Senior Data Engineer

Barclays

Pune, India
Aws data platform experience
Python and pyspark programming
Apache kafka and spark streaming
The role involves building and maintaining systems to collect, store, process, and analyze data ensuring accuracy, accessibility, and security

Job Summary

  • The role involves building and maintaining systems to collect, store, process, and analyze data ensuring accuracy, accessibility, and security.
  • Candidates must have hands-on experience developing cloud solutions on AWS using Glue, Lambda, S3, Redshift, Snowflake, and Databricks.
  • This position requires collaboration with data scientists to build and deploy machine learning models while adhering to strict data governance principles.

Matching Summary

The role involves building and maintaining systems to collect, store, process, and analyze data ensuring accuracy, accessibility, and security.

Skills & Requirements

Must-have

  • AWS data platform experience
  • Python and PySpark programming
  • Apache Kafka and Spark Streaming
  • Data modeling and architecture concepts
  • DevOps pipelines with Jenkins or GitLab
  • Batch and real-time data ingestion

Nice-to-have

  • Financial services industry background
  • Broadridge BPS, IMPACT & Gloss knowledge
  • Machine learning model creation skills
  • Agile methodology proficiency
  • Data governance tools like Alation
  • Strategic thinking and business acumen

Key Requirements

  • Hands-on experience with large scale data platforms
  • Strong understanding of distributed computing paradigms
  • Sound knowledge of data governance principles
  • Experience in financial settlements functions preferred

Work Rights

Not specified

Tailored Resume

Cover Letter