Senior Data Engineer

Barclays

Pune, India
Aws data platform
Data ingestion programs
Python and py-spark
Build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure

Job Summary

  • Build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.
  • Collaborate with data scientists to build and deploy machine learning models.
  • Contribute or set strategy, drive requirements and make recommendations for change.

Matching Summary

Build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.

Skills & Requirements

Must-have

  • AWS data platform
  • data ingestion programs
  • Python and Py-Spark
  • DevOps Pipelines
  • data modelling and architecture
  • Agile Methodology

Nice-to-have

  • financial services industry experience
  • Broadridge BPS, IMPACT & Gloss products
  • machine learning model creation

Key Requirements

  • Hands on experience with large scale data platforms
  • Development of cloud solutions in AWS
  • Experience with Glue, Lambda, S3, Redshift, Snowflake, Databricks
  • Experience with Apache Kafka, Spark Streaming
  • Experience with Jenkins, GitLab
  • Knowledge of data governance principles and tools
  • Experience in financial services industry

Work Rights

Not specified

Tailored Resume

Cover Letter