Data Designer/engineer

Barclays

Pune, India
Aws data engineering (s3, glue, emr, athena, iam)
Advanced python for data engineering
Apache spark / pyspark
Build and maintain systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure

Job Summary

  • Build and maintain systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.
  • Design and implement data warehouses and data lakes that manage appropriate data volumes and velocity and adhere to required security measures.
  • Collaborate with data scientists to build and deploy machine learning models, and advise and influence decision making.

Matching Summary

Build and maintain systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.

Skills & Requirements

Must-have

  • AWS data engineering (S3, Glue, EMR, Athena, IAM)
  • Advanced Python for data engineering
  • Apache Spark / PySpark
  • Databricks (development, optimisation, notebooks, jobs)
  • Apache Airflow and Astronomer
  • Strong SQL skills
  • CI/CD, Git, DevOps for data platforms

Nice-to-have

  • Ownership and accountability for deliverables
  • Problem-solving and analytical mindset
  • Effective communication
  • Mentoring junior engineers
  • Championing engineering excellence
  • Collaboration with data scientists

Key Requirements

  • Bachelor’s or master’s degree in computer science, Engineering, or related field
  • Cloud or data engineering certifications (AWS / Databricks) desirable
  • Experience working in financial services or regulated environments
  • Understanding of risk, controls, and non-functional requirements

Work Rights

Not specified

Tailored Resume

Cover Letter