Lead Data Engineer

Barclays

Pune, India
Aws s3, ec2, lambda, rds, glue, athena
Data pipelines and step functions
Distributed computing architecture
Build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure

Job Summary

  • Build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.
  • Lead a team performing complex tasks, using well developed professional knowledge and skills to deliver on work that impacts the whole business function.
  • Join us as a Lead Data Engineer at Barclays, where you'll take part in the evolution of our digital landscape, driving innovation and excellence.

Matching Summary

Build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.

Skills & Requirements

Must-have

  • AWS S3, EC2, Lambda, RDS, Glue, Athena
  • Data pipelines and step functions
  • Distributed computing architecture
  • Core Hadoop components (HDFS, Spark, Yarn, HIVE, Impala)
  • SQL and advanced SQL skills
  • Shell scripting and programming (Scala/Python)
  • ETL technologies (preferably Ab Initio)

Nice-to-have

  • Skilled communicator at various levels
  • Collaborative and able to share best practice
  • Risk and controls expertise
  • Change and transformation experience
  • Business acumen and strategic thinking
  • Digital and technology understanding

Key Requirements

  • Experience with AWS services
  • Experience with distributed computing
  • Expertise in SQL
  • Expertise in Scala/Python
  • Experience with ETL technologies
  • Good exposure to Data Warehousing

Work Rights

Not specified

Tailored Resume

Cover Letter