Lead Aws Data Engineer

London Stock Exchange Group

Divyasree Technopolis, India
On-site
Python
Apache spark
Aws data stack
The London Stock Exchange Group is seeking a Lead AWS Data Engineer to join its team at FTSE Russell in India. The ideal candidate will design scalable data systems and work within a collaborative environment focused on innovation, quality, and continuous improvement

Job Summary

  • Design and develop scalable, testable data pipelines using Python and Apache Spark, orchestrating data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3.
  • Apply modern software engineering practices including version control, CI/CD, modular design, and automated testing, while contributing to the development of a lakehouse architecture using Apache Iceberg.
  • Collaborate with business teams to translate requirements into data-driven solutions, build observability into data flows, and implement basic quality checks.

Matching Summary

Match Score: 85

The London Stock Exchange Group is seeking a Lead AWS Data Engineer to join its team at FTSE Russell in India. The ideal candidate will design scalable data systems and work within a collaborative environment focused on innovation, quality, and continuous improvement.

Skills & Requirements

Must-have

  • Python
  • Apache Spark
  • AWS data stack
  • ETL pipelines
  • version control
  • CI/CD
  • automated testing

Nice-to-have

  • lakehouse architecture
  • Apache Iceberg
  • financial indices domain
  • data quality frameworks
  • GitLab CI
  • Jenkins
  • GitHub Actions

Key Requirements

  • Writes clean, maintainable Python code
  • Understands data engineering basics
  • Experience with Apache Spark
  • Familiar with AWS data stack
  • Works well in Agile teams

Work Rights

Not specified

Tailored Resume

Cover Letter