Lead Aws Data Engineer

London Stock Exchange Group

Not specified; not specified; benefits include hea...
Python programming with type hints
Apache spark for large-scale processing
Aws data stack experience including glue and s3
The role involves designing and developing scalable, testable data pipelines using Python and Apache Spark within a modern AWS environment

Job Summary

  • The role involves designing and developing scalable, testable data pipelines using Python and Apache Spark within a modern AWS environment.
  • Candidates will collaborate closely with business teams to translate requirements into data-driven solutions while contributing to a lakehouse architecture.
  • LSEG offers a culture of innovation and continuous improvement with tailored benefits including healthcare, retirement planning, and paid volunteering days.

Matching Summary

The role involves designing and developing scalable, testable data pipelines using Python and Apache Spark within a modern AWS environment.

Salary

Not specified; Not specified; Benefits include healthcare, retirement planning, and paid volunteering days

Skills & Requirements

Must-have

  • Python programming with type hints
  • Apache Spark for large-scale processing
  • AWS data stack experience including Glue and S3
  • Building ETL pipelines and batch processing
  • CI/CD and version control practices

Nice-to-have

  • Experience with Apache Iceberg table formats
  • Familiarity with data quality frameworks
  • Curiosity about financial markets domain
  • Collaboration in Agile team environments

Key Requirements

  • Clean maintainable Python code skills
  • Understanding of schema evolution concepts
  • Agile team collaboration experience

Work Rights

Not specified

Tailored Resume

Cover Letter