Lead Aws Software Data Engineer

LSEG

Not specified; not specified; benefits include hea...
Python programming with type hints
Apache spark for large-scale processing
Aws data stack (glue, emr, lambda, s3)
You will help power the indices trusted by financial institutions worldwide while working in a modern AWS environment

Job Summary

  • You will help power the indices trusted by financial institutions worldwide while working in a modern AWS environment.
  • The role involves designing scalable, testable data pipelines using Python and Apache Spark within a collaborative Agile team.
  • LSEG offers a culture of growth, diversity, and innovation with tailored benefits including healthcare, retirement planning, and paid volunteering days.

Matching Summary

You will help power the indices trusted by financial institutions worldwide while working in a modern AWS environment.

Salary

Not specified; Not specified; Benefits include healthcare, retirement planning, paid volunteering days, and wellbeing initiatives

Skills & Requirements

Must-have

  • Python programming with type hints
  • Apache Spark for large-scale processing
  • AWS data stack (Glue, EMR, Lambda, S3)
  • Relational database experience Aurora PostgreSQL
  • CI/CD and automated testing practices

Nice-to-have

  • Experience with Apache Iceberg table formats
  • Familiarity with Great Expectations or Deequ
  • Curiosity about financial markets and indices
  • Collaborative Agile team environment
  • Exposure to Databricks platform

Key Requirements

  • Strong experience in relational databases
  • Ability to write clean, maintainable Python code
  • Understanding of batch processing and schema evolution

Work Rights

Not specified

Tailored Resume

Cover Letter