Data Engineering Lead, Avp

State Street UK

Python java sql programming
Spark sql performance optimization
Snowflake databricks platforms
This role leads the design and delivery of scalable batch and streaming data pipelines using Databricks, Snowflake, Spark, and Informatica ETL

Job Summary

  • This role leads the design and delivery of scalable batch and streaming data pipelines using Databricks, Snowflake, Spark, and Informatica ETL.
  • The successful candidate will own end-to-end implementation of Iceberg-based lakehouse tables including partitioning strategies and schema evolution.
  • State Street offers inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks.

Matching Summary

This role leads the design and delivery of scalable batch and streaming data pipelines using Databricks, Snowflake, Spark, and Informatica ETL.

Skills & Requirements

Must-have

  • Python Java SQL programming
  • Spark SQL performance optimization
  • Snowflake Databricks platforms
  • Apache Iceberg lakehouse tables
  • AWS Azure GCP cloud experience

Nice-to-have

  • Mentoring data engineering teams
  • CI/CD adoption practices
  • Financial enterprise data background
  • Production stability management

Key Requirements

  • Strong hands-on data engineering experience
  • Advanced expertise in Spark and SQL
  • Deep working knowledge of Apache Iceberg

Work Rights

Not specified

Tailored Resume

Cover Letter