The role is accountable for building and operating end-to-end batch and streaming data pipelines on lakehouse platforms to enable the investment management business
Job Summary
The role is accountable for building and operating end-to-end batch and streaming data pipelines on lakehouse platforms to enable the investment management business.
Candidates must deliver production-grade pipeline code using Python, Java/Scala, and SQL while implementing automated data quality and observability measures.
State Street fosters an inclusive environment where employees benefit from flexible work-life support, paid volunteer days, and vibrant employee networks.
Matching Summary
The role is accountable for building and operating end-to-end batch and streaming data pipelines on lakehouse platforms to enable the investment management business.
Skills & Requirements
Must-have
10+ years software or data engineering experience
Python, SQL, Java/Scala programming skills
Apache Spark batch and streaming processing
Snowflake and Databricks cloud platforms
Lakehouse architecture with Apache Iceberg
AWS cloud environment pipeline development
Nice-to-have
Capital Markets domain knowledge
Data quality and lineage tooling experience
Snowflake or Databricks professional certificates
Cloud provider certifications (AWS/GCP/Azure)
Strong communication with global stakeholders
Key Requirements
BS/MS in Computer Science or equivalent practical experience
10+ years of experience in software and/or data engineering
Hands-on experience with distributed data processing principles