The role is accountable for building and operating end-to-end batch and streaming data pipelines on lakehouse platforms like Snowflake and Databricks
Job Summary
The role is accountable for building and operating end-to-end batch and streaming data pipelines on lakehouse platforms like Snowflake and Databricks.
Candidates must possess strong hands-on expertise in distributed data processing and cloud-based data platforms with a focus on reliable delivery.
State Street fosters an inclusive environment where employees benefit from flexible work-life support, paid volunteer days, and vibrant employee networks.
Matching Summary
The role is accountable for building and operating end-to-end batch and streaming data pipelines on lakehouse platforms like Snowflake and Databricks.
Salary
Not specified; Not specified; Not specified
Skills & Requirements
Must-have
10+ years software or data engineering experience
Python and SQL programming skills
Apache Spark batch and streaming expertise
Snowflake and Databricks platform operations
Cloud environment pipeline development AWS preferred
Lakehouse components Apache Iceberg knowledge
Nice-to-have
Capital Markets domain understanding
Java or Scala programming background
Data quality framework implementation
Automated reconciliation patterns
Global stakeholder collaboration skills
Key Requirements
BS/MS in Computer Science or equivalent practical experience
10+ years of experience in software and/or data engineering
Working knowledge of open table formats like Apache Iceberg