The role involves designing and operating scalable batch and streaming pipelines to deliver analytics-ready datasets for critical financial data domains
Job Summary
The role involves designing and operating scalable batch and streaming pipelines to deliver analytics-ready datasets for critical financial data domains.
Candidates will partner with domain experts to define data semantics, stewardship expectations, and consumption contracts for security and holdings data.
State Street fosters an inclusive environment with flexible work-life support, paid volunteer days, and vibrant employee networks.
Matching Summary
The role involves designing and operating scalable batch and streaming pipelines to deliver analytics-ready datasets for critical financial data domains.
Skills & Requirements
Must-have
Python Java SQL programming skills
Snowflake Databricks platform experience
Apache Iceberg table implementation
Spark SQL optimization and debugging
Batch and streaming pipeline development
AWS GCP Azure cloud environments
Nice-to-have
Informatica ETL reuse knowledge
Polaris Horizon Unity catalog experience
CI/CD deployment standardization
Domain SME partnership collaboration
Automated data validation implementation
Key Requirements
Strong data engineering programming skills
Hands-on experience with Snowflake and Databricks
Production-grade service building in cloud environments
Experience with structured and unstructured ingestion