The role involves owning end-to-end batch and streaming pipelines while designing logical and physical data models for Core Reference Data and Security Master systems
Job Summary
The role involves owning end-to-end batch and streaming pipelines while designing logical and physical data models for Core Reference Data and Security Master systems.
Candidates will partner with domain experts to define data semantics and stewardship expectations for critical financial datasets including IBOR holdings and transactions.
State Street fosters an inclusive environment with flexible work-life support, paid volunteer days, and vibrant employee networks to help staff reach their full potential.
Matching Summary
The role involves owning end-to-end batch and streaming pipelines while designing logical and physical data models for Core Reference Data and Security Master systems.
Skills & Requirements
Must-have
Python Java SQL programming skills
Snowflake and Databricks platform experience
Apache Iceberg table implementation
Spark optimization and debugging
Batch and streaming pipeline development
Nice-to-have
Cloud environment experience AWS GCP Azure
Informatica ETL knowledge
API and BI endpoint design
CI/CD deployment standardization
Domain SME collaboration skills
Key Requirements
Strong programming skills in Python Java and SQL
Hands-on experience with Spark and SQL optimization
Experience building production-grade services in cloud environments