Hands-on spark optimization and debugging experience
Deep understanding of apache iceberg open table formats
The role involves designing and building core services for an open-architecture data platform to enable scalable ingestion and governance
Job Summary
The role involves designing and building core services for an open-architecture data platform to enable scalable ingestion and governance.
Engineers will collaborate with Platform and Data Engineering teams to deliver secure, observable, production-grade capabilities supporting critical data initiatives.
State Street offers inclusive development opportunities, flexible work-life support, and vibrant employee networks to foster a valued and empowered workforce.
Matching Summary
The role involves designing and building core services for an open-architecture data platform to enable scalable ingestion and governance.
Salary
Not specified; Not specified; Not specified
Skills & Requirements
Must-have
Strong Python and Java programming skills
Hands-on Spark optimization and debugging experience
Deep understanding of Apache Iceberg open table formats
Experience with Snowflake and Databricks platforms
Knowledge of SQL optimization for large-scale analytics
Nice-to-have
Rust programming language knowledge
Familiarity with Kafka streaming pipelines
Experience with Kubernetes and containerization
Background in financial or data platforms
Knowledge of Polaris, Horizon, or Unity Catalogs
Key Requirements
Strong programming skills in Python and Java
Hands-on experience with Spark optimization
Deep understanding of distributed computing
Production-grade service experience in cloud environments
Experience with CI/CD and automated testing practices