Sr. Databricks Data Engineer, Onsite Avp

State Street UK

Unknown, Unknown, United Kingdom
Base: $91,000 - $140,500 annual; bonus/equity: not...
Databricks sql & scala/pyspark expertise
End-to-end data pipeline development
Azure cloud infrastructure experience
The role involves designing and developing custom high-throughput data pipelines using Databricks to process large volumes of data in near real-time

Job Summary

  • The role involves designing and developing custom high-throughput data pipelines using Databricks to process large volumes of data in near real-time.
  • Candidates will be responsible for the full software development lifecycle, including coding, integration testing, deployment, and documentation of scalable ETL solutions.
  • State Street offers a collaborative environment that values innovation, diverse backgrounds, and provides comprehensive benefits including flexible work programs.

Matching Summary

The role involves designing and developing custom high-throughput data pipelines using Databricks to process large volumes of data in near real-time.

Salary

Base: $91,000 - $140,500 Annual; Bonus/Equity: Not specified; Benefits: Generous medical care, insurance, savings plans, flexible work programs

Skills & Requirements

Must-have

  • Databricks SQL & Scala/PySpark expertise
  • End-to-end data pipeline development
  • Azure cloud infrastructure experience
  • DevOps pipeline troubleshooting skills
  • Microservices and event-driven architecture

Nice-to-have

  • Strong critical thinking and problem-solving
  • Experience in financial industry domain
  • Agile development methodology background
  • Collaboration across global teams
  • Positive attitude with self-motivation

Key Requirements

  • Bachelor's degree in Computer Science or IT
  • 7+ years overall IT experience
  • 5+ years Data Engineering experience
  • 3+ years Databricks hands-on experience
  • 3+ years Azure/AWS cloud development

Work Rights

Not specified

Tailored Resume

Cover Letter