Lead Data Engineer

Disney Streaming

Santa Monica, CA, USA
Santa monica, ca: $155,700 - $208,700; new york ci...
Spark data pipelines
Kafka/kinesis streaming pipelines
Low-latency online feature stores
The Search Machine Learning (ML) team powers the ML aspects of search engines for Disney+ platform

Job Summary

  • The Search Machine Learning (ML) team powers the ML aspects of search engines for Disney+ platform.
  • You will be leading the data operation aspects of our ML services, from data warehousing, building and owning ETL pipelines, and standing up feature stores for low-latency feature access to our ML micro-services.
  • This is a highly collaborative role, where you will be able to own the entire lifecycle of data pipelines, communicate your requirements with upstream DATA teams, bring your data engineering skills and ideas into life by engineering efficient data pipelines, and help supporting the feature requirements by the ML engineers/data scientists.

Matching Summary

The Search Machine Learning (ML) team powers the ML aspects of search engines for Disney+ platform.

Salary

Santa Monica, CA: $155,700 - $208,700; New York City: $163,100 - $218,700; San Francisco, CA: $170,500 - $228,600; Bonus and/or long-term incentive units may be provided; Full range of medical, financial, and/or other benefits

Skills & Requirements

Must-have

  • Spark data pipelines
  • Kafka/Kinesis streaming pipelines
  • Low-latency online feature stores
  • ML micro-services integration
  • Data warehousing and ETL

Nice-to-have

  • Vector database familiarity
  • Cross-team data modeling
  • Mentoring junior engineers
  • Storytelling and innovation culture

Key Requirements

  • 7+ years data engineering experience
  • 2+ years Feature Store experience
  • Experience with sagemaker/Redis
  • Experience with large-scale distributed data processing
  • Bachelor's degree in Computer Science or related field

Work Rights

Not specified

Tailored Resume

Cover Letter