Data Engineering Manager – (data Core Processing Team) – Hyderabad
Warner Bros. Discovery
Hyderabad, India
On-site
Data processing frameworks (spark, kafka, flink)
Cloud platforms (aws, gcp, azure)
Batch and streaming data architectures
Lead, mentor, and grow a team of 6–10 software and data engineers, fostering a culture of collaboration and engineering excellence
Job Summary
Lead, mentor, and grow a team of 6–10 software and data engineers, fostering a culture of collaboration and engineering excellence.
Define and execute the technical roadmap for data processing infrastructure, designing and building scalable data pipelines for structured, semi-structured, and unstructured data.
Establish monitoring, alerting, and observability frameworks for data systems, ensuring compliance with data governance, privacy, and security standards.
Matching Summary
Lead, mentor, and grow a team of 6–10 software and data engineers, fostering a culture of collaboration and engineering excellence.
Skills & Requirements
Must-have
Data processing frameworks (Spark, Kafka, Flink)
Cloud platforms (AWS, GCP, Azure)
Batch and streaming data architectures
Data modeling and schema design
DevOps best practices and automation
Nice-to-have
Experience with unstructured data
Contributions to open-source projects
Vector databases and semantic search
Key Requirements
13 - 15 years of experience in data engineering
3+ years of experience in engineering management
Proficiency in Python, SQL, Java/Scala, or Go
Experience with modern data storage formats (Parquet, Avro, Delta Lake)
Experience with orchestration tools (Airflow, Prefect, Temporal)