Data Engineering Manager – (data Core Processing Team) – Hyderabad
Warner Bros. Discovery
Hyderabad, India
Data processing frameworks (spark, kafka, flink)
Cloud platforms (aws, gcp, azure)
Batch and streaming data architectures
Lead, mentor, and grow a team of 6–10 software and data engineers, fostering a culture of collaboration and engineering excellence
Job Summary
Lead, mentor, and grow a team of 6–10 software and data engineers, fostering a culture of collaboration and engineering excellence.
Define and execute the technical roadmap for data processing infrastructure and design and build scalable data pipelines for structured, semi-structured, and unstructured data.
Ensure data quality, reliability, and consistency across pipelines, optimize system performance, and manage infrastructure costs effectively.
Matching Summary
Lead, mentor, and grow a team of 6–10 software and data engineers, fostering a culture of collaboration and engineering excellence.
Skills & Requirements
Must-have
Data processing frameworks (Spark, Kafka, Flink)
Cloud platforms (AWS, GCP, Azure)
Batch and streaming data architectures
Data modeling and schema design
DevOps best practices and automation
Monitoring, alerting, and observability frameworks
Nice-to-have
Working with unstructured data
Modern data stack knowledge
AI/ML data pipelines
Vector databases and semantic search
Key Requirements
13-15 years in data engineering or distributed systems
3+ years in engineering management
Proficiency in Python, SQL, Java/Scala, or Go
Experience with cloud data services
Experience with data storage formats (Parquet, Avro, Delta Lake)
Experience with orchestration tools (Airflow, Prefect)
Experience with containerization (Docker, Kubernetes)