3+ years designing scalable distributed data pipelines
3+ years experience in python and sql
Extensive experience with microsoft azure data services
You will be responsible for the design and implementation of scalable data solutions providing enterprise-scale data transformation across a broad range of projects
Job Summary
You will be responsible for the design and implementation of scalable data solutions providing enterprise-scale data transformation across a broad range of projects.
The role focuses on delivering solutions that utilize large-scale data ingestion, processing, storage/querying, streaming, and batch analytics using Databricks.
WPP offers a culture of creativity, belonging, and continuous learning with opportunities to work at an unparalleled scale in the industry.
Matching Summary
You will be responsible for the design and implementation of scalable data solutions providing enterprise-scale data transformation across a broad range of projects.
Skills & Requirements
Must-have
3+ years designing scalable distributed data pipelines
3+ years experience in Python and SQL
Extensive experience with Microsoft Azure data services
Must have Databricks platform and PySpark experience
Nice-to-have
Experience with Kafka, Delta Lake, and Pandas
Exposure to AI and ML technologies
Understanding of CI/CD and Agile practices
Key Requirements
Minimum 3 years of experience in data engineering
Fluency in English required
Demonstrable understanding of CI/CD and Azure DevOps