3+ years designing scalable distributed data pipelines
Extensive experience with microsoft azure data services
Proficiency in python and sql for data engineering
You will be responsible for the design and implementation of scalable data solutions providing enterprise-scale data transformation across a broad range of projects
Job Summary
You will be responsible for the design and implementation of scalable data solutions providing enterprise-scale data transformation across a broad range of projects.
The role involves delivering solutions that utilize large-scale data ingestion, processing, storage/querying, streaming, and batch analytics using Databricks on Azure.
WPP offers a culture of creativity, belonging, and continuous learning with opportunities to work at an unparalleled scale in the industry.
Matching Summary
You will be responsible for the design and implementation of scalable data solutions providing enterprise-scale data transformation across a broad range of projects.
Skills & Requirements
Must-have
3+ years designing scalable distributed data pipelines
Extensive experience with Microsoft Azure data services
Proficiency in Python and SQL for data engineering
Must have experience using Databricks platform and PySpark
Nice-to-have
Experience with Kafka, Delta Lake, and Pandas libraries
Exposure to AI and ML technologies
Understanding of CI/CD practices and Agile methodologies
Passion for lifelong learning and collaboration
Key Requirements
Minimum 3 years of experience in data pipeline design
Fluency in English required
Demonstrable understanding of CI/CD and unit testing