3+ years designing scalable distributed data pipelines
Extensive experience with microsoft azure data services
Must have databricks platform and pyspark expertise
The role focuses on delivering solutions that utilize large-scale data ingestion, processing, storage, streaming, and batch analytics using Databricks
Job Summary
The role focuses on delivering solutions that utilize large-scale data ingestion, processing, storage, streaming, and batch analytics using Databricks.
Candidates will be responsible for designing, building, testing, and maintaining ELT data pipelines according to business requirements.
WPP offers a hybrid work approach with teams in the office around four days a week alongside opportunities to influence projects at an industry-unparalleled scale.
Matching Summary
The role focuses on delivering solutions that utilize large-scale data ingestion, processing, storage, streaming, and batch analytics using Databricks.
Skills & Requirements
Must-have
3+ years designing scalable distributed data pipelines
Extensive experience with Microsoft Azure data services
Must have Databricks platform and PySpark expertise
Nice-to-have
Experience with Kafka, Delta Lake, and Pandas
Exposure to AI and ML technologies
Passion for lifelong learning and collaboration
Key Requirements
Minimum 3 years of experience in Python and SQL
Demonstrable understanding of CI/CD and Agile practices