Data Engineer

WPP

Chennai, India
On-site
3+ years designing distributed data pipelines
3+ years experience in python and sql
Extensive databricks platform and pyspark usage
The role involves designing and implementing scalable data solutions utilizing large-scale data ingestion, processing, and streaming on the Databricks platform

Job Summary

  • The role involves designing and implementing scalable data solutions utilizing large-scale data ingestion, processing, and streaming on the Databricks platform.
  • Candidates will be responsible for building secure platforms with data governance in mind while delivering data migrations between legacy and modern systems.
  • WPP offers a culture of creativity and belonging with opportunities to work on projects at an unparalleled scale across 100+ global markets.

Matching Summary

The role involves designing and implementing scalable data solutions utilizing large-scale data ingestion, processing, and streaming on the Databricks platform.

Skills & Requirements

Must-have

  • 3+ years designing distributed data pipelines
  • 3+ years experience in Python and SQL
  • Extensive Databricks platform and PySpark usage
  • Microsoft Azure data services expertise
  • Experience with CI/CD and Agile practices

Nice-to-have

  • Experience with Kafka and Delta Lake
  • Familiarity with Pandas library
  • Exposure to AI and ML technologies
  • Understanding of data governance principles
  • Passion for lifelong learning and collaboration

Key Requirements

  • Minimum 3 years of relevant experience
  • Fluency in English language
  • Demonstrable understanding of CI/CD practices

Work Rights

Not specified

Tailored Resume

Cover Letter