Senior It Data Engineer- Dmo Pipelines

The Procter & Gamble Company

Hyderabad, India
Python and sql programming skills
Databricks and spark/pyspark expertise
Azure cloud platform proficiency
The role focuses on accelerating the publication of data to the core Azure data lake by building and enhancing reliable data pipelines

Job Summary

  • The role focuses on accelerating the publication of data to the core Azure data lake by building and enhancing reliable data pipelines.
  • Candidates will optimize Spark jobs for performance and cost while ensuring data quality through robust validation and monitoring practices.
  • P&G offers continuous mentorship, formal training, and a dynamic work environment that values individual initiative and work/life balance.

Matching Summary

The role focuses on accelerating the publication of data to the core Azure data lake by building and enhancing reliable data pipelines.

Skills & Requirements

Must-have

  • Python and SQL programming skills
  • Databricks and Spark/Pyspark expertise
  • Azure cloud platform proficiency
  • Delta Lake data lake architecture
  • CI/CD implementation with Github Actions

Nice-to-have

  • Mentoring junior engineers
  • Understanding of D&A Platform capabilities
  • Experience with external data engineering tools
  • Strong problem-solving abilities
  • Collaborative team environment experience

Key Requirements

  • Maintain technical certifications in Databricks or Azure
  • Implement CI/CD tools like SonarQube and Snyk
  • Strong understanding of distributed computing concepts

Work Rights

Not specified

Tailored Resume

Cover Letter