In_senior Associate_ Pyspark Developer _data & Analytics _advisory _kolkjata

PwC

Mumbai, India
Onsite
Hands-on experience building data pipelines on hadoop/spark ecosystem
Strong spark (scala and/or pyspark), hive/impala sql
Working knowledge of kafka for streaming ingestion
At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities

Job Summary

  • At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities.
  • You will develop and implement innovative solutions to optimize business performance and enhance competitive advantage.
  • We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life.

Matching Summary

At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities.

Skills & Requirements

Must-have

  • Hands-on experience building data pipelines on Hadoop/Spark ecosystem
  • Strong Spark (Scala and/or PySpark), Hive/Impala SQL
  • Working knowledge of Kafka for streaming ingestion
  • Experience with Cloudera Manager, YARN/Tez, HDFS
  • Proficiency in Linux/Unix, Shell scripting, Git, and CI/CD
  • Strong SQL and data modelling for BFSI use cases

Nice-to-have

  • Experience with Cloudera Data Platform (CDP)
  • Cloud data services – AWS, Azure, or GCP
  • Databricks experience
  • Containerization and orchestration (Docker/Kubernetes)
  • Monitoring/observability – Grafana/Prometheus

Key Requirements

  • 4—7 Years of experience required
  • B.E.(B.Tech)/M.E/M.Tech Education qualification
  • ETL Testing mandatory skill sets

Work Rights

Not specified

Tailored Resume

Cover Letter