In_senior Associate_ Pyspark Developer _data & Analytics _advisory _kolkjata

PwC

Mumbai, India
Onsite
Hands-on experience building data pipelines on hadoop/spark ecosystem
Strong spark (scala and/or pyspark), hive/impala sql
Working knowledge of kafka for streaming ingestion
At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities

Job Summary

  • At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities.
  • We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life.
  • We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firm’s growth.

Matching Summary

At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities.

Skills & Requirements

Must-have

  • Hands-on experience building data pipelines on Hadoop/Spark ecosystem
  • Strong Spark (Scala and/or PySpark), Hive/Impala SQL
  • Working knowledge of Kafka for streaming ingestion
  • Experience with Cloudera Manager, YARN/Tez, HDFS
  • Proficiency in Linux/Unix, Shell scripting, Git, and CI/CD
  • Strong SQL and data modelling for BFSI use cases
  • Develop robust Spark jobs (batch and streaming)

Nice-to-have

  • Experience with Cloudera Data Platform (CDP)
  • Security and governance: Apache Ranger, Atlas
  • Cloud data services – AWS, Azure, or GCP
  • Databricks experience
  • Containerization and orchestration (Docker/Kubernetes)
  • Monitoring/observability – Grafana/Prometheus

Key Requirements

  • 4—7 Years experience
  • B.E.(B.Tech)/M.E/M.Tech
  • Bachelor of Engineering, Master of Business Administration, Bachelor of Technology

Work Rights

Not specified

Tailored Resume

Cover Letter