In_senior Associate_ Pyspark Developer _data & Analytics _advisory _kolkata

263

Kolkata, , India
Onsite
Hands-on experience building data pipelines on hadoop/spark ecosystem
Strong spark (scala and/or pyspark), hive/impala sql
Working knowledge of kafka for streaming ingestion
PwC is seeking a Senior Associate PySpark Developer for their Data & Analytics team in Kolkata. The role involves building data pipelines using Hadoop/Spark, with a focus on optimizing business performance through advanced analytics techniques

Job Summary

  • At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities.
  • We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life.
  • We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firm’s growth.

Matching Summary

Match Score: 85

PwC is seeking a Senior Associate PySpark Developer for their Data & Analytics team in Kolkata. The role involves building data pipelines using Hadoop/Spark, with a focus on optimizing business performance through advanced analytics techniques.

Skills & Requirements

Must-have

  • Hands-on experience building data pipelines on Hadoop/Spark ecosystem
  • Strong Spark (Scala and/or PySpark), Hive/Impala SQL
  • Working knowledge of Kafka for streaming ingestion
  • Experience with Cloudera Manager, YARN/Tez, HDFS
  • Proficiency in Linux/Unix, Shell scripting, Git, and CI/CD
  • Strong SQL and data modelling for BFSI use cases
  • Develop robust Spark jobs (batch and streaming)

Nice-to-have

  • Experience with Cloudera Data Platform (CDP)
  • Security and governance: Apache Ranger, Atlas
  • Cloud data services – AWS, Azure, or GCP
  • Databricks experience (Spark, Delta Lake)
  • Containerization and orchestration (Docker/Kubernetes)
  • Monitoring/observability – Cloudera Manager metrics

Key Requirements

  • 4—7 Years of experience
  • B.E.(B.Tech)/M.E/M.Tech
  • Master of Business Administration, Bachelor of Engineering, Bachelor of Technology

Work Rights

Not specified

Tailored Resume

Cover Letter