In_senior Associate_ Pyspark Developer _data & Analytics _advisory _kolkjata

Jobs Ta Pwc

Kolkata, , India
Onsite
Hands-on experience building data pipelines on hadoop/spark ecosystem
Strong spark (scala and/or pyspark), hive/impala sql
Working knowledge of kafka for streaming ingestion
PwC is seeking a Senior Associate PySpark Developer for their Advisory team in Kolkata, focusing on data and analytics solutions. The role requires expertise in building data pipelines using Hadoop/Spark and experience with various data processing and orchestration tools

Job Summary

  • At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities.
  • Develop and implement innovative solutions to optimise business performance and enhance competitive advantage.
  • We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life.

Matching Summary

Match Score: 85

PwC is seeking a Senior Associate PySpark Developer for their Advisory team in Kolkata, focusing on data and analytics solutions. The role requires expertise in building data pipelines using Hadoop/Spark and experience with various data processing and orchestration tools.

Skills & Requirements

Must-have

  • Hands-on experience building data pipelines on Hadoop/Spark ecosystem
  • Strong Spark (Scala and/or PySpark), Hive/Impala SQL
  • Working knowledge of Kafka for streaming ingestion
  • Experience with Cloudera Manager, YARN/Tez, HDFS
  • Proficiency in Linux/Unix, Shell scripting, Git
  • Strong SQL and data modelling for BFSI use cases

Nice-to-have

  • Experience with Cloudera Data Platform (CDP)
  • Cloud data services – AWS, Azure, or GCP
  • Databricks experience (Spark, Delta Lake)
  • Containerization and orchestration (Docker/Kubernetes)
  • Monitoring/observability – Grafana/Prometheus

Key Requirements

  • 4—7 Years of experience
  • ETL Testing
  • Bachelor of Engineering, Master of Business Administration, Bachelor of Technology

Work Rights

Not specified

Tailored Resume

Cover Letter