In_sr Associate_ Data Engineer Spark, Scala_d&a_advisory_bangalore

PwC

Bangalore, India
Spark (scala) data processing pipelines
Data transformation logic
Hive-based data models
Design, develop, and optimize large-scale data processing pipelines using Spark (Scala)

Job Summary

  • Design, develop, and optimize large-scale data processing pipelines using Spark (Scala).
  • Collaborate with cross-functional teams including Data Analysts, Architects, and Business stakeholders.
  • At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities.

Matching Summary

Design, develop, and optimize large-scale data processing pipelines using Spark (Scala).

Skills & Requirements

Must-have

  • Spark (Scala) data processing pipelines
  • Data transformation logic
  • Hive-based data models
  • ETL processes
  • Oozie / Airflow workflow management
  • CI/CD pipelines GitHub Actions
  • Maven or SBT dependency management
  • Spark job optimization

Nice-to-have

  • Containerization with Docker
  • Kubernetes deployment and scaling
  • Kafka / streaming pipelines
  • Financial Service domain experience
  • Tableau
  • Power BI

Key Requirements

  • 8+ years of experience
  • Business Analysis
  • BRD
  • FRD
  • Requirement Gathering

Work Rights

Not specified

Tailored Resume

Cover Letter