In_sr Associate_ Data Engineer Spark, Scala_d&a_advisory_bangalore
PwC
Bangalore, India
Spark (scala) data processing pipelines
Hive-based data models and etl
Oozie / airflow workflow management
At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities
Job Summary
At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities.
Design, develop, and optimize large-scale data processing pipelines using Spark (Scala) and implement robust, reusable, and efficient data transformation logic.
We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life.
Matching Summary
At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities.
Skills & Requirements
Must-have
Spark (Scala) data processing pipelines
Hive-based data models and ETL
Oozie / Airflow workflow management
CI/CD with GitHub Actions
Maven or SBT dependency management
Spark job debugging and optimization
Nice-to-have
Containerization with Docker
Kubernetes deployment and scaling
Kafka streaming pipelines
Financial Service domain experience
Key Requirements
8+ years of experience
B.E, B.Tech, MBA, M.Tech, M.E, MCA education
Business Analysis, BRD, FRD, Requirement Gathering