In_senior Associate_spark Scala_data And Analytics_advisory_bangalore
PwC
Bangalore, India
Spark scala data processing pipelines
Hive-based data models and etl
Oozie / airflow workflow scheduling
At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities
Job Summary
At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities.
You will design, develop, and optimize large-scale data processing pipelines using Spark (Scala) and implement robust, reusable, and efficient data transformation logic.
We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life.
Matching Summary
At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities.
Skills & Requirements
Must-have
Spark Scala data processing pipelines
Hive-based data models and ETL
Oozie / Airflow workflow scheduling
CI/CD pipelines using GitHub Actions
Maven or SBT dependency management
Spark jobs performance optimization
Data ingestion across diverse sources
Nice-to-have
Leveraging data for insights
Optimizing business performance
Enhancing competitive advantage
Driving informed decision-making
Advanced functional programming techniques
Containerization with Docker
Kubernetes for deployment and scaling
Kafka / streaming pipelines
Key Requirements
4-8 years of experience
B.E, B.Tech, M.E, MCA, M.Tech degrees
Master of Engineering, Bachelor of Engineering, MBA preferred