In_sr Associate_ Data Engineer Spark, Scala_d&a_advisory_bangalore
PwC
Bangalore, India
Spark scala data processing pipelines
Hive data models and etl
Oozie airflow workflow scheduling
Leverage data to drive insights and make informed business decisions using advanced analytics techniques to help clients optimize operations and achieve strategic goals
Job Summary
Leverage data to drive insights and make informed business decisions using advanced analytics techniques to help clients optimize operations and achieve strategic goals.
Design, develop, and optimize large-scale data processing pipelines using Spark (Scala) and implement robust, reusable, and efficient data transformation logic.
At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities.
Matching Summary
Leverage data to drive insights and make informed business decisions using advanced analytics techniques to help clients optimize operations and achieve strategic goals.
Skills & Requirements
Must-have
Spark Scala data processing pipelines
Hive data models and ETL
Oozie Airflow workflow scheduling
CI/CD GitHub Actions
Maven SBT dependency management
Spark job optimization
Nice-to-have
Financial Service domain experience
Tableau power BI knowledge
Docker containerization knowledge
Kubernetes deployment scaling
Key Requirements
8+ years of experience
Business Analysis, BRD, FRD, Requirement Gathering