In_sr Associate_ Data Engineer Spark, Scala_d&a_advisory_bangalore
PwC
Bangalore, India
Spark (scala)
Data processing pipelines
Data transformation logic
Design, develop, and optimize large-scale data processing pipelines using Spark (Scala) and implement robust, reusable, and efficient data transformation logic leveraging advanced functional programming techniques
Job Summary
Design, develop, and optimize large-scale data processing pipelines using Spark (Scala) and implement robust, reusable, and efficient data transformation logic leveraging advanced functional programming techniques.
Develop and maintain Hive-based data models and ETL processes, schedule and manage workflows using Oozie / Airflow, and implement CI/CD pipelines using GitHub Actions for automated build, test, and deployment.
At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities, powered by technology in an environment that drives innovation.
Matching Summary
Design, develop, and optimize large-scale data processing pipelines using Spark (Scala) and implement robust, reusable, and efficient data transformation logic leveraging advanced functional programming techniques.