Develop, maintain, and optimize data pipelines in cloud environments (GCP or other clouds) using BigQuery, Dataflow (Apache Beam), and Composer (Apache Airflow)
Job Summary
Develop, maintain, and optimize data pipelines in cloud environments (GCP or other clouds) using BigQuery, Dataflow (Apache Beam), and Composer (Apache Airflow).
Ensure data quality, integrity, and governance across different systems, and perform advanced SQL analysis to support business and AI projects.
Accenture offers a comprehensive benefits package including 100% subsidized health insurance, dental assistance, meal/food vouchers, life insurance, and more.
Matching Summary
Develop, maintain, and optimize data pipelines in cloud environments (GCP or other clouds) using BigQuery, Dataflow (Apache Beam), and Composer (Apache Airflow).
Skills & Requirements
Must-have
Cloud environments (GCP or others)
BigQuery, Dataflow, Composer
DBT and Python for data transformation
SQL and Python
Data integration and systems
Nice-to-have
Innovative and collaborative environment
Modern and scalable solutions
DataOps best practices adoption
Passion for data engineering
Key Requirements
Higher education in technology or related fields
Experience in Cloud (GCP, AWS or Azure)
Experience with databases (Oracle, Sybase, SQL Server or MySQL)
Experience with Apache Airflow, GCP DataFlow and IBM InfoSphere DataStage (Differentiator)