The role involves designing and maintaining scalable ETL/ELT pipelines using Azure Data Factory and optimizing data workflows with Azure Databricks
Job Summary
The role involves designing and maintaining scalable ETL/ELT pipelines using Azure Data Factory and optimizing data workflows with Azure Databricks.
Candidates will work across Lakehouse architecture layers to implement real-time data ingestion and ensure high data quality through dbt tests.
Conduent offers a culture where individuality is valued, providing opportunities to make a difference while working with Fortune 100 companies and governments.
Matching Summary
The role involves designing and maintaining scalable ETL/ELT pipelines using Azure Data Factory and optimizing data workflows with Azure Databricks.
Skills & Requirements
Must-have
Azure Data Factory (ADF)
Azure Databricks PySpark
Lakehouse architecture Bronze Silver Gold
dbt models for transformation
Azure Event Hub real-time ingestion
Power BI and SQL expertise
Nice-to-have
Unity Catalog metadata-driven design
Git version control experience
CI/CD process knowledge
Production support willingness
Cross-functional collaboration skills
Key Requirements
Strong technical expertise in Power BI and SQL
Experience with Azure Data Lake Storage (ADLS)
Knowledge of data warehousing concepts and ELT methodologies