Design, develop, and implement data models, ETL processes, and data pipelines to ensure efficient and accurate data flow using Databricks
Job Summary
Design, develop, and implement data models, ETL processes, and data pipelines to ensure efficient and accurate data flow using Databricks.
Provide technical guidance, mentoring, and support, implementing and enforcing architectural standards and frameworks to ensure a flexible and scalable data environment.
Collaborate with cross-functional teams to gather requirements, analyze data, and design effective solutions, playing a key role in DevOps activities.
Matching Summary
Design, develop, and implement data models, ETL processes, and data pipelines to ensure efficient and accurate data flow using Databricks.
Skills & Requirements
Must-have
Databricks development using Python
PySpark & DLT Pipelines
ETL processes and data pipelines
database management
Azure Data Factory
Change Data Capture (CDC)
Nice-to-have
holistic thinking and action
goal orientation
DevOps activities
industry trends and technologies
Key Requirements
7+ Years of experience in Data Engineering & Analytics
Degree in computer science or similar field
Experience working with Azure / AWS
Strong understanding of Data warehousing, engineering & ETL concepts