Building data platforms with critical components including data warehouses and data lakes using tools like Azure Databricks, MS Fabric, and Azure Data Factory for extraction, transformation and loading
Job Summary
Building data platforms with critical components including data warehouses and data lakes using tools like Azure Databricks, MS Fabric, and Azure Data Factory for extraction, transformation and loading.
Conducting comprehensive data assessments alongside Data Modelers and Analysts across multiple systems of record and data domains to identify and remediate data quality issues.
Liaising with client senior stakeholders and supporting Senior Data Architects to gather functional requirements to design modern data architecture.
Matching Summary
Building data platforms with critical components including data warehouses and data lakes using tools like Azure Databricks, MS Fabric, and Azure Data Factory for extraction, transformation and loading.
Skills & Requirements
Must-have
Azure Databricks, MS Fabric, Azure Data Factory
Medallion architecture data flow
Data quality assessment and remediation
Python (PySpark) and SQL scripting
CI/CD practices with Azure DevOps/Jira
Nice-to-have
Cloud certifications (Azure, AWS, GCP)
Data Governance certifications
Agentic AI for data automation
Data Strategy and Governance projects
Agile project management (Scrum)
Key Requirements
Minimum 3 years in data engineering roles
Hands-on experience with data transformation tools
Experience building data warehouses, data lakes, data lakehouses