Design, develop, and optimize enterprise ETL/ELT pipelines utilizing Azure Data Factory, Azure Data Lake Storage, and advanced serverless technologies
Job Summary
Design, develop, and optimize enterprise ETL/ELT pipelines utilizing Azure Data Factory, Azure Data Lake Storage, and advanced serverless technologies.
Implement highly efficient, complex SQL solutions to power sophisticated analytics models and enable real-time data processing.
Lead modernization initiatives across the organization, championing the adoption of technologies such as Databricks, DBT and advanced DevOps practices.
Matching Summary
Design, develop, and optimize enterprise ETL/ELT pipelines utilizing Azure Data Factory, Azure Data Lake Storage, and advanced serverless technologies.
Skills & Requirements
Must-have
Azure Data Factory
Azure Data Lake Storage
advanced serverless technologies
complex SQL solutions
Python
API orchestration
production pipeline reliability
CI/CD deployment practices
Nice-to-have
agentic marketing platform
AI-driven media operating unit
creative personalization at scale
Open Intelligence
transformational growth
cultivating trust
championing growth and development
Key Requirements
3-4 years of progressive experience in data engineering
Expert-level mastery of Azure Data Factory, SQL, and cloud data platforms (Azure and/or GCP)
Proven expertise in designing, optimizing, and managing large-scale, production-grade data pipelines
Advanced knowledge of production operations, troubleshooting, and high-availability data processing at scale