Design, develop, and optimize enterprise ETL/ELT pipelines utilizing Azure Data Factory, Azure Data Lake Storage, and advanced serverless technologies
Job Summary
Design, develop, and optimize enterprise ETL/ELT pipelines utilizing Azure Data Factory, Azure Data Lake Storage, and advanced serverless technologies.
Lead the development and integration of robust automation frameworks using Python, and API orchestration, introducing innovative solutions to streamline the entire data lifecycle and maximize operational efficiency.
Our benefits include competitive medical, group retirement plans, vision, and dental insurance, significant paid time off, preferential partner discounts, and employee mental health awareness days.
Matching Summary
Design, develop, and optimize enterprise ETL/ELT pipelines utilizing Azure Data Factory, Azure Data Lake Storage, and advanced serverless technologies.
Skills & Requirements
Must-have
Azure Data Factory
Azure Data Lake Storage
SQL solutions
Python
API orchestration
production pipeline reliability
CI/CD deployment practices
Nice-to-have
AI-driven media operating unit
creative personalization at scale
transformational growth
fostering creativity collaboration connection
Key Requirements
3-4 years of progressive experience in data engineering
expert-level mastery of Azure Data Factory, SQL, and cloud data platforms
Proven expertise in designing, optimizing, and managing large-scale, production-grade data pipelines
Advanced knowledge of production operations, troubleshooting, and high-availability data processing