Ensure the smooth operation, reliability, and scalability of our data infrastructure by monitoring, troubleshooting, and optimizing data pipelines and Azure data services
Job Summary
Ensure the smooth operation, reliability, and scalability of our data infrastructure by monitoring, troubleshooting, and optimizing data pipelines and Azure data services.
Collaborate with data teams to support analytics and business intelligence functions, focusing on production support for Azure-based data pipelines, data lakes, and data warehouses.
Develop scripts or automation tools to improve operational efficiency and suggest process improvements to enhance reliability and reduce manual interventions.
Matching Summary
Ensure the smooth operation, reliability, and scalability of our data infrastructure by monitoring, troubleshooting, and optimizing data pipelines and Azure data services.
Skills & Requirements
Must-have
Microsoft Azure Cloud ecosystem
Azure data services
Databricks for batch and data engineering
monitoring and troubleshooting data pipelines
Python or PowerShell for automation
Nice-to-have
structured incident/change management frameworks
real-time data streaming support
DevOps tools familiarity
Key Requirements
3+ years of experience
Bachelor’s degree in Computer Science, Information Systems, or related field
Proficiency in SQL
Familiarity with DevOps tools
Understanding of data modeling, ETL concepts, and data warehousing principles