Design and implement efficient data products to support data processing and analytics needs, including developing, maintaining, and optimizing data pipelines
Job Summary
Design and implement efficient data products to support data processing and analytics needs, including developing, maintaining, and optimizing data pipelines.
Integrate data from various source systems, process it into final datasets, and collaborate with stakeholders to deliver data solutions that drive insights.
Follow data governance practices, ensuring data security, privacy, and compliance, while actively collaborating with data communities to foster a data-driven culture.
Matching Summary
Design and implement efficient data products to support data processing and analytics needs, including developing, maintaining, and optimizing data pipelines.
Skills & Requirements
Must-have
Python, SQL, Pyspark
DevOps implementation (Azure DevOps, Jenkins)
Cloud-based data solutions (Azure Cloud)
Data pipeline design and implementation
Clean, maintainable, efficient code development
Data security, privacy, and compliance
Nice-to-have
Power BI or similar data visualization
Enhance insights generation
Data-driven decision making culture
Helping and empowering others
Key Requirements
2-3 years of experience in data engineering
University degree in relevant field
Experience with large-scale data processing systems