Artefact is seeking a Data Engineer to develop and manage data pipelines, focusing on cloud services like Azure and GCP. The ideal candidate should have a solid background in Python, SQL, and data engineering methodologies, along with excellent communication and problem-solving skills
Job Summary
Craft and maintain robust data pipelines using Python and SQL for efficient data extraction, transformation, and loading.
Leverage cloud services such as MS Azure and GCP to architect and deploy scalable data solutions.
Collaborate with teams to integrate machine learning models into data pipelines for enhanced data processing.
Matching Summary
Match Score: 85
Artefact is seeking a Data Engineer to develop and manage data pipelines, focusing on cloud services like Azure and GCP. The ideal candidate should have a solid background in Python, SQL, and data engineering methodologies, along with excellent communication and problem-solving skills.
Skills & Requirements
Must-have
Python and SQL proficiency
Data pipeline ETL experience
MS Azure and GCP cloud services
Spark and Kafka for real-time processing
Machine learning model integration
Nice-to-have
Problem-solving and solution-oriented mindset
Excellent communication skills
Strong business acumen
Adaptability and start-up mentality
Key Requirements
Proficiency in Python, SQL, and database management
Experience with Data Pipelines ETL
Experience with Cloud Services (MS Azure, GCP preferred)
Experience with ML Modeling, Spark & Kafka
Computer Science, Electronics, and Communication Engineering degrees