Design and maintain data ingestion and transformation pipelines, integrating multiple data sources in various formats
Job Summary
Design and maintain data ingestion and transformation pipelines, integrating multiple data sources in various formats.
Ensure data quality, integrity, and reliability while optimizing performance for high-volume data extraction processes.
Collaborate with technical teams using event-driven architectures and bring hands-on experience with Azure services, Big Data technologies, and programming languages.
Matching Summary
Design and maintain data ingestion and transformation pipelines, integrating multiple data sources in various formats.
Skills & Requirements
Must-have
Design and maintain data ingestion
Integrate multiple data sources
Ensure data quality, integrity, and reliability
Optimize performance for high-volume data
Collaborate with technical teams
Experience with Azure services
Programming experience in Python/.NET C#/Java
Nice-to-have
Work under pressure
Quality at work
Results oriented
Key Requirements
Designing and implementing ETL processes
Working with SQL and NoSQL databases
Experience with Big Data technologies (Spark, Kafka)