Azure Data Engineer - Inglês

Capco

Sao Paulo, Brazil
On-site
Azure data factory
Kafka streaming/messaging
Sql and python programming
Design and build batch and streaming pipelines in Azure to ingest data from various sources

Job Summary

  • Design and build batch and streaming pipelines in Azure to ingest data from various sources.
  • Develop and operate pipelines in Azure Data Factory, implementing streaming patterns based on Kafka.
  • Support DevOps practices including CI/CD for pipeline artifacts and operational dashboards.

Matching Summary

Design and build batch and streaming pipelines in Azure to ingest data from various sources.

Skills & Requirements

Must-have

  • Azure Data Factory
  • Kafka streaming/messaging
  • SQL and Python programming
  • ETL/ELT and data modeling
  • DevOps and CI/CD practices

Nice-to-have

  • RDF/Knowledge Graph concepts
  • Graph database integration
  • Azure services integration

Key Requirements

  • 3+ years building production data pipelines in Azure
  • Experience with Kafka
  • Advanced/Fluent English

Work Rights

Not specified

Tailored Resume

Cover Letter