Engenharia De Dados - 131753

GFT Technologies Canada Inc

Alphaville, Barueri, Brazil
On-site
Apache spark/pyspark
Aws glue, s3, emr, athena, redshift
Data modeling, etl/elt, data pipelines
We are looking for a data engineering professional with experience in distributed environments, capable of designing and maintaining scalable pipelines, ensuring data governance and quality, and collaborating with multidisciplinary teams to support technical decisions related to data architecture and tools

Job Summary

  • We are looking for a data engineering professional with experience in distributed environments, capable of designing and maintaining scalable pipelines, ensuring data governance and quality, and collaborating with multidisciplinary teams to support technical decisions related to data architecture and tools.
  • Design, build, and maintain scalable and resilient data pipelines, work with large volumes of structured and unstructured data, and ensure data quality, consistency, and governance.
  • We are looking for someone who enjoys teamwork and is collaborative in their responsibilities; has the courage to challenge themselves and go beyond, embracing new growth opportunities; transforms ideas into creative solutions and seeks quality in their daily routine.

Matching Summary

We are looking for a data engineering professional with experience in distributed environments, capable of designing and maintaining scalable pipelines, ensuring data governance and quality, and collaborating with multidisciplinary teams to support technical decisions related to data architecture and tools.

Skills & Requirements

Must-have

  • Apache Spark/Pyspark
  • AWS Glue, S3, EMR, Athena, Redshift
  • Data modeling, ETL/ELT, data pipelines
  • Batch and streaming processing
  • Apache Kafka or Amazon MSK
  • Scala

Nice-to-have

  • Modernization of legacy systems
  • Delta Lake, Apache Hudi or Iceberg
  • CI/CD for data (dbt, Airflow, Terraform)

Key Requirements

  • Experience with data engineering in distributed environments
  • Familiarity with relational and NoSQL databases
  • Experience with batch and streaming processing

Work Rights

Not specified

Tailored Resume

Cover Letter