Pessoa Engenheira De Dados Senior

Zup

Remote, Brazil
On-site
Apache spark pyspark
Python for pipelines
Aws emr s3 glue athena
The role involves designing and implementing scalable data pipelines with optimized continuous processing and low latency

Job Summary

  • The role involves designing and implementing scalable data pipelines with optimized continuous processing and low latency.
  • You will lead technical initiatives in Data Lake and Lakehouse architectures while integrating multiple sources and services on AWS.
  • The company values a collaborative culture driven by curiosity and continuous professional growth for its team members.

Matching Summary

The role involves designing and implementing scalable data pipelines with optimized continuous processing and low latency.

Skills & Requirements

Must-have

  • Apache Spark PySpark
  • Python for pipelines
  • AWS EMR S3 Glue Athena
  • Data Lake Lakehouse architecture
  • High availability database replication

Nice-to-have

  • Machine learning algorithms in pipelines
  • FinOps cost optimization practices
  • CI/CD automation strategies
  • Airflow or dbt experience
  • Technical community participation

Key Requirements

  • Senior level experience
  • Internal candidate status required

Work Rights

Not specified

Tailored Resume

Cover Letter