Data Engineer Spec Ii

Santander UK

São Paulo, SP, Brazil
Hybrid
Sql and python programming experience
Azure data factory and databricks usage
Aws athena and airflow orchestration
The role involves designing and maintaining data loads between diverse sources to support business needs and client analysis

Job Summary

  • The role involves designing and maintaining data loads between diverse sources to support business needs and client analysis.
  • Candidates will build simple and scalable data architectures while prioritizing tasks and managing data volume and load times.
  • The company offers a hybrid work model with 2 days remote and 3 days onsite, along with extensive benefits like Flex Férias and gym partnerships.

Matching Summary

The role involves designing and maintaining data loads between diverse sources to support business needs and client analysis.

Skills & Requirements

Must-have

  • SQL and Python programming experience
  • Azure Data Factory and Databricks usage
  • AWS Athena and Airflow orchestration
  • PySpark big data processing skills
  • ETL pipeline development and maintenance
  • DAG deployment and management

Nice-to-have

  • Big Query and Delta Lake familiarity
  • Cloud Storage knowledge
  • CI/CD and Infrastructure as Code
  • Containerization expertise
  • Azure DevOps and Git proficiency
  • Strong communication and presentation skills

Key Requirements

  • Experience with SQL and Python
  • Proficiency in Azure Data Factory and Databricks
  • Knowledge of ETL processes and DAG deployment
  • Ability to structure concepts from conception to solution

Work Rights

Not specified

Tailored Resume

Cover Letter