Data Engineer- Databricks

Derevo LLC

Mexico
Remote
Databricks platform expertise
Apache spark and pyspark programming
Delta lake architecture implementation
Derevo LLC is seeking a Senior Data Engineer specializing in Databricks to design and implement modern data architectures. The role focuses on creating high-quality analytical solutions using Big Data technologies while promoting a collaborative and innovative work environment

Job Summary

  • You will be a key player in creating and implementing high-quality modern data architectures that drive analytical solutions based on Big Data technologies.
  • The role involves designing, maintaining, and optimizing parallel multiprocessing systems while applying best practices for storage and management in data warehouses, lakes, and lakehouses.
  • Employees benefit from a remote flexible environment with opportunities for interdisciplinary specialization, access to cutting-edge multinational projects, and comprehensive wellness support.

Matching Summary

Match Score: 85

Derevo LLC is seeking a Senior Data Engineer specializing in Databricks to design and implement modern data architectures. The role focuses on creating high-quality analytical solutions using Big Data technologies while promoting a collaborative and innovative work environment.

Skills & Requirements

Must-have

  • Databricks platform expertise
  • Apache Spark and PySpark programming
  • Delta Lake architecture implementation
  • Structured Streaming and Auto Loader
  • T-SQL and Spark SQL proficiency
  • Azure Data Factory knowledge
  • CI/CD pipeline management

Nice-to-have

  • Unity Catalog federation skills
  • Consultative approach to requirements
  • Agile sprint planning participation
  • Cross-functional team collaboration
  • Proactive risk communication
  • Wellness and work-life balance focus

Key Requirements

  • Senior level Data Engineer experience
  • Advanced T-SQL and Spark SQL skills
  • Object-oriented Python (PySpark) development
  • Experience with Delta Live Tables (DLT)
  • Knowledge of Azure ecosystem tools

Work Rights

Not specified

Tailored Resume

Cover Letter