Senior Data Engineer - Data Bricks

UPS

**
3+ years experience with databricks
Proficient in python and spark sql
Strong azure cloud services knowledge
** UPS is seeking a Senior Data Engineer with expertise in Data Bricks to support the development of batch and real-time data pipelines for the Marketing and Finance business units. The role requires strong programming skills, particularly in Python and Spark, as well as proficiency in cloud services and data lifecycle management. **

Job Summary

  • This position supports batch and real-time data pipelines utilizing various data analytics processing frameworks for Marketing and Finance business units.
  • The role involves performing full systems life cycle management activities including analysis, design, coding, testing, and implementation of software applications.
  • Candidates must be proficient in developing notebooks in Data Bricks using Python and Spark while leveraging strong foundational knowledge in software development.

Matching Summary

Match Score: 75

** UPS is seeking a Senior Data Engineer with expertise in Data Bricks to support the development of batch and real-time data pipelines for the Marketing and Finance business units. The role requires strong programming skills, particularly in Python and Spark, as well as proficiency in cloud services and data lifecycle management. **

Skills & Requirements

Must-have

  • 3+ years experience with Databricks
  • Proficient in Python and Spark SQL
  • Strong Azure cloud services knowledge

Nice-to-have

  • Knowledge of Delta Lake and Unity Catalog
  • Experience with R or Scala programming
  • Familiarity with Agile Kanban and Scrum

Key Requirements

  • Bachelor's degree in MIS, mathematics, statistics, or computer science
  • 3 years of experience with Databricks, Apache Spark, Python, and SQL
  • Strong understanding of cloud-based data lake systems and data warehousing solutions

Work Rights

Not specified

Tailored Resume

Cover Letter