Senior Pyspark Data Engineer - Assistant Vice President

Publix Serving (Civica)

Pyspark
Apache airflow
Big data ecosystems
You will be responsible for designing, developing, and maintaining our data pipelines, ensuring they are efficient, reliable, and scalable to meet our growing business needs

Job Summary

  • You will be responsible for designing, developing, and maintaining our data pipelines, ensuring they are efficient, reliable, and scalable to meet our growing business needs.
  • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver high-quality data solutions.
  • Mentor junior data engineers and promote best practices in data engineering.

Matching Summary

You will be responsible for designing, developing, and maintaining our data pipelines, ensuring they are efficient, reliable, and scalable to meet our growing business needs.

Skills & Requirements

Must-have

  • PySpark
  • Apache Airflow
  • Big Data ecosystems
  • distributed query engines
  • SQL
  • data warehousing
  • ETL/ELT processes
  • data modeling
  • Linux/Unix environment
  • GIT HUB
  • CI/CD Pipeline

Nice-to-have

  • cutting-edge Big Data technologies
  • mentor junior data engineers
  • data governance and security policies

Key Requirements

  • 6+ years of professional experience
  • Bachelor’s or Master’s degree
  • Cloudera and/or DataBricks experience
  • Starburst (Trino/Presto) experience

Work Rights

Not specified

Tailored Resume

Cover Letter