Data Engineer Consultant Ii

The Allstate Corp

Base: $70,100.00 - $121,475.00 annually; bonus/equ...
Fully remote
Apache spark experience
Python and sql proficiency
Cloud-based data platform expertise
The role focuses on building robust batch and streaming data solutions using Apache Spark and modern cloud data platforms

Job Summary

  • The role focuses on building robust batch and streaming data solutions using Apache Spark and modern cloud data platforms.
  • Candidates will work closely with analytics engineers, data scientists, and product teams to transform raw data into trusted datasets.
  • Allstate provides a comprehensive technology setup including laptops and monitors, along with monthly connectivity reimbursement for remote workers.

Matching Summary

The role focuses on building robust batch and streaming data solutions using Apache Spark and modern cloud data platforms.

Salary

Base: $70,100.00 - $121,475.00 annually; Bonus/Equity: Not specified; Benefits: Comprehensive tech setup and connectivity reimbursement

Skills & Requirements

Must-have

  • Apache Spark experience
  • Python and SQL proficiency
  • Cloud-based data platform expertise
  • ETL/ELT workflow development
  • CI/CD pipeline implementation

Nice-to-have

  • Microsoft Fabric or OneLake experience
  • Real-time streaming data processing
  • Schema drift management skills
  • Agile delivery process participation

Key Requirements

  • 2+ years of data engineering experience
  • Strong problem-solving and troubleshooting skills
  • Experience with distributed data processing concepts

Work Rights

Not specified

Tailored Resume

Cover Letter