Data Engineer Consultant Ii

The Allstate Corporation

Base: $70,100.00 - $121,475.00 annually; bonus/equ...
Fully remote
Apache spark for large-scale processing
Python and sql proficiency
Cloud-based data platform experience
The role focuses on building robust batch and streaming data solutions using Apache Spark and modern cloud data platforms

Job Summary

  • The role focuses on building robust batch and streaming data solutions using Apache Spark and modern cloud data platforms.
  • Candidates will work closely with analytics engineers and data scientists to transform raw data into trusted, analytics-ready datasets.
  • Allstate provides a comprehensive technology setup including a laptop, monitors, and monthly connectivity reimbursement for remote workers.

Matching Summary

The role focuses on building robust batch and streaming data solutions using Apache Spark and modern cloud data platforms.

Salary

Base: $70,100.00 - $121,475.00 annually; Bonus/Equity: Not specified; Benefits: Comprehensive tech setup and connectivity reimbursement

Skills & Requirements

Must-have

  • Apache Spark for large-scale processing
  • Python and SQL proficiency
  • Cloud-based data platform experience
  • ETL/ELT workflow development
  • CI/CD pipeline implementation

Nice-to-have

  • Microsoft Fabric and OneLake experience
  • Real-time or event-driven processing
  • Schema drift management skills
  • Agile delivery process participation

Key Requirements

  • 2+ years of data engineering experience
  • Strong problem-solving and troubleshooting skills
  • Experience with distributed data processing concepts

Work Rights

Not specified

Tailored Resume

Cover Letter