Not specified (assumed to be flexible based on the company culture)
9+ years software development experience
Streaming experience with flink and kafka
Proficiency in scala, pyspark, and python
Solera is seeking a Lead Data Engineer to design and optimize data processing pipelines using various technologies such as Scala, Kafka, and AWS. The role requires extensive experience in software development and data integration, alongside collaboration with cross-functional teams to ensure data quality and availability
Job Summary
Solera is a global leader processing over 300 million digital transactions annually for partners in more than 90 countries.
The Lead Data Engineer will design and optimize scalable data pipelines using technologies like Flink, Scala, Kafka, and AWS.
This role requires close collaboration with cross-functional teams including data analysts and scientists to ensure data quality and availability.
Matching Summary
Match Score: 85
Solera is seeking a Lead Data Engineer to design and optimize data processing pipelines using various technologies such as Scala, Kafka, and AWS. The role requires extensive experience in software development and data integration, alongside collaboration with cross-functional teams to ensure data quality and availability.
Skills & Requirements
Must-have
9+ years software development experience
Streaming experience with Flink and Kafka
Proficiency in Scala, PySpark, and Python
AWS cloud platform expertise
SQL and database management systems
Docker and Kubernetes container orchestration
Logical data modeling and ETL/ELT workflows
Nice-to-have
Transportation industry knowledge
Experience mentoring developers
Leadership of data engineering teams
Knowledge of Agile and SCRUM methodologies
Experience with ElasticSearch
Azure cloud experience
Key Requirements
Bachelor's degree in Computer Science or equivalent
9+ years of applicable software development experience