The candidate will play a key role in designing, building and maintaining a robust and scalable data processing platform and end to end solutions using Apache Spark, Databricks, and other related big data and distributed computing technologies
Job Summary
The candidate will play a key role in designing, building and maintaining a robust and scalable data processing platform and end to end solutions using Apache Spark, Databricks, and other related big data and distributed computing technologies.
You will be deeply involved in all phases of the software development lifecycle, including scope definition, requirements analysis, functional and technical design, application build, unit testing, production deployment and support.
As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most.
Matching Summary
The candidate will play a key role in designing, building and maintaining a robust and scalable data processing platform and end to end solutions using Apache Spark, Databricks, and other related big data and distributed computing technologies.
Skills & Requirements
Must-have
Apache Spark and Databricks expertise
Cloud-native enterprise scale data solutions
Distributed system concepts
Event-driven architecture and real-time data streaming
Batch and real-time data processing
Application monitoring and observability
Nice-to-have
AI and machine learning tools
Emerging tools evaluation
Creative problem solver
Collaborative team player
Key Requirements
5+ years of software engineering experience
BS/MS in Computer Science or equivalent field
Strong programming skills in Java, Python, Scala, SQL, UNIX and Shell scripting
Deep understanding of cloud-native and system integration design patterns