The role requires a hands-on player/coach to design and optimize large-scale data processing solutions using PySpark and cutting-edge technologies
Job Summary
The role requires a hands-on player/coach to design and optimize large-scale data processing solutions using PySpark and cutting-edge technologies.
Candidates must demonstrate an AI-first thinker mindset by proactively leveraging AI-powered development tools like Copilot and Claude Code to enhance productivity.
This position involves operating end-to-end in robust big data solution implementation while mentoring team members within small, autonomous squads.
Matching Summary
The role requires a hands-on player/coach to design and optimize large-scale data processing solutions using PySpark and cutting-edge technologies.
Salary
Base: $120,800.00 - $170,800.00; Bonus/Equity: Not specified; Benefits: Not specified
Skills & Requirements
Must-have
6+ years PySpark experience
Expert Python programming skills
Apache Spark ecosystem mastery
Real-time Kafka streaming
AI-first development mindset
Distributed data storage expertise
Nice-to-have
NoSQL database experience
Cloud platform big data services
Containerization with Docker/Kubernetes
RESTful API design skills
Mentoring junior engineers
Domain business context understanding
Key Requirements
Bachelor's or Master's degree in CS or related field