Proven track record in real-time streaming architecture
**
G-P is seeking a Senior Software Engineer for their AI-native Data Platform, which involves architecting and optimizing data systems to enhance performance and reliability. The role requires expertise in Databricks and Spark, along with experience in building scalable data architectures.
**
Job Summary
The role involves designing the architectural backbone for an AI-native Data Platform that powers every product and AI workflow across the company.
Candidates will take full ownership of platform performance by tuning Spark execution plans and managing trade-offs between latency, throughput, and cloud spend.
The company offers excellent benefits including generous paid parental leave, flexible time off, spending accounts, and medical insurance to support a diverse remote-first team.
Matching Summary
Match Score: 75
**
G-P is seeking a Senior Software Engineer for their AI-native Data Platform, which involves architecting and optimizing data systems to enhance performance and reliability. The role requires expertise in Databricks and Spark, along with experience in building scalable data architectures.
**
Salary
Base: Competitive; Bonus: Annual bonus eligible based on performance; Benefits: Generous paid parental leave, flexible time off, medical/dental/vision insurance
Skills & Requirements
Must-have
5+ years production-grade data systems experience
Deep mastery of Databricks and Spark ecosystem
Proven track record in real-time streaming architecture
Experience with cloud cost optimization strategies
Background in building internal APIs and tools
Nice-to-have
Championing AI-assisted development tools usage
Mentoring engineers on distributed computing best practices
Implementing schema-on-write validation protocols
Fostering innovation in remote-first team environments
Key Requirements
5+ years experience building massive scale data systems
Hands-on expertise with Delta Lake and Databricks SQL
Proficiency in Spark Structured Streaming or Kafka
Demonstrated ability to optimize high-growth cloud costs