Senior Software Engineer (data Platform)

gp-hub.dev

Remote, US
Base: competitive compensation; bonus/equity: annu...
**
5+ years production-grade data systems experience
Deep mastery of databricks and spark ecosystem
Proven track record building real-time streaming architectures
** G-P is seeking a Senior Software Engineer specializing in data platforms to architect and optimize their AI-native Data Platform. The ideal candidate should possess significant experience with Databricks and large-scale data systems, with a focus on building self-service frameworks and ensuring data reliability. **

Job Summary

  • The role involves designing the architectural backbone of an AI-native Data Platform to power every product and AI workflow across the company.
  • Candidates will take full ownership of the cost-effectiveness of the Databricks ecosystem by tuning execution plans and managing auto-scaling strategies.
  • G-P offers excellent benefits including generous paid parental leave, flexible time off, spending accounts, medical insurance, and a sabbatical after 5 years.

Matching Summary

Match Score: 75

** G-P is seeking a Senior Software Engineer specializing in data platforms to architect and optimize their AI-native Data Platform. The ideal candidate should possess significant experience with Databricks and large-scale data systems, with a focus on building self-service frameworks and ensuring data reliability. **

Salary

Base: Competitive compensation; Bonus/Equity: Annual bonus eligible for non-sales roles; Benefits: Generous paid parental leave, flexible time off, medical/dental/vision insurance, sabbatical after 5 years

Skills & Requirements

Must-have

  • 5+ years production-grade data systems experience
  • Deep mastery of Databricks and Spark ecosystem
  • Proven track record building real-time streaming architectures
  • Experience managing cloud cost optimization strategies
  • Background in building internal APIs and frameworks

Nice-to-have

  • Championing AI-assisted development tools usage
  • Mentoring engineers on distributed computing best practices
  • Experience with Schema-on-Write validation
  • Fostering innovation in remote-first team environments

Key Requirements

  • 5+ years experience in massive scale data systems
  • Hands-on mastery of Delta Lake and DLT
  • Production experience with Spark Structured Streaming or Kafka

Work Rights

Not specified

Tailored Resume

Cover Letter