Staff+ Software Engineer, Backend And Infra

Haize Labs

New York, NY, United States
Base: $200,000 – $300,000 annual salary; bonus/equ...
On-site
7+ years industry experience
3+ years leading large initiatives
Python go or rust proficiency
The role involves designing scalable infrastructure to orchestrate tens of thousands of LLM calls per second for AI reliability testing

Job Summary

  • The role involves designing scalable infrastructure to orchestrate tens of thousands of LLM calls per second for AI reliability testing.
  • Candidates will collaborate with research teams to deploy innovative models and interface directly with customers to address their pain points.
  • This position requires a technical leader who can mentor talent, set vision, and uphold operational excellence within a high-performing team.

Matching Summary

The role involves designing scalable infrastructure to orchestrate tens of thousands of LLM calls per second for AI reliability testing.

Salary

Base: $200,000 – $300,000 annual salary; Bonus/Equity: Equity included; Benefits: Standard benefits package included

Skills & Requirements

Must-have

  • 7+ years industry experience
  • 3+ years leading large initiatives
  • Python Go or Rust proficiency
  • Kubernetes and Terraform expertise
  • AWS GCP or Azure cloud platforms
  • Postgres MongoDB and Redis databases

Nice-to-have

  • Applied AI and ML experience
  • Security and privacy best practices
  • GPU-based model training infrastructure
  • Multi-datacenter cloud-agnostic systems
  • Passion for magical user experiences

Key Requirements

  • Bachelor's degree in Computer Science or equivalent
  • 6 days a week in-person work in NYC
  • US visa sponsorship available for exceptional candidates

Work Rights

Not specified

Sponsorship: available

Tailored Resume

Cover Letter