Staff Software Engineer, Core Infrastructure

Harvey

New York, United States
Base: $201,000 - $264,000 usd; bonus/equity: not s...
10+ years infrastructure engineering experience
Azure or gcp cloud platform proficiency
Kubernetes and container orchestration expertise
Harvey is transforming legal and professional services by combining frontier agentic AI with an enterprise-grade platform to reshape critical knowledge work

Job Summary

  • Harvey is transforming legal and professional services by combining frontier agentic AI with an enterprise-grade platform to reshape critical knowledge work.
  • As a Staff Software Engineer, you will design scalable infrastructure systems that power billions of prompt tokens and millions of daily requests across the global legal AI platform.
  • The role requires deep ownership of multi-cloud environments (Azure, GCP) and driving operational excellence through advanced observability and incident response practices.

Matching Summary

Harvey is transforming legal and professional services by combining frontier agentic AI with an enterprise-grade platform to reshape critical knowledge work.

Salary

Base: $201,000 - $264,000 USD; Bonus/Equity: Not specified; Benefits: Relocation assistance offered

Skills & Requirements

Must-have

  • 10+ years Infrastructure Engineering experience
  • Azure or GCP cloud platform proficiency
  • Kubernetes and container orchestration expertise
  • Terraform or Pulumi Infrastructure as Code skills
  • Python or Go programming language fluency
  • Distributed system reliability and scaling
  • Observability tools like Datadog and Sentry

Nice-to-have

  • Experience with AI/ML workload infrastructure
  • Background in high-throughput inference systems
  • Multi-tenant platform security compliance
  • Cross-functional project leadership track record
  • Redis-backed rate limiting algorithms

Key Requirements

  • 10+ years of production Infrastructure Engineering experience
  • Deep proficiency with Azure preferred; GCP or AWS transfers well
  • Strong fluency in Terraform, Pulumi, or CloudFormation
  • Solid understanding of Kubernetes networking and cloud security at scale
  • Excellent problem-solving skills and commitment to operational excellence

Work Rights

Not specified

Tailored Resume

Cover Letter