Staff Software Engineer, Ai Platform

Harvey

New York, United States
Base: $231,000 - $340,000; bonus/equity: not speci...
Remote
8+ years backend systems experience
1+ year ai/ml engineering focus
Multi-model or multi-provider ai systems
The role involves designing and building platform-level systems for context management, session state, and memory that support all of Harvey's agentic products

Job Summary

  • The role involves designing and building platform-level systems for context management, session state, and memory that support all of Harvey's agentic products.
  • Candidates will own the infrastructure for model integration and routing to enable the company to onboard new foundation models quickly and select the right one for each task.
  • The team is described as sharp, motivated, and deeply committed to reshaping how critical knowledge work gets done with zero margin for error on accuracy.

Matching Summary

The role involves designing and building platform-level systems for context management, session state, and memory that support all of Harvey's agentic products.

Salary

Base: $231,000 - $340,000; Bonus/Equity: Not specified; Benefits: Not specified

Skills & Requirements

Must-have

  • 8+ years backend systems experience
  • 1+ year AI/ML engineering focus
  • Multi-model or multi-provider AI systems
  • Context management and session state systems
  • Internal platforms and SDK development

Nice-to-have

  • Experience building evaluation frameworks
  • Agent/function-calling architectures knowledge
  • Legal or high-stakes professional services domain
  • Early-stage or hyper-growth startup experience
  • Bias toward full ownership and ambiguity

Key Requirements

  • 8+ years backend systems experience
  • 1+ year AI/ML engineering experience
  • Track record of technical leadership across teams

Work Rights

Not specified

Tailored Resume

Cover Letter