Staff Software Engineer, Ai Platform

Harvey

Toronto, Canada
Remote
8+ years backend systems experience
1+ year ai/ml engineering focus
Multi-model or multi-provider ai systems
The role involves designing and building platform-level systems for context management, session state, and memory that support all of Harvey's agents and products

Job Summary

  • The role involves designing and building platform-level systems for context management, session state, and memory that support all of Harvey's agents and products.
  • Candidates will own the infrastructure for model integration and routing to enable fast onboarding of new foundation models and optimal task assignment.
  • The team operates with intensity and urgency, requiring individuals who thrive in ambiguity and take real ownership from early thinking to long-term outcomes.

Matching Summary

The role involves designing and building platform-level systems for context management, session state, and memory that support all of Harvey's agents and products.

Skills & Requirements

Must-have

  • 8+ years backend systems experience
  • 1+ year AI/ML engineering focus
  • Multi-model or multi-provider AI systems
  • Context management and session state
  • Internal platforms and SDK development

Nice-to-have

  • Experience building evaluation frameworks
  • Agent/function-calling architectures
  • Legal or high-stakes professional services
  • Early-stage hyper-growth startup experience
  • Bias toward full ownership

Key Requirements

  • 8+ years backend systems experience
  • 1+ year AI/ML engineering experience
  • Track record of technical leadership

Work Rights

Not specified

Tailored Resume

Cover Letter