Staff Software Engineer - Backend

ServiceNow

Hyderabad, India
On-site
Python and java development
Llms and agentic ai
Prompt engineering and pipeline optimization
Lead the design and architecture of AI solutions, shaping how reasoning, memory, and orchestration come together in production systems

Job Summary

  • Lead the design and architecture of AI solutions, shaping how reasoning, memory, and orchestration come together in production systems.
  • Own end-to-end delivery—from design through deployment—ensuring solutions are scalable, reliable, and performant.
  • Champion observability and evaluation for AI systems, building out logging, metrics, and automated evaluation frameworks for production workloads.

Matching Summary

Lead the design and architecture of AI solutions, shaping how reasoning, memory, and orchestration come together in production systems.

Skills & Requirements

Must-have

  • Python and Java development
  • LLMs and Agentic AI
  • Prompt engineering and pipeline optimization
  • Scalable, reliable, and performant AI solutions
  • Observability and evaluation for AI systems

Nice-to-have

  • Research initiatives in agent learning
  • Publications, technical blogs, or open-source contributions

Key Requirements

  • 9+ years of experience
  • Experience in conversational AI and NLP platforms
  • Hands-on expertise in LLM-powered applications and tooling
  • Experience providing technical leadership

Work Rights

Not specified

Tailored Resume

Cover Letter