Senior Analyst, Ai Workflows & Automation

Roblox

Gurugram, India
On-site
5+ years technical operations experience
2+ years workflow automation expertise
Llm-based tools and prompt design
The role involves creating AI workflows that combine LLM agents with human review to improve speed and consistency in Trust & Safety operations

Job Summary

  • The role involves creating AI workflows that combine LLM agents with human review to improve speed and consistency in Trust & Safety operations.
  • Candidates will partner with subject matter experts to map existing workflows and identify high-leverage automation opportunities.
  • The position requires defining success metrics and building evaluation pipelines to ensure AI automations are safe, reliable, and measurable.

Matching Summary

The role involves creating AI workflows that combine LLM agents with human review to improve speed and consistency in Trust & Safety operations.

Skills & Requirements

Must-have

  • 5+ years technical operations experience
  • 2+ years workflow automation expertise
  • LLM-based tools and prompt design
  • Python scripting and API integration
  • Defining success metrics and evaluation plans

Nice-to-have

  • Trust & Safety or compliance background
  • Experience evaluating AI agent quality
  • Cross-functional communication skills
  • Building eval suites and gold-label sets
  • Knowledge of regulatory constraints

Key Requirements

  • 5+ years in technical operations or data science
  • 2+ years working with workflow automation
  • Strong technical fluency in Python or similar languages

Work Rights

Not specified

Tailored Resume

Cover Letter