Software Development Engineer, Agi Data Services

Amazon

United States
168,100.00 - 227,400.00 usd annually py
On-site
Llm-as-a-judge evaluation pipelines
Genai-powered workflow tools
Agent orchestration frameworks
The Sr. SDE will own the LLM-as-a-Judge evaluation pipeline — designing, building, and scaling automated evaluation systems that leverage large language models to assess data quality

Job Summary

  • The Sr. SDE will own the LLM-as-a-Judge evaluation pipeline — designing, building, and scaling automated evaluation systems that leverage large language models to assess data quality.
  • The Sr. SDE will design and build GenAI-powered diagnostic and workflow tools — including conversational troubleshooting agents, automated quality assessment tools, guided remediation systems, and workflow copilots.
  • The Sr. SDE will design and implement robust backend services, APIs, and data pipelines on AWS leveraging Amazon Bedrock, SageMaker, Lambda, ECS/EKS, Step Functions, DynamoDB, OpenSearch, and S3.

Matching Summary

The Sr. SDE will own the LLM-as-a-Judge evaluation pipeline — designing, building, and scaling automated evaluation systems that leverage large language models to assess data quality.

Salary

168,100.00 - 227,400.00 USD annually

Skills & Requirements

Must-have

  • LLM-as-a-Judge evaluation pipelines
  • GenAI-powered workflow tools
  • Agent orchestration frameworks
  • Backend services on AWS
  • Data quality assessment at scale

Nice-to-have

  • Passion for Generative AI
  • Strong engineering fundamentals
  • Collaboration with cross-functional teams
  • Direct visibility to leadership

Key Requirements

  • Senior Software Development Engineer experience

Work Rights

Not specified

Tailored Resume

Cover Letter