Ai Benchmark Engineer | Native Language Specialist

Jobgether

India, India
On-site
Native language expertise
Multilingual dataset creation
Terminal-based task design
Jobgether is seeking an AI Benchmark Engineer | Native Language Specialist in India. The role requires a blend of software engineering and language expertise to evaluate and improve the multilingual capabilities of large language models through rigorous benchmarking and dataset creation

Job Summary

  • This role sits at the intersection of software engineering, language expertise, and AI evaluation to build rigorous benchmarks for large language models.
  • You will create realistic multilingual datasets and identify model failure points to define robust evaluation standards for next-generation AI systems.
  • The work is highly experimental and research-oriented, requiring both technical depth and linguistic precision in a distributed, quality-focused environment.

Matching Summary

Match Score: 85

Jobgether is seeking an AI Benchmark Engineer | Native Language Specialist in India. The role requires a blend of software engineering and language expertise to evaluate and improve the multilingual capabilities of large language models through rigorous benchmarking and dataset creation.

Skills & Requirements

Must-have

  • Native language expertise
  • Multilingual dataset creation
  • Terminal-based task design
  • AI model evaluation standards
  • Software engineering background

Nice-to-have

  • Research-oriented mindset
  • Linguistic precision skills
  • Distributed team collaboration
  • Reproducibility focus
  • Experimental approach

Key Requirements

  • Native language proficiency
  • Experience with AI benchmarking
  • Strong software engineering skills

Work Rights

Not specified

Tailored Resume

Cover Letter