Ai/ml Engineer For Assessment Systems

Northeastern University

Base: $25ph; bonus/equity: not specified; benefits...
**
Python programming (pandas, scikit-learn, numpy)
Large language model apis (openai gpt-4, claude)
Nlp pipelines design and implementation
** Northeastern University is seeking an AI/ML Engineer for Assessment Systems to develop AI scoring systems that evaluate student transcripts using validated rubrics. The role requires expertise in natural language processing, prompt engineering, and educational assessment methodologies, with a focus on collaboration with research teams to ensure AI systems align with human evaluations. **

Job Summary

  • You will develop, implement, and validate AI scoring systems that evaluate student transcripts using research-validated rubrics.
  • This role combines natural language processing, prompt engineering, and educational assessment methodology to create scalable evaluation tools.
  • Northeastern has a comprehensive benefits package for benefit eligible employees.

Matching Summary

Match Score: 75

** Northeastern University is seeking an AI/ML Engineer for Assessment Systems to develop AI scoring systems that evaluate student transcripts using validated rubrics. The role requires expertise in natural language processing, prompt engineering, and educational assessment methodologies, with a focus on collaboration with research teams to ensure AI systems align with human evaluations. **

Salary

Base: $25/hour; Bonus/Equity: Not specified; Benefits: Comprehensive benefits package

Skills & Requirements

Must-have

  • Python programming (pandas, scikit-learn, numpy)
  • Large language model APIs (OpenAI GPT-4, Claude)
  • NLP pipelines design and implementation
  • Evaluation metrics (precision, recall, F1)
  • Version control (Git)

Nice-to-have

  • Prompt engineering and LLM optimization
  • Educational assessment or psychometrics
  • Inter-annotator agreement statistics
  • Retrieval-augmented generation (RAG) systems
  • Bias detection and fairness metrics

Key Requirements

  • Graduate student or professional in CS/Data Science/Comp Ling
  • Strong Python programming skills
  • Experience with LLM APIs
  • Demonstrated NLP pipeline ability
  • Understanding of evaluation metrics
  • Experience with Git

Work Rights

Not specified

Tailored Resume

Cover Letter