Application Architect - Darpa Scify Project - Penn Engineering
University of Pennsylvania
Philadelphia, Pennsylvania, US
$100,000.00 - $150,000.00 annual rate py
On-site
Multi-llm pipelines
Agent architecture
Tool-calling chains
Design and build ClaimSpy's agent architecture, featuring multi-LLM pipelines with tool-calling chains for literature retrieval, computational analysis, and claim assessment
Job Summary
Design and build ClaimSpy's agent architecture, featuring multi-LLM pipelines with tool-calling chains for literature retrieval, computational analysis, and claim assessment.
Develop an interactive Claim Card interface for analysts to construct, refine, and explore structured speculative claims, inspect reasoning traces, and review evidence bundles.
Collaborate with researchers on AutoRubric integration for automated LLM-as-judge evaluation of claim assessments and conform to DARPA's testing and evaluation framework.
Matching Summary
Design and build ClaimSpy's agent architecture, featuring multi-LLM pipelines with tool-calling chains for literature retrieval, computational analysis, and claim assessment.
Salary
$100,000.00 - $150,000.00 Annual Rate
Skills & Requirements
Must-have
multi-LLM pipelines
agent architecture
tool-calling chains
claim assessment system
Python skills
LLM APIs
agentic systems
Nice-to-have
RAG systems
vector databases
interactive data exploration
scientific literature processing
containerization and deployment
government-funded research
Key Requirements
Bachelor's in Computer Science with 4-6 years of experience
Equivalent combination of education and experience