Tech Lead Data Scientist, Ai Evaluation & Monitoring
Geisinger
Pennsylvania, United States
Not specified; not specified; healthcare benefits ...
Fully remote
6+ years data science or ml engineering experience
Hands-on llm and generative ai evaluation
Experimental design and causal inference expertise
Geisinger is seeking a Tech Lead Data Scientist specializing in AI Evaluation & Monitoring to provide technical leadership in evaluating and optimizing AI systems in healthcare. This fully remote position requires a strong background in data science, experimental design, and experience with AI and ML systems
Job Summary
This role serves as the principal technical expert for evaluating, monitoring, and optimizing AI systems across Geisinger's enterprise portfolio.
The position requires hands-on guidance to program teams in designing validation studies, equity audits, and production monitoring plans.
Geisinger offers comprehensive healthcare benefits including vision, dental, and domestic partners starting from day one.
Matching Summary
Match Score: 85
Geisinger is seeking a Tech Lead Data Scientist specializing in AI Evaluation & Monitoring to provide technical leadership in evaluating and optimizing AI systems in healthcare. This fully remote position requires a strong background in data science, experimental design, and experience with AI and ML systems.
Salary
Not specified; Not specified; Healthcare benefits including vision, dental, and domestic partners
Skills & Requirements
Must-have
6+ years data science or ML engineering experience
Hands-on LLM and generative AI evaluation
Experimental design and causal inference expertise
Python and SQL proficiency with cloud-native tools
Fairness and equity evaluation for ML systems
Nice-to-have
Healthcare or clinical industry experience preferred
MS or PhD in quantitative field
Experience with Epic Clarity or HL7 data sources
Strong written communication for non-technical stakeholders
Key Requirements
Minimum 6 years relevant experience in data science or statistics