Research Program Manager – Model Evaluation & Safety
reflectionai · New York City
Job description
About the role
Reflection AI is building open AI models and needs a senior leader to create and run the model evaluation and safety function from the ground up. You will define frameworks, processes, and infrastructure to ensure models are safe and reliable before release.
Key responsibilities
- Design and implement the foundational infrastructure, evaluation frameworks, tooling, and operational processes for model evaluation and safety.
- Establish model safety operations, including review cadences, decision frameworks, and integration of safety checkpoints throughout the model development lifecycle.
- Partner with research and engineering leads across pre‑training, mid‑training, and post‑training to embed rigorous safety and evaluation steps without creating bottlenecks.
- Prioritize and scope evaluation science and infrastructure investments, deciding what to build in‑house versus adopt.
- Lead engagement with external safety ecosystem—third‑party assessments, academic partnerships, and industry frameworks—and represent the company’s safety posture to stakeholders.
- Create reporting structures that give leadership clear visibility into safety status, evaluation coverage, and open risks.
- Promote a blameless post‑mortem culture, turning safety findings into concrete system and process improvements.
Required profile
- 7+ years of experience in technical program management, research operations, or ML engineering, with a track record of standing up new functions from scratch.
- Strong understanding of model evaluation and AI safety landscape, including red‑teamings, alignment research, and emerging regulatory frameworks.
- Technical depth to engage with researchers and engineers on model behavior, evaluation design, data pipelines, and safety‑critical system architecture.
- Proven ability to turn ambiguous mandates into structured programs with clear ownership, measurable outcomes, and durable processes.
- Excellent stakeholder management across technical ICs, research leadership, and external partners.
- Motivation to build zero‑to‑one capabilities in a fast‑moving, small team.
Required skills
- Technical program management
- Machine learning engineering
- Model evaluation methodologies
- AI safety and alignment concepts
- Data pipeline design
- Safety‑critical system architecture
What we offer
- Top‑tier compensation with salary and equity.
- Stock options for all contributors.
- Comprehensive health, dental, vision, and life coverage plus an annual wellness allowance.
- Daily lunch and dinner provided on‑site.
- 22 weeks paid parental leave for all new parents.
- Unlimited paid time off in the U.S.
- Visa sponsorship and support for long‑term immigration pathways.
- Regular off‑sites, happy hours, and team celebrations.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in the United States.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 10 hours ago
Expires 1 month from now
3 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
reflectionai
New York City