Member of Technical Staff, Data Flywheel

About the role

Join the Data Flywheel team at Reflection, a research lab focused on making AI intelligence open and accessible. This hands‑on technical position bridges research and deployment, turning ambiguous model behaviors into measurable improvements.

Key responsibilities

• Identify high‑value data sources and partnership opportunities, translating use cases into representative evaluations.
• Bring new data sources online, validate quality, and integrate them into production evaluation and training pipelines.
• Design and build evaluations, graders, and feedback loops to make real‑world model behaviors measurable.
• Analyze model performance, create targeted datasets, reward signals, and training interventions.
• Develop human and synthetic data strategies, including running evaluation and data‑collection programs with vendors.
• Build infrastructure and pipelines for reliable, scalable data ingestion, inspection, versioning, and evaluation.

Required profile

• BS/MS/PhD in Computer Science, Machine Learning, or related field, or equivalent practical experience.
• Deep technical understanding of LLM training and evaluation with hands‑on experience in evaluation design, data curation, reinforcement learning, or reward design.
• Proven ability to own high‑impact projects end‑to‑end in ambiguous, fast‑changing environments.
• Collaborative, action‑oriented mindset and comfort working across research, engineering, operations, and product teams.

Required skills

• LLM training and evaluation expertise
• Evaluation design and data curation
• Reinforcement learning and reward design
• Software engineering for automated data/evaluation pipelines
• Building large‑scale machine‑learning systems

What we offer

• Top‑tier compensation with salary and equity
• Stock options for all contributors
• Comprehensive health, dental, vision, and life coverage plus wellness allowance
• Daily lunch and dinner provided on‑site
• 22 weeks paid parental leave for all new parents
• Unlimited PTO in the U.S. and 30 days in the U.K.
• Visa sponsorship and immigration support
• Regular off‑sites, happy hours, and team celebrations