Research Engineer – AI Agent Platform
console · San Francisco
Job description
About the role
Console is looking for a Research Engineer to advance its core AI agent loop from powerful to truly self‑improving. You will work at the intersection of applied AI engineering and research, turning real production traffic into better agents, evaluations, and specialist models.
Key responsibilities
- Build and refine the evaluation and optimization loop that converts production usage into measurable improvements in quality, latency, and reliability.
- Systematically enhance agent behavior across prompts, programs, routing logic, constraints, and model adaptations using techniques such as DSPy and GEPA.
- Fine‑tune, adapt, and evaluate specialist models for high‑volume agent tasks with clear production feedback.
- Develop infrastructure for trace collection, offline replay, labeling workflows, and eval harnesses.
- Collaborate with product, engineering, and leadership to ship improvements quickly and define research practices at scale.
Required profile
- Strong background in applied AI or machine learning research.
- Experience turning production data into research insights and model improvements.
- Ability to work across the stack, from data pipelines to model deployment.
- Comfort with rapid iteration and shipping code to production environments.
Required skills
- DSPy
- GEPA
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in the United States.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
Published 3 weeks ago
Expires 1 month from now
15 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
console
San Francisco
Related job offers
-
Machine Learning Engineer
sift San Francisco -
Software Engineer – Horizon
sierra San Francisco -
Software Engineer – AI Agent for Tech, Media & Telecom
sierra San Francisco -
Director
Food Safety and Inspection Service Thitani location -
AI Safety Specialist (Short‑Term Project)
HumanitApp Thitani location