Product Manager, Claude Code Model Performance
Anthropic · San Francisco
Job description
About the role
Anthropic is looking for a Product Manager to own the end‑to‑end launch and performance evaluation of Claude Code, the world’s most capable coding agent. You will bridge frontier AI research with the daily needs of millions of developers, turning research breakthroughs into shipped improvements.
Key responsibilities
- Own model launch planning and execution: define readiness criteria, coordinate research and engineering, and ensure clean releases for developers.
- Design and implement agentic evaluations that measure real‑world coding performance.
- Drive the engineering team’s evaluation roadmap.
- Partner with researchers to define target behaviors and influence model development using real‑usage evidence.
- Engage with users, analyze transcripts, and translate capability gaps into product improvements.
- Synthesize signals from internal users, external developers, and competitive benchmarks into clear priorities.
Required profile
- Built agentic evaluations (e.g., SWE‑bench‑style task suites).
- Daily user of Claude Code with a clear sense of desired model behaviors.
- Engineering background with 2+ years in product management or equivalent product‑direction experience.
- Deep understanding of AI concepts, model behavior, prompt engineering, and evaluation methodology.
- Systems thinker who builds infrastructure to prevent recurring problems.
- Experience launching products or capabilities in ambiguous, research‑adjacent environments.
- Creative, hacker spirit with a passion for solving puzzles.
Required skills
- Agentic evaluation design (e.g., SWE‑bench).
- Prompt engineering.
- AI model evaluation methodology.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in the United States.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 1 month ago
Expires 1 week from now
35 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Anthropic
San Francisco
Related job offers
-
Machine Learning Data Scientist
Jobs for Humanity San Francisco -
Senior Software Engineer
Jobs for Humanity San Francisco -
Vice President, AI Center of Excellence
mastercard San Francisco -
Data Governance Analyst
oceanspray Lakeville -
Business Systems Analyst III
Zurich Insurance Company Ltd. Schaumburg