Product Manager, Agent Intelligence

About the role

We are seeking a Product Manager for Agent Intelligence to own the systems that measure, understand, and improve agent performance. This high‑ownership role sits at the intersection of product, data, evaluation, and AI quality, defining the roadmap for turning agent interactions into structured insights and product improvements.

Key responsibilities

• Define agent quality by creating evaluation rubrics and scoring standards across workflows and use cases.
• Build evaluation systems, including human‑in‑the‑loop review workflows, automated pipelines, and scenario‑based testing.
• Turn large volumes of conversational data into actionable insights, identifying issues, edge cases, and improvement opportunities.
• Close the feedback loop by converting failures into test scenarios, product requirements, and training examples.
• Advance learning systems such as retrieval, ranking, personalization, and feedback loops to make agents more effective.

Required profile

• Experience as a Product Manager on technical, data‑intensive, AI, automation, or platform products.
• Strong analytical skills with comfort working with data, metrics, and ambiguous problem spaces.
• Proven ability to define quality standards, measurement frameworks, and operational workflows.
• Experience collaborating closely with engineering and cross‑functional teams.
• Excellent written and verbal communication skills.

Required skills

• AI and machine‑learning concepts, especially conversational interfaces and LLMs.
• Evaluation frameworks, experimentation, and human‑in‑the‑loop systems.
• Retrieval, ranking, personalization, and feedback‑loop design.
• Handling large‑scale conversational, support, or call data.