Technical Product Manager, Data Science

About the role

Centrl is seeking an owner for the accuracy, reliability, and cost‑efficiency of the AI behind CentrlX, its agentic platform for manager research and investor relations teams. This product‑focused role blends data‑science rigor with product‑management judgment to drive measurable improvements.

Key responsibilities

• Build and own the evaluation foundation: golden datasets, grading rubrics, LLM‑as‑judge pipelines, and regression suites.
• Benchmark and select models across providers (OpenAI, Anthropic, Google, etc.) on accuracy, latency, and cost, and manage model migrations.
• Define logging and tracing requirements, partner with product/design to capture in‑app feedback, and maintain evaluation datasets.
• Serve as the single point of contact for AI‑quality escalations, write user stories and acceptance criteria, and publish regular quality and cost readouts.

Required profile

• 3+ years experience in product management, data science, or applied AI, with at least 2 years on LLM‑based products in production.
• Hands‑on Python and SQL experience; comfortable pulling data, running batch inference, and computing metrics.
• Demonstrated experience building evaluation datasets and harnesses for LLM systems.
• Statistical literacy to size comparisons, judge significance, and interpret results.

Required skills

• Python
• SQL