AI Product Analyst - Voice AI Agents

About the role

MEDvidi is seeking an AI Product Analyst to evaluate, monitor, and improve Voice AI Agents that support patient journeys on its mental‑health platform. The role sits at the intersection of product, engineering, operations and AI, turning raw conversation data into actionable insights that drive product decisions.

Key responsibilities

• Analyze production behavior of Voice AI Agents and conversational workflows.
• Investigate hallucinations, inconsistencies, silent failures and quality degradation in AI‑driven conversations.
• Work directly with call transcripts, logs, generated outputs and operational datasets to uncover patterns.
• Design evaluation frameworks to measure AI quality, reliability and business impact.
• Build monitoring dashboards and alerting systems for AI performance visibility.
• Measure the impact of AI systems on operational efficiency, business outcomes and patient experience.
• Detect quality shifts, anomalies and emerging failure modes in production.
• Partner with Product, Engineering, QA and Operations teams to support rapid decision‑making.

Required profile

• 3+ years of experience in product, data or operational analytics within complex production systems.
• Strong analytical mindset with comfort handling raw conversation data and ambiguous problems.
• Understanding of large language model limitations and failure modes.

Required skills

• SQL
• Python (including text‑data processing)

What we offer

• Opportunity to shape a high‑visibility AI product in healthcare.
• High ownership in a fast‑moving medical‑tech company.
• Influence product decisions using real‑world evidence.