AI Product Analyst – Automation team
Job Description
Description
At MEDvidi, the Automation team builds and operates a mix of AI and conventional product features that automate clinical and operational workflows - from AI-drafted medical documentation to automated resolution of patient issues, intake verification flows, provider tooling, and the backend pipelines behind them. We free clinicians and operations from manual work a machine can do reliably and safely, in a domain where mistakes have real clinical and compliance consequences.
It's a full-stack product team, not an AI lab: we ship UI, backend workflows, integrations, and AI features side by side, and we measure them the same way.
The team works closely with Product, Engineering, MedOps, Clinical people. We're hiring an Product Analyst to own analytics for the team end-to-end as our automated surface area grows.
The role
You'll be the Product Analyst for the team - across everything we ship, both classical product features and AI-powered ones. You'll turn the production behavior of our systems into evidence the team can act on: which parts work, where they fail silently, and what to fix next. The work blends product analytics, AI evaluation, and operational analysis.
Responsibilities
Own the full product analytics stack for features the team ships - discovery and sizing, experiment design and analysis, funnel and adoption analysis, post-release impact assessment - across both AI-powered and conventional product features.
Analyze production behavior of AI and automation workflows across clinical and operational journeys.
Investigate hallucinations, silent failures, and quality degradation in AI-generated output.
Work directly with logs, transcripts, generated artifacts, and operational data to find patterns dashboards miss.
Design evaluations for AI quality - both automated and human review - and close the loop into prompt and product changes.
Build monitoring and dashboards for AI and automation health, and the operational metrics they roll up to.
Measure