AI Product Analyst – Automation team

<h2>Description</h2> <p>At MEDvidi, the Automation team builds and operates a mix of AI and conventional product features that automate clinical and operational workflows - from AI-drafted medical documentation to automated resolution of patient issues, intake verification flows, provider tooling, and the backend pipelines behind them. We free clinicians and operations from manual work a machine can do reliably and safely, in a domain where mistakes have real clinical and compliance consequences.</p> </p> <p>It's a full-stack product team, not an AI lab: we ship UI, backend workflows, integrations, and AI features side by side, and we measure them the same way.</p> </p> <p>The team works closely with Product, Engineering, MedOps, Clinical people. We're hiring an Product Analyst to own analytics for the team end-to-end as our automated surface area grows.</p> </p> <p><strong>The role</strong></p> <p>You'll be the Product Analyst for the team - across everything we ship, both classical product features and AI-powered ones. You'll turn the production behavior of our systems into evidence the team can act on: which parts work, where they fail silently, and what to fix next. The work blends product analytics, AI evaluation, and operational analysis.</p> <h2>Responsibilities</h2> <ul> <li>Own the full product analytics stack for features the team ships - discovery and sizing, experiment design and analysis, funnel and adoption analysis, post-release impact assessment - across both AI-powered and conventional product features.</li> <li>Analyze production behavior of AI and automation workflows across clinical and operational journeys.</li> <li>Investigate hallucinations, silent failures, and quality degradation in AI-generated output.</li> <li>Work directly with logs, transcripts, generated artifacts, and operational data to find patterns dashboards miss.</li> <li>Design evaluations for AI quality - both automated and human review - and close the loop into prompt and product changes.</li> <li>Build monitoring and dashboards for AI and automation health, and the operational metrics they roll up to.</li> <li>Measure business and operational impact of automation initiatives and surface the risks they introduce.</li> <li>Partner closely with Product, Engineering, Clinical, MedOps, and Legal to support fast decisions under ambiguity.</li> </ul> <h2>Requirements</h2> <ul> <li>3+ years of experience in Product Analytics/Operational Analytics/Data Analytics, or analytics roles within complex production systems.</li> <li><strong>Hands-on experience evaluating LLM or AI output - prompt iteration, eval frameworks and human review pipelines is a strong plus.</strong></li> <li>Effective, structured written and verbal communication - able to turn analysis into crisp, decision-ready writeups that non-analysts can act on.</li> <li>Comfort in ambiguous, fast-changing environments where ground truth often has to be constructed.</li> <li>Strong product / operational analytics background, comfortable owning metrics end-to-end and writing SQL and Python code against messy production data.</li> <li>Fluent Russian; English level B2 or higher,</li> <li>Ability to work CET-overlapping hours.</li> </ul> <h2>What we offer</h2> <ul> <li>Work on a modern AI product where quality is a strategic function, not a formality</li> <li>Real influence on product direction and engineering practices</li> <li>High-impact work in a product-driven medical tech company</li> <li>Startup environment: fast iteration, high ownership, minimal bureaucracy</li> <li>Competitive compensation and growth opportunities</li> </ul> <p><strong>Benefits</strong></p> <ul> <li>Health insurance after probation period</li> <li>Sports &amp; wellness compensation</li> <li>Fully remote, long-term B2B collaboration</li> <li>19 working days of vacation per year</li> <li>3 additional wellness days per year</li> <li>Paid sick leave for the first 5 working days</li> <li>Gifts to employees for important events</li> <li>Career Development</li> <li>Personalized English lessons via Preply</li> </ul> <p><strong>Ready to make an impact? Send us your profile - let’s build something meaningful together.</strong></p>