Clinical AI Engineer

Job Title: Clinical AI Engineer Company: Heidi Job Category: Machine Learning Roles & Responsibilities: We're building the future of healthcare by giving every clinician the earth's finest AI Care Partner. Our platform has absorbed the administrative chaos of 175 million patient visits and supported 67 million clinical hours. Today, we support 2\.8 million patient sessions a week across 190\+ countries, in 110 languages and over 200 specialties. The role ------------ * Design the evaluation. Define evaluations for greenfield products to an academic standard: endpoints, comparators, ground truth, sample size, analysis plan. Set the bar before the result arrives. * Build the measurement. Build, optimize and validate the LLM judges and rubrics that score the product at scale. Report their agreement with clinician ground truth, not their convenience, and retire the ones that drift. * Run it and write it up. Execute the evaluation, do the statistics, and write it up once in a form that serves the pod, the regulatory file and an academic submission. * Run post\-market surveillance. Monitor output quality in production and respond to regulatory feedback with data. Our clinical safety team triages complaints and incidents; you’re their counterpart in the pod, working out what their findings mean for the product and what should change. * Fix what the evidence finds. Prompt and rubric changes, evaluation harness changes, code changes in the pod’s codebase, shipped through the pod’s normal review and release process. * Publish. Contribute to peer\-reviewed literature on the translational benefit of the product. * Be the clinician in the room. Catch the output that reads well and is wrong. Hold the line on clinical nuance when a shortcut would ship faster. * Build for the next decade, not next quarter. Our targets are outrageous on purpose. The world's health doesn't have the luxury of incrementalism. * Lead, don't wait. We treat tomorrow's problems today. Sometimes we build what's needed before it's wanted, and we're fine with that. * Follow the evidence. Trust the patient. We pursue truth relentlessly. But when the subjective and objective disagree, we treat the patient, not the numbers. Ego is a comorbidity we can't afford. * Own the outcome. Everyone here carries the company. Raise problems with solutions, solve them end\-to\-end, and never be a bystander. * Ship, measure, go again. A button today, a workflow tomorrow. More iterations beat better planning. We're precise at pace, not reckless. * Live in clinicians' reality. Not the ideal workflow, the twenty\-patients\-before\-lunch actual one. We build for exhausted humans, and we'd better be decent ones while we do it. * Equity from day one. When Heidi wins, you win. You'll share directly in the success you help create. * Your health, covered. Comprehensive private medical and dental cover through Bupa, plus 24/7 mental health, coaching and wellbeing support through Sonder and a £100/month Healthy Heidi’s stipend. * Global parental leave. 26 weeks paid for primary carers and 18 weeks for secondary carers, subject to eligibility. * Fertility support. £7,000 one\-off payment, eligibility applies. * Learning \& development. £700 per year for courses, books, memberships, conferences and more. * Home office budget of £500 one\-off to set up a workspace you actually want to work in. * Recharge days after major milestones and busy periods so you can reset and come back strong. * Work from anywhere for up to 4 weeks per year, wherever the world takes you. * Clinical leave. 10 days per year for eligible clinical roles to maintain accreditation and requirements. * Flexibility that works. A hybrid environment, with 3 days in the office. Work Location: Sydney, NSW, Australia Availability: Full time

* A medical degree and clinical practice with independent clinical judgment. This role runs on medical nuance, and this requirement doesn’t flex. * Academic depth. Study design, inferential statistics, agreement and reliability measures, sample size, handling of multiple comparisons. Thesis or publication\-level work, not a methods module. * Experience evaluating medical software or clinical AI, including building or validating LLM\-as\-judge pipelines. * Enough engineering to work in a production codebase. Read it, understand what a change will do, make the change in Python or TypeScript, and get it through review. Prompt engineering and AI\-assisted coding are daily tools here, and they’re the floor, not the ceiling. * Independence. You can run a project for weeks with light direction, and you say early when it’s stuck. * Clear writing. Evaluation reports, surveillance summaries and manuscripts are the primary output of this role. Our Benefits Key Skills: Machine Learning, Python Salary: $1