When AI Changes Overnight: How NICE is Rewriting the Rules for Evaluating Frontier AI

How do you evaluate a medical technology that constantly changes after deployment? Maya and Sam unpack a new report from the University of Sheffield's Decision Support Unit on how health technology assessment bodies like NICE must adapt to 'frontier AI'. They explore the nightmare of evidence decay, the hidden costs of governance, and the new requirements medtech companies will face to get AI funded.

Key points

• Frontier AI is defined by its nature as a configurable, evolving service rather than a fixed product, causing constant intervention instability.
• Health technology assessments face rapid evidence decay because routine updates to AI models and prompt templates can alter safety and performance.
• Economic models must evolve beyond software licensing fees to include the massive ongoing costs of cybersecurity, workflow integration, and continuous governance.
• NICE may require Predetermined Change Control Plans to ensure medtech companies outline exactly how post-deployment updates will be managed and tested.
• Recommendations for frontier AI will likely be bound to specific versions, configurations, and strict scopes of use, with mandatory review triggers if the system changes.

Source: FRONTIER ARTIFICIAL INTELLIGENCE AND HEALTH TECHNOLOGY ASSESSMENT - Decision Support Unit, University of Sheffield, 2026

This spot is available. Reach clinicians, health-system leaders and medtech and pharma teams following AI in medicine. Sponsor the show

This episode is an AI-generated conversation summarising a public document; the hosts' voices are synthetic. It is for information only and is not medical advice. Always refer to the original source.

Full transcript: https://ai-in-medicine-podcast.vercel.app/episodes/when-ai-changes-overnight-how-nice-is-rewriting-the-rules-for-evaluati-bef9c8