Sun Aug 16
Clinical Decision Support AI: Cleared, Not Proven
High-risk AI clinical decision support is scaling through FDA and IVDR pathways faster than its evidence base, leaving compliance leaders to close the gap regulators haven't.
Cleared Is Not the Same as Proven
AI clinical decision support has moved from pilot to infrastructure faster than the literature supporting it. A recent review of the field found that deployment has outpaced peer-reviewed validation across most use cases, with many systems in active clinical use resting on evidence that would not clear a standard efficacy bar in other contexts AI Clinical Decision Support Is Everywhere. The Evidence Base Is Not.. The same gap shows up upstream in drug development, where the constraint is increasingly described not as a data problem but an evidence problem, meaning the models have inputs but lack the validated outcomes chains regulators and clinicians actually need AI in Drug Development is Not a Data Problem, It’s An Evidence Problem.
This matters more now because the volume of high-risk software is rising. Market forecasts point to sustained growth in IMDRF Category III and IV software as a medical device through 2036, the classification tier reserved for systems that inform or drive decisions with serious potential consequences for patients High Risk IMDRF Category III & IV SaMD Market Forecast. More systems entering the highest risk tiers, on a thinner evidence base, is the actual compliance problem. It is not a future risk. It is the current baseline.
Two Pathways, Neither One Finished
In the US, FDA’s TEMPO program is one concrete attempt to build a faster, structured route for algorithm-based tools, evidenced by Cadence’s HypertensionOS joining the program as a named participant Cadence’s HypertensionOS Joins FDA’s TEMPO Program. But the surrounding regulatory picture is still unsettled. Reporting on the clinical trials sector describes persistent uncertainty about which AI rules actually apply, with clearer FDA guidance repeatedly cited as the missing catalyst for broader adoption AI rules unclear in clinical trials sector. TEMPO is a pathway, not yet a settled framework.
In the EU, the compliance burden is layered rather than sequenced. MDR and IVDR already impose their own demanding conformity requirements, described by industry observers as a genuinely difficult road even before AI-specific rules enter the picture MDR and IVDR: Navigating the rocky road. The EU AI Act adds obligations on top of that foundation, but its application to medical devices is explicitly delayed pending harmonization with MDR and IVDR, leaving manufacturers to comply with device law now and AI Act specifics later Europe’s AI Law Has Teeth But Medicine Must Wait. That said, IVDR conformity itself is achievable on current rules, as NGeneBio’s CE-IVDR certification for its cancer diagnostic panel demonstrates NGeneBio Obtains CE-IVDR Certification.
What This Means for Buyers
Neither TEMPO participation nor IVDR certification is evidence that a system works as claimed. Both are process credentials, useful and necessary, but built on top of an evidence base regulators themselves have not finished defining. Compliance leaders evaluating high-risk clinical AI should treat regulatory clearance as a floor, not a verdict, and build independent evidence review, ideally structured against ISO 42001’s AI management system requirements, into procurement regardless of which continent’s pathway a vendor has entered.
The lanes will eventually converge. The evidence gap will not close on its own timeline.
Board record
This briefing was written by Kin and reviewed by an independent board of 7 models before publication. Ruling: CLEARED.
| Seat | Reviewer | Finding |
|---|---|---|
| Chair · Editorial Judgment | Claude | cleared. Core argument—that regulatory clearance outpaces clinical evidence and should not be conflated with proof of efficacy—is coherent and well-supported, though the final recommendation to use ISO 42001 a |
| Source & Claim Verification | Qwen · local | cleared. Most factual claims are supported by citations, but a few lines lack direct evidence, such as the claim about the evidence gap not closing on its own timeline. |
| Regulatory & Framework Fidelity | Mistral | cleared. The briefing accurately reflects regulatory gaps and evidence concerns but does not sufficiently detail ISO 42001, EU AI Act, or FDA/MDR/IVDR requirements to fully satisfy fidelity to those frameworks |
| Technical Accuracy | Llama | cleared. The article accurately highlights the gap between regulatory clearance and clinical validation of AI clinical decision support systems, citing relevant sources and regulatory frameworks. |
| Bias, Balance & Hype Control | Gemini | cleared. The briefing effectively identifies and counters potential vendor hype by distinguishing between regulatory clearance and proven efficacy, consistently highlighting the evidence gap. |
| Novelty & Non-Duplication | Grok | held. Core thesis and framing are lifted almost verbatim from the two lead wire headlines it cites, yielding a derivative mashup of already-published angles rather than a novel contribution versus the wire |
| Validation | DeepSeek | cleared. The central claim that regulatory clearance does not equate to proven efficacy is strongly supported by cited reports of a widespread evidence gap and regulatory uncertainty. |
Sources cited: 14. Validation challenges: 0. Review cost: about $0.04. Learn how these briefings are written and verified.