FDA's AI tool for medical devices struggles with simple tasks
Source: NBC News
June 3, 2025, 2:40 PM EDT
A new Food and Drug Administration AI tool that could speed up reviews and approvals of medical devices such as pacemakers and insulin pumps is struggling with simple tasks, according to two people familiar with it. The tool which is still in beta testing is buggy, doesnt yet connect to the FDAs internal systems and has issues when it comes to uploading documents or allowing users to submit questions, the people say. Its also not currently connected to the internet and cant access new content, such as recently published studies or anything behind a paywall.
The artificial intelligence, dubbed internally CDRH-GPT, is intended to help staffers at the agencys Center for Devices and Radiological Health, a division responsible for ensuring the safety of devices implanted in the body as well as essential tools like X-rays and CT scanners. The division was among those affected by the sweeping mass layoffs at the Department for Health and Human Services earlier this year.
While many of the device reviewers were spared, the agency eliminated much of the backend support that enables them to issue approval decisions on time. The work of reviewers includes sifting through large amounts of data from animal studies and clinical trials. Depending on the applicant, it can take months or even over a year which an AI tool could feasibly help shorten. Experts, however, are concerned that the FDAs push toward AI could outpace what the technology is actually ready for.
Since taking over the agency on April 1, Commissioner Dr. Marty Makary has pushed to integrate artificial intelligence across the FDAs divisions. How this move into AI could affect the safety and effectiveness of drugs or medical devices hasnt been determined. Last month, Makary set a June 30 deadline for the AI rollout. On Monday, he said the agency was ahead of schedule. But the two people familiar with CDRH-GPT say that it still needs significant work and that FDA staff were already concerned about meeting the June deadline, at least in its original form.
Read more: https://www.nbcnews.com/health/health-news/fdas-ai-tool-medical-devices-struggles-simple-tasks-rcna210340
ADDITIONAL REFERENCE FOR SIMILAR TOOL - https://www.democraticunderground.com/10143470601

CDRH has literal electrical and mechanical engineers as device reviewers for the hospital equipment that as noted, can range from the sophisticated scanners (like MRIs, CTs, X-ray) down to the hospital bed. All the tubing, syringes, needles, injection vials (and caps), are considered "medical devices" as are simple IV bags, tongue depressors, swabs, and bandages. And add to this a HUGE assortment of medical "test kits" for everything under the sun (including the well-known COVID-tests and of course the blood sugar monitors/test strips).
Since that Center DOES have a User Fee program, I expect the few brought back may have been "paid for" with MDUFA funds (Medical Device User Fees Amendments).

Bayard
(25,361 posts)Most of the design/development engineers were mechanical or electrical back then.
There are 3 levels of devices: Class 1 are things like bandages and stethoscopes (not much risk.) Class II are a bit more involved, like hearing aids. Class III are the riskiest, and include implants, like pacemakers.
I don't think I'd want AI involved in anything to do with Class III devices.
BumRushDaShow
(153,947 posts)(fill in the blank type) Sponge USP.
And the both the medical gloves and condom tests are fun.
Bayard
(25,361 posts)
BumRushDaShow
(153,947 posts)when you have tanks of helium in the lab (used as a carrier gas for the GCs and "other purposes" ).
highplainsdem
(56,453 posts)bros haven't been happy that businesses haven't all rushed to implement software that hallucinates. But now, with AI bros so chummy with Trump, they can use the entire government for an experiment.
And almost anything could go wrong...
mathematic
(1,569 posts)Buggy
Doesn't connect to internal systems
Poor support for uploading documents
Poor support for user questions
Can't access latest data from the internet
These are, indeed, "simple tasks" and are readily addressable in mature software systems. Could this new breed of AI systems use a few more years of private industry maturation before the government adopts them? Sure. Does that mean that these types of AI systems are flawed and should be prohibited from government use? No, of course not.
These tools will be used by human experts. This is not an automated approval or regulatory process. Might as well as ask about the ethics of FDA staff using google, a tool that also uses adaptive computer algorithms to find and summarize data.