Features Partner Sites Information LinkXpress hp
Sign In
Advertise with Us
IBA-Radcal

Download Mobile App




Events

08 Dec 2026 - 10 Dec 2026
25 Jan 2027 - 28 Jan 2027

Study Finds AI Falls Short When Analyzing Medical Data

By HospiMedica International staff writers
Posted on 20 Nov 2018
A study conducted at the Icahn School of Medicine at Mount Sinai (New York, NY, USA) has found that artificial intelligence (AI) tools trained to detect pneumonia on chest X-rays suffered significant decreases in performance when tested on data from outside health systems. More...
These findings suggest that unless AI in the medical space is carefully tested for performance across a wide range of populations, the deep learning models may not perform as accurately as expected.

Amidst the growing interest in the use of computer system frameworks called convolutional neural networks (CNN) to analyze medical imaging and provide a computer-aided diagnosis, recent studies have found that AI image classification may not generalize to new data as well as commonly portrayed. The researchers at the Icahn School of Medicine at Mount Sinai assessed how AI models identified pneumonia in 158,000 chest X-rays across three medical institutions. They chose to study the diagnosis of pneumonia on chest X-rays due to its common occurrence, clinical significance, and prevalence in the research community.

The researchers found that in three out of five comparisons, the performance of CNNs in diagnosing diseases on X-rays from hospitals outside of its own network was significantly lower as compared to X-rays from the original health system. However, CNNs were able to detect the hospital system where an X-ray was acquired with a high-degree of accuracy, and cheated at their predictive task based on the prevalence of pneumonia at the training institution. The researchers found that the key problem in using deep learning models in medicine was their use of a massive number of parameters, making it challenging to identify specific variables driving predictions, such as the types of CT scanners used at a hospital and the resolution quality of imaging.

“Our findings should give pause to those considering rapid deployment of AI platforms without rigorously assessing their performance in real-world clinical settings reflective of where they are being deployed,” said senior author Eric Oermann, MD, Instructor in Neurosurgery at the Icahn School of Medicine at Mount Sinai. “Deep learning models trained to perform medical diagnosis can generalize well, but this cannot be taken for granted since patient populations and imaging techniques differ significantly across institutions.”

“If CNN systems are to be used for medical diagnosis, they must be tailored to carefully consider clinical questions, tested for a variety of real-world scenarios, and carefully assessed to determine how they impact accurate diagnosis,” said first author John Zech, a medical student at the Icahn School of Medicine at Mount Sinai.

Related Links:
Icahn School of Medicine at Mount Sinai


Gold Member
Neonatal Heel Incision Device
Tenderfoot
Hand-held Hemoglobin Analyzer
DiaSpect Tm
Tourniquet System
heidi– mein Tourniquet
POC Respiratory/Sore Throat Test
BIOFIRE SPOTFIRE (R/ST) Panel
Read the full article by registering today, it's FREE! It's Free!
Register now for FREE to HospiMedica.com and get access to news and events that shape the world of Hospital Medicine.
  • Free digital version edition of HospiMedica International sent by email on regular basis
  • Free print version of HospiMedica International magazine (available only outside USA and Canada).
  • Free and unlimited access to back issues of HospiMedica International in digital format
  • Free HospiMedica International Newsletter sent every week containing the latest news
  • Free breaking news sent via email
  • Free access to Events Calendar
  • Free access to LinkXpress new product services
  • REGISTRATION IS FREE AND EASY!
Click here to Register








Channels

Artificial Intelligence

view channel
Image Credit: Shutterstock

Explainable AI Examines Sepsis Mortality Risk and Emergency Care Delays

Preventing sepsis-related deaths in emergency departments (EDs) remains challenging because patient deterioration can result from multiple rapidly evolving and interconnected factors. These include triage... Read more

Patient Care

view channel
Image: A view inside the custom virtual reality environment used in the study: a calm room with a teddy bear, soft colors and large windows looking out over the sea. (Image Credit: Walaa S. Abu Rukbah et al., Virginia Commonwealth University; CC-BY 4.0, https://creativecommons.org/licenses/by/4.0/)

Virtual Reality Program May Reduce Anxiety Before Pediatric Surgery

Presurgery anxiety affects an estimated 50% to 75% of children undergoing surgery and can complicate anesthesia induction, increase postoperative pain, and prolong recovery. Sedation is often used to manage... Read more

Health IT

view channel
Image Credit: Shutterstock

Telemonitoring Program Improves Quality of Life After Heart Failure Discharge

Heart failure is a chronic condition associated with high mortality, frequent hospitalizations, and reduced quality of life. Patients face particularly high risks of readmission and death after discharge,... Read more

Point of Care

view channel
Image: Jessica Ramella-Roman, professor of biomedical engineering at Florida International University, holding the PPRIM (Portable Preterm Imaging) device designed to detect early signs of preterm labor risk. (Photo courtesy of Florida International University)

Handheld Imaging Device May Help Identify Preterm Birth Risk Earlier

Preterm birth, defined as delivery before 37 weeks of pregnancy, can lead to serious neonatal complications, including neurological, developmental, and respiratory problems. However, identifying pregnancies... Read more

Business

view channel
Image: Stryker has acquired ZuriMED, adding the FiberLocker System, a rotator cuff augmentation technology designed to strengthen repairs, to its Sports Medicine portfolio. (Photo courtesy of ZuriMED)

Stryker Completes Acquisition to Broaden Shoulder Surgery Offerings

Stryker (Portage, MI, USA) has completed its acquisition of ZuriMED (Zurich, Switzerland), a privately held developer of the FiberLocker System, expanding its Sports Medicine portfolio with a commercialized... Read more
Copyright © 2000-2026 Globetech Media. All rights reserved.