Features Partner Sites Information LinkXpress hp
Sign In
Advertise with Us
IBA-Radcal

Download Mobile App




Events

08 Dec 2026 - 10 Dec 2026
25 Jan 2027 - 28 Jan 2027

New Study Highlights Benefits and Risks of AI Explanations in Clinical Diagnosis

By HospiMedica International staff writers
Posted on 12 Aug 2026

Explainable artificial intelligence is increasingly used in tools that help clinicians and patients assess skin disease, but its explanations can influence decisions and contribute to overreliance or error. More...

As use expands, maintaining accuracy and equity is a growing priority. A new study finds that the benefits and risks of AI explanations vary by user expertise and identifies interface choices that may support safer diagnostic decisions.

Researchers at the Massachusetts Institute of Technology, working with collaborators at Stanford University and Columbia University, evaluated several forms of explainable AI for dermatologic diagnosis. The systems provided either a model prediction with confidence alone, similar-image retrieval to support the prediction, heat maps highlighting influential image regions, or plain-language explanations generated by a large language model. These approaches are intended to make AI reasoning more transparent and help users calibrate trust during image-based diagnosis.

The team tested both nonexperts and clinicians on skin disease recognition with and without these aids. Nonexperts assessed whether mole images were cancerous, while clinicians generated differential diagnoses for dermatologic conditions. The researchers also evaluated a fairness-constrained model designed to reduce bias across skin tones.

All explainability methods improved accuracy among nonexperts, largely because users tended to defer to the AI. Large language model explanations were especially persuasive, increasing confidence even when the model was incorrect, while vague or generic rationales were often judged more convincing. Clinicians were more resistant to incorrect AI guidance and performed best when shown only the model prediction without an explanation. Showing explanations before users formed their own assessment also increased reliance on the AI.

Across tasks, AI outperformed humans when disease presentation was subtle, whereas humans excelled when images contained atypical features or unrelated artifacts. The fairness‑constrained model significantly improved accuracy and reduced diagnostic disparities based on skin tone. The findings, published in Nature Medicine on August 4, 2026, suggest interface designs that require users to commit to an initial hypothesis before viewing AI output may mitigate overreliance.

“Good AI systems can improve performance in some health settings, but this has to be balanced carefully with algorithmic deference that can lead to more error. We know that both AI and explainability methods can engage automation bias in humans, and this anchoring effect is something that must be accounted for when we design AI systems,” said Marzyeh Ghassemi, an associate professor in MIT’s Department of Electrical Engineering and Computer Science, a member of the Institute for Medical Engineering and Science, and a principal investigator at the Laboratory for Information and Decision Systems and the Abdul Latif Jameel Clinic for Machine Learning in Health.

“These findings are important as patients increasingly turn to AI to help with their health care. Our findings show that those with the least medical knowledge are most likely to be led astray when explainable AI models give an erroneous output,” said Roxana Daneshjou, a co-author and assistant professor of biomedical data science and dermatology at Stanford University.


Gold Member
SARS‑CoV‑2/Flu A/Flu B/RSV Sample-To-Answer Test
SARS‑CoV‑2/Flu A/Flu B/RSV Cartridge (CE-IVD)
Hand-held Hemoglobin Analyzer
DiaSpect Tm
Medical-Grade Display
HL2316SHTB
Multi-Chamber Washer-Disinfector
WD 390
Read the full article by registering today, it's FREE! It's Free!
Register now for FREE to HospiMedica.com and get access to news and events that shape the world of Hospital Medicine.
  • Free digital version edition of HospiMedica International sent by email on regular basis
  • Free print version of HospiMedica International magazine (available only outside USA and Canada).
  • Free and unlimited access to back issues of HospiMedica International in digital format
  • Free HospiMedica International Newsletter sent every week containing the latest news
  • Free breaking news sent via email
  • Free access to Events Calendar
  • Free access to LinkXpress new product services
  • REGISTRATION IS FREE AND EASY!
Click here to Register








Channels

Patient Care

view channel
Image: A view inside the custom virtual reality environment used in the study: a calm room with a teddy bear, soft colors and large windows looking out over the sea. (Image Credit: Walaa S. Abu Rukbah et al., Virginia Commonwealth University; CC-BY 4.0, https://creativecommons.org/licenses/by/4.0/)

Virtual Reality Program May Reduce Anxiety Before Pediatric Surgery

Presurgery anxiety affects an estimated 50% to 75% of children undergoing surgery and can complicate anesthesia induction, increase postoperative pain, and prolong recovery. Sedation is often used to manage... Read more

Medical Imaging

view channel
Image: A new automated approach could help predict which patients with dystonia will benefit from deep brain stimulation before surgery (Image Credit: Adobe Stock)

AI Uses Routine MRI to Predict Deep Brain Stimulation Response in Dystonia

Dystonia is a debilitating neurological movement disorder characterized by involuntary muscle contractions that cause abnormal movements and postures. Deep brain stimulation (DBS) is one of the few treatments... Read more

Health IT

view channel
Image Credit: Shutterstock

Telemonitoring Program Improves Quality of Life After Heart Failure Discharge

Heart failure is a chronic condition associated with high mortality, frequent hospitalizations, and reduced quality of life. Patients face particularly high risks of readmission and death after discharge,... Read more

Point of Care

view channel
Image: Jessica Ramella-Roman, professor of biomedical engineering at Florida International University, holding the PPRIM (Portable Preterm Imaging) device designed to detect early signs of preterm labor risk. (Photo courtesy of Florida International University)

Handheld Imaging Device May Help Identify Preterm Birth Risk Earlier

Preterm birth, defined as delivery before 37 weeks of pregnancy, can lead to serious neonatal complications, including neurological, developmental, and respiratory problems. However, identifying pregnancies... Read more

Business

view channel
Image: Stryker has acquired ZuriMED, adding the FiberLocker System, a rotator cuff augmentation technology designed to strengthen repairs, to its Sports Medicine portfolio. (Photo courtesy of ZuriMED)

Stryker Completes Acquisition to Broaden Shoulder Surgery Offerings

Stryker (Portage, MI, USA) has completed its acquisition of ZuriMED (Zurich, Switzerland), a privately held developer of the FiberLocker System, expanding its Sports Medicine portfolio with a commercialized... Read more
Copyright © 2000-2026 Globetech Media. All rights reserved.