Performance evaluation of ChatGPT in detecting diagnostic errors and their contributing factors: an analysis of 545 case reports of diagnostic errors. | PSNet

Provide Feedback |

Submit a Case

Register

Study

Performance evaluation of ChatGPT in detecting diagnostic errors and their contributing factors: an analysis of 545 case reports of diagnostic errors.

June 19, 2024

Harada Y, Suzuki T, Harada T, et al. BMJ Open Qual. 2024;13(2):e002654.

View more articles from the same authors.

ChatGPT and other large language models are being studied for their ability to provide correct diagnoses in numerous clinical areas. This study sought to evaluate ChatGPT's ability to identify diagnostic errors in case studies. ChatGPT was able to identify diagnostic errors in 95% of the 545 case reports. The results suggest ChatGPT could be used to screen for possible diagnostic errors in electronic health records, but significant research and testing is still required.

PubMed citation

Related Resources From the Same Author(s)

Diagnostic errors in uncommon conditions: a systematic review of case reports of diagnostic errors.

September 13, 2023

Cognitive biases encountered by physicians in the emergency room.

November 9, 2022

Effect of contextual factors on the prevalence of diagnostic errors among patients managed by physicians of the same specialty: a single-centre retrospective observational study.

February 8, 2023

Culture of safety: impact on improvement in infection prevention process and outcomes.

February 3, 2021

How insight contributes to diagnostic excellence.

September 21, 2022

Effectiveness of a clinical knowledge support system for reducing diagnostic errors in outpatient care in Japan: a retrospective study.

March 28, 2018

Reduction of medication errors related to sliding scale insulin by the introduction of a standardized order sheet.

February 22, 2017

Daytime sleepiness, sleep habits and occupational accidents among hospital nurses.

November 23, 2005

Wake Up Safe and root cause analysis: quality improvement in pediatric anesthesia.

July 9, 2014

In-hospital mortality associated with the misdiagnosis or unidentified site of infection at admission.

July 31, 2019

Potentially inappropriate medications according to STOPP-J criteria and risks of hospitalization and mortality in elderly patients receiving home-based medical services

December 18, 2019

Posttraumatic growth and second victim distress resulting from medical mishaps among physicians and nurses.

January 11, 2023

Coronavirus disease 2019 (COVID-19) pandemic, central-line-associated bloodstream infection (CLABSI), and catheter-associated urinary tract infection (CAUTI): the urgent need to refocus on hardwiring prevention efforts.

February 7, 2022

Evaluation of communication and safety behaviors during hospital-wide code response simulation.

March 2, 2022

The impact of internal service quality on preventable adverse events in hospitals.

March 27, 2019

Medical emergency team calls in the radiology department: patient characteristics and outcomes.

March 14, 2012

Investigating the impact of intensive care unit interruptions on patient safety events and electronic health records use: an observational study.

July 24, 2019

Bundle interventions including nontechnical skills for surgeons can reduce operative time and improve patient safety.

December 9, 2020

Using pharmacists to optimize patient outcomes and costs in the ED.

August 27, 2014

Impact of organizational culture on preventability assessment of selected adverse events in the ICU: evaluation of morbidity and mortality conferences.

June 19, 2013

A health system–wide initiative to decrease opioid-related morbidity and mortality.

September 26, 2018

Chemotherapy regimen checks performed by pharmacists contribute to safe administration of chemotherapy.

December 2, 2015

View More

Related Resources

Does an app a day keep the doctor away? AI symptom checker applications, entrenched bias, and professional responsibility.

June 26, 2024

Stakeholder perspectives on contributors to delayed and inaccurate diagnosis of cardiovascular disease and their implications for digital health technologies: a UK-based qualitative study.

June 19, 2024

Artificial intelligence in the provision of health care: an American College of Physicians policy position paper.

June 12, 2024

Comparative evaluation of LLMs in clinical oncology.

May 8, 2024

The role for policy in AI-assisted medical diagnosis.

May 8, 2024

Clinical reasoning of a generative artificial intelligence model compared with physicians.

April 17, 2024

Patient Safety Research Summaries.

April 9, 2024

Question answering systems for health professionals at the point of care - a systematic review.

March 20, 2024

Assessing diagnostic performance.

February 14, 2024

Current State of Diagnostic Safety: Implications for Research, Practice, and Policy.

February 7, 2024

Embracing the future-is artificial intelligence already better? A comparative study of artificial intelligence performance in diagnostic accuracy and decision-making.

February 7, 2024

Grand rounds in methodology: key considerations for implementing machine learning solutions in quality improvement initiatives.

January 31, 2024

Medical mistakes are more likely in women and minorities.

January 24, 2024

Diagnostic accuracy of a large language model in pediatric case studies.

January 17, 2024

On Patient Safety.

January 13, 2024

Measuring the impact of AI in the diagnosis of hospitalized patients: a randomized clinical vignette survey study.

January 10, 2024

Diagnostic Quality Improvement Repository.

January 10, 2024

Many people of color worry good health care is tied to their appearance.

December 13, 2023

"ChatGPT, can you help me save my child's life?" - Diagnostic accuracy and supportive capabilities to lay rescuers by ChatGPT in prehospital basic life support and paediatric advanced life support cases - an in-silico analysis.

December 6, 2023

Advancing Diagnostic Excellence for Maternal Health Care: Proceedings of a Workshop–in Brief.

November 15, 2023

Doctors wrestle with A.I. in patient care, citing lax oversight.

November 8, 2023

Can AI help doctors come up with better diagnoses?

October 4, 2023

Understanding And Addressing Pre-Hospital Diagnostic Delays.

September 20, 2023

Uncovering the shocking dangers of misdiagnosis.

September 20, 2023

‘Dr. Google’ meets its match: Dr. ChatGPT.

September 20, 2023

Patient and family contributions to improve the diagnostic process through the OurDX electronic health record tool: a mixed method analysis.

September 13, 2023

Assessing the utility of ChatGPT throughout the entire clinical workflow: development and usability study.

September 13, 2023

Pediatric Diagnostic Safety: State of the Science and Future Directions.

September 13, 2023

Diagnostic errors in uncommon conditions: a systematic review of case reports of diagnostic errors.

September 13, 2023

Reimagining Healthcare Teams: Leveraging the Patient-Clinician-AI Triad To Improve Diagnostic Safety.

August 16, 2023

View More

See More About The Topic

Ambulatory Clinic or Office

Clinical Misdiagnosis

Technologic Approaches

To sign up for updates or to access your subscriber preferences, please enter your email address below.

5600 Fishers Lane
Rockville, MD 20857
Telephone: (301) 427-1364