Accuracy of a popular online symptom checker for ophthalmic diagnoses.

Carl Shen; Michael Nguyen; Alexander Gregor; Gloria Isaza; Anne Beattie

Study

Accuracy of a popular online symptom checker for ophthalmic diagnoses.

May 22, 2019

Shen C, Nguyen M, Gregor A, et al. JAMA Ophthalmol. 2019;137(6):690-692.

View more articles from the same authors.

This study entered 42 validated clinical vignettes for eye diseases into an online symptom checker. As with prior studies, the performance of the online symptom checker in producing the correct diagnosis was suboptimal. The authors suggest that current performance of symptom checkers is not sufficient for timely and accurate diagnosis of ophthalmologic conditions.

Available at

PubMed citation

Related Resources From the Same Author(s)

Responding to serious medical error in general practice—consequences for the GPs involved: analysis of 75 cases from Germany.

December 19, 2007

Advancing the future of patient safety in oncology: implications of patient safety education on cancer care delivery.

June 10, 2015

Simulation safety first: an imperative.

February 20, 2019

Endorsements of surgeon punishment and patient compensation in rested and sleep-restricted individuals.

March 27, 2019

Evaluation of parenteral nutrition errors in an era of drug shortages.

December 16, 2015

Testing the technology acceptance model for evaluating healthcare professionals' intention to use an adverse event reporting system.

February 20, 2008

How to induce an error management climate: experimental evidence from newly formed teams.

November 2, 2022

Ambulance diversion associated with reduced access to cardiac technology and increased one-year mortality.

August 19, 2015

Patient safety and quality outcomes for ED patients admitted to alternative care area inpatient beds.

May 29, 2019

Hospital-acquired infections under pay-for-performance systems: an administrative perspective on management and change.

September 26, 2018

The use of technology for urgent clinician to clinician communications: a systematic review of the literature.

January 7, 2015

How strong is the evidence for the use of perioperative beta blockers in non-cardiac surgery? Systematic review and meta-analysis of randomised controlled trials.

September 7, 2005

Opioid prescribing decreases after learning of a patient's fatal overdose.

August 22, 2018

Effect of prescriber notifications of patient’s fatal overdose on opioid prescribing at 4 to 12 months: a randomized clinical trial.

January 18, 2023

Safety implications of different forms of understaffing among nurses during the COVID-19 pandemic.

July 28, 2021

Hospital financial condition and the quality of patient care.

November 5, 2008

Human factors in anaesthetic practice: insights from a task analysis.

March 19, 2008

Remembering to learn: the overlooked role of remembrance in safety improvement.

December 7, 2016

The problem with incident reporting.

October 28, 2015

Imitating incidents: how simulation can improve safety investigation and learning from adverse events.

June 27, 2018

Investigating for improvement? Five strategies to ensure national patient safety investigations improve patient safety.

June 5, 2019

Governing the safety of artificial intelligence in healthcare.

May 8, 2019

Early warnings, weak signals and learning from healthcare disasters.

April 9, 2014

Learning from patient safety incidents: creating participative risk regulation in healthcare.

February 27, 2008

Experiences of physicians investigated for professionalism concerns: a narrative review.

March 13, 2024

How health systems decide to use artificial intelligence for clinical decision support.

April 6, 2022

Labeling morphine milligram equivalents on opioid packaging: a potential patient safety intervention.

August 22, 2018

Framing patient safety initiatives: working model and case example.

April 26, 2006

Interventions to improve safe sleep among hospitalized infants at eight children's hospitals.

May 4, 2016

Motivational influences on anaesthetists' use of practice guidelines.

May 13, 2009

We are going to name names and call you out! Improving the team in the academic operating room environment.

June 21, 2017

Harnessing event report data to identify diagnostic error during the COVID-19 pandemic.

December 15, 2021

Adverse events experienced by homecare patients: a scoping review of the literature.

March 10, 2010

The impact of a 22-month multistep implementation program on speaking-up behavior in an academic anesthesia department.

July 27, 2022

July 20, 2022

Identifying violation-provoking conditions in a healthcare setting.

December 17, 2008

Insulin pump risks and benefits: a clinical appraisal of pump safety standards, adverse event reporting, and research needs: a joint statement of the European Association for the Study of Diabetes and the American Diabetes Association Diabetes Technology Working Group.

May 6, 2015

A mixed-method study of practitioners' perspectives on issues related to EHR medication reconciliation at a health system.

May 8, 2019

Implementation of a modified bedside handoff for a postpartum unit.

June 21, 2017

Identification and characterization of adverse drug events in primary care.

October 11, 2017

Evaluating the effect of safety culture on error reporting: a comparison of managerial and staff perspectives.

August 20, 2014

The influence of organizational factors on patient safety: examining successful handoffs in health care.

August 27, 2014

Delivering high reliability in maternity care: in situ simulation as a source of organisational resilience.

July 10, 2019

Human and organizational biases affecting the management of safety.

October 12, 2011

Can we import improvements from industry to healthcare?

May 1, 2019

Systematic biases in group decision-making: implications for patient safety.

November 5, 2014

Does the concept of safety culture help or hinder systems thinking in safety?

January 22, 2014

Surgical count process for prevention of retained surgical items: an integrative review.

May 11, 2016

Medication safety initiative in reducing medication errors.

July 7, 2010

Patient Safety Innovations

Assessing the impact of virtual medication history technicians on medication reconciliation discrepancies.

April 7, 2022

Assessing the impact of virtual medication history technicians on medication reconciliation discrepancies.

December 1, 2021

Findings from the ISMP Medication Safety Self-Assessment for hospitals.

March 6, 2005

Using harm-based weights for the AHRQ Patient Safety for Selected Indicators composite (PSI-90): does it affect assessment of hospital performance and financial penalties in Veterans Health Administration hospitals?

February 1, 2017

Improving handoffs in the perioperative environment: a conceptual framework of key theories, system factors, methods, and core interventions to ensure success.

July 19, 2023

Learning from failure: the need for independent safety investigation in healthcare.

November 19, 2014

Using prospective clinical surveillance to identify adverse events in hospital.

March 30, 2011

Reducing inappropriate diagnostic practice through education and decision support.

May 19, 2010

A scoping review of adverse incidents research in aged care homes: learnings, gaps, and challenges.

February 8, 2023

Effects of a multimodal transitional care intervention in patients at high risk of readmission: the TARGET-READ randomized clinical trial.

May 17, 2023

Medication errors' causes analysis in home care setting: a systematic review.

February 9, 2022

The effect of a clinical pharmacist-led training programme on intravenous medication errors: a controlled before and after study.

April 2, 2014

Mandating limits on workload, duty, and speed in radiology.

July 6, 2022

Medication error in the care of HIV/AIDS patients: electronic surveillance, confirmation, and adverse events.

September 7, 2005

A safe practice standard for barcode technology.

June 3, 2015

Inpatient suicide: preventing a common sentinel event.

March 25, 2009

Improving heparin safety: a multidisciplinary invited conference.

July 23, 2008

Ergonomic and human factors affecting anesthetic vigilance and monitoring performance in the operating room environment.

December 14, 2005

Using an interactive voice response system to improve patient safety following hospital discharge.

August 1, 2007

"It's not our ass": medical resident sense-making regarding lawsuits.

July 19, 2006

Improved medication management with introduction of a perioperative and prescribing pharmacist service.

August 12, 2020

Error disclosure and apology in radiology: the case for further dialogue.

September 25, 2019

Patient safety improvement interventions in children's surgery: a systematic review.

November 16, 2016

Variations by state in physician disciplinary actions by US medical licensure boards.

April 13, 2016

Identifying potential prescribing safety indicators related to mental health disorders and medications: a systematic review.

August 14, 2019

Delayed or failure to follow-up abnormal breast cancer screening mammograms in primary care: a systematic review.

May 12, 2021

"Good care is slow enough to be able to pay attention": primary care time scarcity and patient safety.

March 6, 2024

"Thank You for Listening": An exploratory study regarding the lived experience and perception of medical errors among those who receive care.

February 19, 2020

Training health care professionals in root cause analysis: a cross-sectional study of post-training experiences, benefits and attitudes.

April 10, 2013

Duplication of surgical site marking.

September 19, 2012

The effect of external inspections on safety in acute hospitals in the National Health Service in England: a controlled interrupted time-series analysis.

August 14, 2019

Do telephone call interruptions have an impact on radiology resident diagnostic accuracy?

October 22, 2014

Family perceptions of medication administration at school: errors, risk factors, and consequences.

April 16, 2008

Creating an integrated patient safety team.

August 10, 2005

Crisis checklists in emergency medicine: another step forward for cognitive aids.

April 7, 2021

A report of information technology and health deficiencies in U.S. nursing homes.

September 8, 2021

Ensuring access to medications in the US during the COVID-19 pandemic.

May 6, 2020

Sample to sample carryover: a source of analytical laboratory error and its relevance to integrated clinical chemistry/immunoassay systems.

July 5, 2006

Cough and cold medication adverse events after market withdrawal and labeling revision.

December 4, 2013

Establishing a multidisciplinary taskforce to improve anticoagulation safety at a large health system.

December 12, 2021

"It's a big part of being good surgeons": surgical trainees' perceptions of error recovery in the operating room.

July 28, 2021

Surgical errors happen, but are learners trained to recover from them? A survey of North American surgical residents and fellows.

August 26, 2020

Prevalence and factors associated with patient-requested corrections to the medical record through use of a patient portal: findings from a national survey.

March 9, 2022

Competencies for improving diagnosis: an interprofessional framework for education and training in health care.

August 28, 2019

Learning from accidents—what more do we need to know?

May 12, 2010

The economic burden of nurse-sensitive adverse events in 22 medical-surgical units: retrospective and matching analysis.

September 20, 2017

A realist synthesis of interprofessional patient safety activities and healthcare student attitudes towards patient safety.

August 16, 2023

Case-control analysis of the financial cost of medication errors in hospitalized patients.

January 11, 2006

Improving maternal safety at scale with the mentor model of collaborative improvement.

May 23, 2018

Medication errors in acute cardiovascular and stroke patients. A scientific statement from the American Heart Association.

April 7, 2010

Patient safety and systematic reviews: finding papers indexed in MEDLINE, EMBASE and CINAHL.

November 24, 2010

Related Resources

A "Do No Harm" novel safety checklist and research approach to determine whether to launch an artificial intelligence-based medical technology: introducing the Biological-Psychological, Economic, and Social (BPES) Framework.

July 5, 2023

Patient Safety Innovations

Remote Response Team and Customized Alert Settings Help Improve Management of Sepsis

May 31, 2023

Journal Article

Study

Reducing hospital harm: establishing a command centre to foster situational awareness.

March 29, 2023

I’m an ER doctor: here’s what I found when I asked ChatGPT to diagnose my patients.

March 22, 2023

Health technology, quality and safety in a learning health system.

February 15, 2023

Using community detection techniques to identify themes in COVID-19-related patient safety event reports.

December 7, 2022

Electronic diagnostic support in emergency physician triage: qualitative study with thematic analysis of interviews.

November 16, 2022

Improving diagnostic decision support through deliberate reflection: a proposal.

November 9, 2022

Artificial Intelligence in Health Care: Benefits and Challenges of Machine Learning Technologies for Medical Diagnostics.

October 26, 2022

The diagnostic and triage accuracy of digital and online symptom checker tools: a systematic review.

August 31, 2022

Business Intelligence dashboards for patient safety and quality: a narrative literature review.

June 22, 2022

Automated identification of diagnostic labelling errors in medicine.

June 8, 2022

WebM&M Cases

To Dilute or Not Dilute: Drug Errors and Consequences in the Operating Room

October 27, 2021

Diagnostic errors, health disparities, and artificial intelligence: a combination for health or harm.

September 1, 2021

Stroke hospitalization after misdiagnosis of "benign dizziness" is lower in specialty care than general practice: a population-based cohort analysis of missed stroke using SPADE methods.

July 21, 2021

Machine learning is booming in medicine. It’s also facing a credibility crisis.

June 16, 2021

Safe opioid prescribing: a prognostic machine learning approach to predicting 30-day risk after an opioid dispensation in Alberta, Canada.

June 16, 2021

WebM&M Cases

Delayed Diagnosis in the Setting of Virtual Care: Remembering the Physical Examination

March 31, 2021

When machine learning goes off the rails. A guide to managing the risks.

March 3, 2021

Using telehealth to revolutionize the speed of making rare disease diagnoses.

September 9, 2020

Human-computer collaboration for skin cancer recognition.

July 22, 2020

The limits of current A.I. in health care: patient safety policing in hospitals.

June 17, 2020

Patient perspectives on the use of artificial intelligence for skin cancer screening: a qualitative study.

April 1, 2020

WebM&M Cases

A Mistaken Dose of Naloxone 

December 18, 2019

Missed serious neurologic conditions in emergency department patients discharged with nonspecific diagnoses of headache or back pain.

October 30, 2019

Prevalence and predictability of low-yield inpatient laboratory diagnostic tests.

September 25, 2019

Using proactive risk assessment (HFMEA) to improve patient safety and quality associated with intraocular lens selection and implantation in cataract surgery.

September 18, 2019

Advances in Human Factors and Ergonomics in Healthcare and Medical Devices.

September 11, 2019

From box ticking to the black box: the evolution of operating room safety.

September 4, 2019

Medication accuracy in electronic health records for microbial keratitis.

June 12, 2019

See More About The Topic

Physicians

Information Professionals

Patients

Ophthalmology

Clinical Misdiagnosis

Accuracy of a popular online symptom checker for ophthalmic diagnoses.

Assessing the impact of virtual medication history technicians on medication reconciliation discrepancies.

Remote Response Team and Customized Alert Settings Help Improve Management of Sepsis

Reducing hospital harm: establishing a command centre to foster situational awareness.

Connect With Us

Sign up for Email Updates

Agency for Healthcare Research and Quality

Accuracy of a popular online symptom checker for ophthalmic diagnoses.

Assessing the impact of virtual medication history technicians on medication reconciliation discrepancies.

Remote Response Team and Customized Alert Settings Help Improve Management of Sepsis

Reducing hospital harm: establishing a command centre to foster situational awareness.

Connect With Us

Sign up for Email Updates

Agency for Healthcare Research and Quality

Submit Your Innovations

Continue as a Guest

Continue Logged In

Submit Your Innovations

Continue as a Guest

Continue logged in

New Users to the PSNet site