Crowdsourcing a diagnosis? Exploring the accuracy of the size and type of group diagnosis: an experimental study.

Jonathan Sherbino; Matt Sibbald; Geoffrey R. Norman; Andrew LoGiudice; Amy Keuhl; Mark Lee; Sandra D. Monteiro

Study

Crowdsourcing a diagnosis? Exploring the accuracy of the size and type of group diagnosis: an experimental study.

April 10, 2024

Sherbino J, Sibbald M, Norman GR, et al. BMJ Qual Saf. 2024;Epub Mar 19.

View more articles from the same authors.

Collaboration between clinicians encourages better diagnostic decision making and clinical outcomes. This study sought to determine if collaboration improves diagnostic accuracy, assessing by collaborative group size (3 or 6 physicians) and process type (interactive or retrospective). Groups had better diagnostic accuracy than individuals, regardless of group size. Process types were equally effective.

PubMed citation

Available at

Related Resources From the Same Author(s)

Should electronic differential diagnosis support be used early or late in the diagnostic process? A multicentre experimental study of Isabel.

October 27, 2021

Electronic diagnostic support in emergency physician triage: qualitative study with thematic analysis of interviews.

November 16, 2022

The causes of errors in clinical reasoning: cognitive biases, knowledge deficits, and dual process thinking.

November 16, 2016

Disrupting diagnostic reasoning: do interruptions, instructions, and experience affect the diagnostic accuracy and response time of residents and emergency physicians?

February 18, 2015

Is bias in the eye of the beholder? A vignette study to assess recognition of cognitive biases in clinical case workups.

February 17, 2016

Reflecting on diagnostic errors: taking a second look is not enough.

September 2, 2015

The etiology of diagnostic errors: a controlled trial of System 1 versus System 2 reasoning.

January 29, 2014

Assessing diagnostic reasoning: a consensus statement summarizing theory, practice, and future needs.

February 6, 2013

Diagnostic reasoning in cardiovascular medicine.

January 19, 2022

The relationship between response time and diagnostic accuracy.

August 15, 2012

“I made a mistake!”: a narrative analysis of experienced physicians' stories of preventable error.

January 20, 2021

Surviving Sepsis Campaign: international guidelines for management of sepsis and septic shock: 2016

March 3, 2017

Seroprevalence of SARS-CoV-2 among frontline health care personnel in a multistate hospital network--13 academic medical centers, April-June 2020.

September 23, 2020

Optimizing Pediatric Patient Safety in the Emergency Care Setting.

October 19, 2022

Hospital discharge documentation and risk of rehospitalisation.

May 4, 2011

Implementation of the I-PASS handoff program in diverse clinical environments: a multicenter prospective effectiveness implementation study.

November 16, 2022

Families as partners in hospital error and adverse event surveillance.

March 8, 2017

Racial and ethnic differences in emergency department diagnostic imaging at US Children's Hospitals, 2016-2019.

January 4, 2021

Physician and nurse well-being and preferred interventions to address burnout in hospital practice: factors associated with turnover, outcomes, and patient safety.

July 19, 2023

ASPEN Safe Practices for Enteral Nutrition Therapy.

December 14, 2016

Diagnostic error and clinical reasoning.

January 13, 2010

Trigger alerts associated with laboratory abnormalities on identifying potentially preventable adverse drug events in the intensive care unit and general ward.

August 1, 2018

Development of an emergency department trigger tool using a systematic search and modified Delphi process.

July 13, 2016

Determination of unnecessary blood transfusion by comprehensive 15-hospital record review.

January 25, 2023

Implementing receiver-driven handoffs to the emergency department to reduce miscommunication.

June 3, 2020

Professional values and reported behaviours of doctors in the USA and UK: quantitative survey.

April 6, 2011

The effects of leadership curricula with and without implicit bias training on graduate medical education: a multicenter randomized trial.

May 18, 2022

The Research on Adverse Drug Events and Reports (RADAR) project.

May 18, 2005

Prevalence and causes of diagnostic errors in hospitalized patients under investigation for COVID-19.

April 12, 2023

Implementation and sustainability of a medication reconciliation toolkit: a mixed methods evaluation.

August 5, 2020

The computerized rounding report: implementation of a model system to support transitions of care.

August 3, 2011

Operating room–to-ICU patient handovers: a multidisciplinary human-centered design approach.

August 31, 2016

"July Effect": impact of the academic year-end changeover on patient outcomes. A systematic review.

July 27, 2011

Identifying and classifying diagnostic errors in acute care across hospitals: early lessons from the Utility of Predictive Systems in Diagnostic Errors (UPSIDE) study.

February 21, 2024

Requirements for implementing a 'just culture' within healthcare organisations: an integrative review.

June 21, 2023

Relationship between preventability of death after coronary artery bypass graft surgery and all-cause risk-adjusted mortality rates.

July 9, 2008

Management reasoning: beyond the diagnosis.

May 23, 2018

The effect of hospitalist discontinuity on adverse events.

March 25, 2015

The AHRQ Report on Diagnostic Errors in the Emergency Department: the wrong answer to the wrong question.

June 28, 2023

Assessing the potential adoption and usefulness of concurrent, action-oriented, electronic adverse drug event triggers designed for the outpatient setting.

June 24, 2015

Development of trigger tools for surveillance of adverse events in ambulatory surgery.

November 10, 2010

Applying trigger tools to detect adverse events associated with outpatient surgery.

March 16, 2011

The MedSafer study-electronic decision support for deprescribing in hospitalized older adults: a cluster randomized clinical trial.

February 2, 2022

Health care-associated invasive MRSA infections, 2005-2008.

August 18, 2010

The impact of errors on healthcare professionals in the critical care setting.

April 24, 2019

Crowding in the Emergency Department: Challenges for the Care of Children.

March 15, 2023

Trauma resuscitation errors and computer-assisted decision support.

March 2, 2011

Association of surgeon-patient sex concordance with postoperative outcomes,

December 22, 2021

Consensus building for development of outpatient adverse drug event triggers.

June 15, 2011

Surgical checklists: a systematic review of impacts and implementation.

September 25, 2013

Association of patient and family reports of hospital safety climate with language proficiency in the US.

June 29, 2022

Real-time automated paging and decision support for critical laboratory abnormalities.

August 17, 2011

Improving handoffs in the perioperative environment: a conceptual framework of key theories, system factors, methods, and core interventions to ensure success.

July 19, 2023

Crowd-sourced hospital ratings are correlated with patient satisfaction but not surgical safety.

June 9, 2021

A framework for engaging physicians in quality and safety.

August 24, 2011

Nurse's Achilles Heel: using big data to determine workload factors that impact near misses.

April 14, 2021

Cough and cold medication adverse events after market withdrawal and labeling revision.

December 4, 2013

Effect of genetic diagnosis on patients with previously undiagnosed disease.

November 7, 2018

Description and yield of current quality and safety review in selected US academic emergency departments.

August 30, 2017

Association between measured teamwork and medical errors: an observational study of prehospital care in the USA

December 11, 2019

Complexity and challenges of the clinical diagnosis and management of Long COVID.

November 30, 2022

A multidisciplinary team approach to retained foreign objects.

March 4, 2009

Hospital ward adaptation during the COVID-19 pandemic: a national survey of academic medical centers.

September 23, 2020

Expressing concern and writing it down: an experimental study investigating transfer of information at nursing handover.

March 11, 2015

Bedside shift-to-shift handoffs: a systematic review of the literature.

August 26, 2015

The attitudes and experiences of trainees regarding disclosing medical errors to patients.

March 19, 2008

The relationship between physician practice characteristics and physician adoption of electronic health records.

January 13, 2010

Patient safety perspectives of providers and nurses: the experience of a rural ambulatory care practice using an EHR with e-prescribing.

November 13, 2013

Impact of the Opioid Safety Initiative on opioid-related prescribing in veterans.

March 22, 2017

Development of an online morbidity, mortality, and near-miss reporting system to identify patterns of adverse events in surgical patients.

April 22, 2009

Confidential clinician-reported surveillance of adverse events among medical inpatients.

March 27, 2005

Patient safety after implementation of a coproduced family centered communication programme: multicenter before and after intervention study.

December 19, 2018

Surgical site signing and "time out": issues of compliance or complacence.

January 13, 2010

Enabling a learning healthcare system with automated computer protocols that produce replicable and personalized clinician actions.

August 4, 2021

Adversarial attacks on medical machine learning.

April 3, 2019

Perspectives about racism and patient-clinician communication among black adults with serious illness.

July 26, 2023

Using social and behavioural science to support COVID-19 pandemic response.

June 3, 2020

National incidence of medication error in surgical patients before and after Accreditation Council for Graduate Medical Education duty-hour reform.

July 8, 2015

Society of Critical Care Medicine Guidelines on Recognizing and Responding to Clinical Deterioration Outside the ICU: 2023.

February 7, 2024

Primary care collaboration to improve diagnosis and screening for colorectal cancer.

May 3, 2017

Association between hospital performance on patient safety and 30-day mortality and unplanned readmission for Medicare fee-for-service patients with acute myocardial infarction.

August 3, 2016

International evaluation of an AI system for breast cancer screening.

January 29, 2020

Incidence and severity of medication reconciliation discrepancies in trauma patients.

August 16, 2023

Predictors of completeness of patients' self-reported personal medication lists and discrepancies with clinic medication lists.

December 11, 2013

25-Year summary of US malpractice claims for diagnostic errors 1986–2010: an analysis from the National Practitioner Data Bank.

May 1, 2013

I-CaRe: a case review tool focused on improving inpatient care.

February 4, 2009

Effect of complementary interventions to redesign care on teamwork and quality for hospitalized medical patients: a pragmatic controlled trial.

November 15, 2023

Potential safety gaps in order entry and automated drug alerts: a nationwide survey of VA physician self-reported practices with computerized order entry.

June 22, 2011

Diagnostic assessment of deep learning algorithms for detection of lymph node metastases in women with breast cancer.

January 10, 2018

Handoffs causing patient harm: a survey of medical and surgical house staff.

October 1, 2008

A computer alert system to prevent injury from adverse drug events: development and evaluation in a community teaching hospital.

September 7, 2005

Understanding patient-centred readmission factors: a multi-site, mixed-methods study.

January 25, 2017

The HOSPITAL score predicts potentially preventable 30-day readmissions in conditions targeted by the Hospital Readmissions Reduction Program.

June 14, 2017

Improving medication reconciliation with comprehensive evaluation at a Veterans Affairs skilled-nursing facility.

July 21, 2021

A trigger tool to detect harm in pediatric inpatient settings.

June 3, 2015

Using a pediatric trigger tool to estimate total harm burden hospital-acquired conditions represent.

July 11, 2018

Effect of a pediatric early warning system on all-cause mortality in hospitalized pediatric patients.

March 7, 2018

Real-time clinical alerting: effect of an automated paging system on response time to critical laboratory values—a randomised controlled trial.

April 14, 2010

Development of medical checklists for improved quality of patient care.

January 9, 2008

Medication reconciliation campaign in a clinic for homeless patients.

April 4, 2012

Related Resources

Exploring the causes of COPD misdiagnosis in primary care: a mixed methods study.

April 10, 2024

Characteristics and contributing factors of diagnostic error in surgery: analysis of closed medico-legal cases and complaints in Canada.

April 3, 2024

The TeamSTEPPS for Improving Diagnosis Team Assessment Tool: scale development and psychometric evaluation.

February 7, 2024

Low rate of completion of recommended tests and referrals in an academic primary care practice with resident trainees.

January 31, 2024

Associations between hospitalist shift busyness, diagnostic confidence, and resource utilization: a pilot study.

October 11, 2023

Can asking emergency physicians whether or not they would have done something differently (WYHDSD) be a useful screening tool to identify emergency department error?

October 11, 2023

The power of written word: reflection reduces errors of omission.

October 4, 2023

From battles to burnout: investigating the role of interphysician conflict in physician burnout.

September 20, 2023

Patient and family contributions to improve the diagnostic process through the OurDX electronic health record tool: a mixed method analysis.

September 13, 2023

WebM&M Cases

Prolonged DKA in Pregnancy: A Case of Communication Breakdown.

August 30, 2023

Experimental evidence for structured information-sharing networks reducing medical errors.

August 9, 2023

Burden of serious harms from diagnostic error in the USA.

July 28, 2023

Evidence for anchoring bias during physician decision-making.

July 12, 2023

Clinician factors associated with delayed diagnosis of appendicitis.

July 5, 2023

Patient Safety Innovations

Preventing Falls Through Patient and Family Engagement to Create Customized Prevention Plans

May 31, 2023

Identification of patient safety threats in a post-intensive care clinic.

May 31, 2023

Danger in discharge summaries: abbreviations create confusion for both author and recipient.

May 31, 2023

Vestibular syndromes, diagnosis and diagnostic errors in patients with dizziness presenting to the emergency department: a cross-sectional study.

May 17, 2023

Annual Perspective

Improving Diagnostic Safety and Quality

April 26, 2023

Patient Safety Innovations

Enhancing Support for Patients’ Social Needs to Reduce Hospital Readmissions and Improve Health Outcomes

March 29, 2023

WebM&M Cases

Sepsis Resulting from Delays in Treatment and Miscommunication among Specialists

March 15, 2023

Risk assessment of the acute stroke diagnostic process using failure modes, effects, and criticality analysis.

March 1, 2023

Diagnostic delays among COVID-19 patients with a second concurrent diagnosis.

February 22, 2023

Complexity and challenges of the clinical diagnosis and management of Long COVID.

November 30, 2022

Electronic diagnostic support in emergency physician triage: qualitative study with thematic analysis of interviews.

November 16, 2022

Cognitive biases encountered by physicians in the emergency room.

November 9, 2022

Misdiagnosis of thoracic aortic emergencies occurs frequently among transfers to aortic referral centers: an analysis of over 3700 patients.

October 12, 2022

Analysis of variation between diagnosis at admission vs discharge and clinical outcomes among adults with possible bacteremia.

July 13, 2022

Factors associated with malpractice claim payout: an analysis of closed emergency department claims.

July 13, 2022

WebM&M Cases

Missing a Large Vessel Occlusion Stroke in a Patient with a History of Seizures.

July 8, 2022

See More About The Topic

Emergency Medicine

Internal Medicine

Clinical Misdiagnosis

Communication between Providers

Crowdsourcing a diagnosis? Exploring the accuracy of the size and type of group diagnosis: an experimental study.

Preventing Falls Through Patient and Family Engagement to Create Customized Prevention Plans

Enhancing Support for Patients’ Social Needs to Reduce Hospital Readmissions and Improve Health Outcomes

Connect With Us

Sign up for Email Updates

Agency for Healthcare Research and Quality

Crowdsourcing a diagnosis? Exploring the accuracy of the size and type of group diagnosis: an experimental study.

Preventing Falls Through Patient and Family Engagement to Create Customized Prevention Plans

Enhancing Support for Patients’ Social Needs to Reduce Hospital Readmissions and Improve Health Outcomes

Connect With Us

Sign up for Email Updates

Agency for Healthcare Research and Quality

Submit Your Innovations

Continue as a Guest

Continue Logged In

Submit Your Innovations

Continue as a Guest

Continue logged in

New Users to the PSNet site