Remote assessment of real-world surgical safety checklist performance using the OR Black Box: a multi-institutional evaluation.

Max S Riley; James Etheridge; Vanessa Palter; Herbert Zeh; Teodor Grantcharov; Zoey Kaelberer; Yves Sonnay; Douglas S Smink; Mary E Brindle; George Molina

Study

Remote assessment of real-world surgical safety checklist performance using the OR Black Box: a multi-institutional evaluation.

March 20, 2024

Riley MS, Etheridge J, Palter V, et al. J Am Coll Surg. 2024;238(2):206-215.

View more articles from the same authors.

Operating room (OR) ‘black boxes’ collect audio-video recordings of operative procedures and are increasingly used to assess and improve clinical and team performance. This retrospective study examined 7,243 surgical procedures from seven academic medical centers using an OR black box between August 2020 and January 2022. Researchers found that key elements of the time-out and debrief processes were not routinely discussed, such as relevant imaging, anesthesia concerns, or item counts.

PubMed citation

Available at

Related Resources From the Same Author(s)

We asked the experts: the WHO Surgical Safety Checklist and the COVID-19 pandemic: recommendations for content and implementation adaptations.

March 17, 2021

Redeployment of health care workers in the COVID-19 pandemic: a qualitative study of health system leaders' strategies.

May 19, 2021

Non-technical skills in surgery during the COVID-19 pandemic: an observational study.

March 9, 2022

Transforming team performance through reimplementation of the surgical safety checklist.

December 6, 2023

CheckPOINT: a simple tool to measure Surgical Safety Checklist implementation fidelity.

October 18, 2023

Perspectives on perioperative team-based morbidity and mortality conferences: a mixed-methods study.

November 29, 2023

Readiness of US general surgery residents for independent practice.

October 4, 2017

System factors affecting patient safety in the OR: an analysis of safety threats and resiliency.

August 25, 2021

CT for suspected appendicitis in children: an analysis of diagnostic errors.

March 1, 2006

Association of hospital markup with preventable adverse events following pancreatic surgery in the United States.

February 7, 2024

Automated capture of intraoperative adverse events using artificial intelligence: a systematic review and meta-analysis.

March 15, 2023

Pilot testing of a model for insurer-driven, large-scale multicenter simulation training for operating room teams.

December 11, 2013

Analyzing and discussing human factors affecting surgical patient safety using innovative technology: creating a safer operating culture.

August 31, 2022

Adverse events in the operating room: definitions, prevalence, and characteristics. A systematic review.

October 16, 2019

Measuring the teamwork performance of teams in crisis situations: a systematic review of assessment tools and their measurement properties.

October 31, 2018

First-year analysis of the Operating Room Black Box study.

July 25, 2018

Using data to enhance performance and improve quality and safety in surgery.

August 30, 2017

Families as partners in hospital error and adverse event surveillance.

March 8, 2017

Crisis checklists for the operating room: development and pilot testing.

January 30, 2005

Simulation-based trial of surgical-crisis checklists.

January 30, 2013

Characterising 'near miss' events in complex laparoscopic surgery through video analysis.

May 27, 2015

Effect of the surgical safety checklist on provider and patient outcomes: a systematic review.

April 27, 2022

Physician and nurse well-being and preferred interventions to address burnout in hospital practice: factors associated with turnover, outcomes, and patient safety.

July 19, 2023

Operative team communication during simulated emergencies: too busy to respond?

December 21, 2016

The eNOTSS platform for surgeons’ nontechnical skills performance improvement.

March 4, 2020

Enabling a learning healthcare system with automated computer protocols that produce replicable and personalized clinician actions.

August 4, 2021

Evidence-based guidelines for fatigue risk management in emergency medical services.

March 14, 2018

Healthcare professionals' perception of safety culture and the Operating Room (OR) Black Box technology before clinical implementation: a cross-sectional survey.

March 22, 2023

Cognitive biases in surgery: systematic review.

March 1, 2023

System factors affecting intraoperative risk and resilience: applying a novel integrated approach to study surgical performance and patient safety.

February 10, 2021

Surgeons' leadership style and team behavior in the hybrid operating room: prospective cohort study.

October 4, 2023

Explainable artificial intelligence for safe intraoperative decision support.

September 25, 2019

Defining technical errors in laparoscopic surgery: a systematic review.

October 9, 2013

Canadian Association of University Surgeons' Annual Symposium. Surgical simulation: the solution to safe training or a promise unfulfilled?

September 5, 2012

Prescription opioid dose reductions and potential adverse events: a multi-site observational cohort study in diverse US health systems.

November 29, 2023

Using social and behavioural science to support COVID-19 pandemic response.

June 3, 2020

Surgical teams' attitudes about surgical safety and the surgical safety checklist at 10 years: a multinational survey.

November 17, 2021

Impact of the WHO Surgical Safety Checklist relative to its design and intended use: a systematic review and meta-meta-analysis.

November 24, 2021

International perspectives on modifications to the surgical safety checklist.

June 21, 2023

Implementation of a mandatory checklist of protocols and objectives improves compliance with a wide range of evidence-based intensive care unit practices.

July 29, 2009

What has been the impact of Covid-19 on safety culture? A case study from a large metropolitan healthcare trust.

September 2, 2020

Determinants of burnout and other aspects of psychological well-being in healthcare workers during the Covid-19 pandemic: a multinational cross-sectional study.

May 5, 2021

A multistep approach to improving biopsy site identification in dermatology: physician, staff, and patient roles based on a Delphi consensus.

March 26, 2014

National Partnership for Maternal Safety: Consensus Bundle on Venous Thromboembolism.

December 7, 2016

Operational failures detected by frontline acute care nurses.

March 29, 2017

Optimizing Pediatric Patient Safety in the Emergency Care Setting.

October 19, 2022

Predictors of successful implementation of preoperative briefings and postoperative debriefings after medical team training.

November 18, 2009

Integrated approach to reduce perinatal adverse events: standardized processes, interdisciplinary teamwork training, and performance feedback.

February 8, 2017

Decreasing malpractice claims by reducing preventable perinatal harm.

September 14, 2016

Mortality trends after a voluntary checklist-based surgical safety collaborative.

May 3, 2017

Implementation of the surgical safety checklist in South Carolina hospitals is associated with improvement in perceived perioperative safety.

May 11, 2016

Narrative feedback from OR personnel about the safety of their surgical practice before and after a surgical safety checklist intervention.

July 12, 2017

Relationship between operating room teamwork, contextual factors, and safety checklist performance.

August 31, 2016

Perception of safety of surgical practice among operating room personnel from survey data is associated with all-cause 30-day postoperative death rate in South Carolina.

August 16, 2017

Full work analysis of resident work hours.

June 11, 2008

Effect of changes in hospital nursing resources on improvements in patient safety and quality of care: a panel study.

November 28, 2018

Effects of nurse staffing and nurse education on patient deaths in hospitals with different nurse work environments.

January 25, 2012

Patient safety, satisfaction, and quality of hospital care: cross sectional surveys of nurses and patients in 12 countries in Europe and the United States.

April 4, 2012

New York-Presbyterian Hospital: translating innovation into practice.

October 12, 2005

Perioperative team-based morbidity and mortality conferences: a systematic review of the literature.

October 11, 2023

Effect of a pediatric early warning system on all-cause mortality in hospitalized pediatric patients.

March 7, 2018

Modes of failure in venous thromboembolism prophylaxis.

September 28, 2022

Changes in medication safety indicators in England throughout the covid-19 pandemic using OpenSAFELY: population based, retrospective cohort study of 57 million patients using federated analytics.

June 7, 2023

A new professionalism? Surgical residents, duty hours restrictions, and shift transitions.

November 17, 2010

Eliminating central line-associated bloodstream infections: a national patient safety imperative.

January 15, 2014

Patient safety in the office-based setting.

April 19, 2006

Incidence and nature of adverse events during pediatric sedation/anesthesia for procedures outside the operating room: report from the Pediatric Sedation Research Consortium.

October 18, 2006

Characteristics of medical professional liability claims in patients with cardiovascular diseases.

April 21, 2010

Diagnostic errors in interpretation of pediatric musculoskeletal radiographs at common injury sites.

June 25, 2014

Adaptation and implementation of the WHO Safe Childbirth Checklist around the world.

November 3, 2021

Developing surgical and anesthesia resident patient safety competencies through systems-based event analysis. Guide to curricular development and evaluation of longer-term resident perceptions.

October 18, 2023

Effective followership: a standardized algorithm to resolve clinical conflicts and improve teamwork.

August 12, 2015

Errors upstream and downstream to the Universal Protocol associated with wrong surgery events in the Veterans Health Administration.

April 29, 2015

CDC central-line bloodstream infection prevention efforts produced net benefits of at least $640 million during 1990–2008.

June 18, 2014

Association between implementation of a medical team training program and surgical mortality.

October 20, 2010

Medical team training and coaching in the veterans health administration; assessment and impact on the first 32 facilities in the programme.

August 18, 2010

Using simulation to improve root cause analysis of adverse surgical outcomes.

March 12, 2014

Association between implementation of a medical team training program and surgical morbidity.

January 4, 2012

Sharing lessons learned to prevent incorrect surgery.

November 21, 2012

Association of a surgical task during training with team skill acquisition among surgical residents: the missing piece in multidisciplinary team training.

June 7, 2017

The Pursuing Excellence Collaborative: engaging first-year residents and fellows in patient safety event investigations.

August 30, 2023

A systematic review of the performance characteristics of clinical event monitor signals used to detect adverse drug events in the hospital setting.

May 23, 2007

Noise levels in Johns Hopkins Hospital.

December 21, 2005

Laboratory medicine handoff gaps experienced by primary care practices: a report from the Shared Networks of Collaborative Ambulatory Practices and Partners (SNOCAP).

December 3, 2014

Oral outpatient chemotherapy medication errors in children with acute lymphoblastic leukemia.

August 23, 2006

Improving safety in the operating room: medication icon labels increase visibility and discrimination.

November 2, 2022

Impact of online education on intern behaviour around Joint Commission national patient safety goals: a randomised trial.

June 27, 2012

Patients' and doctors' views and experiences of the patient safety trajectory of breast cancer care.

March 27, 2024

Centers for Disease Control and Prevention Guideline for the Prevention of Surgical Site Infection, 2017.

May 10, 2017

A new patient safety smartphone application for prevention of "forgotten" ureteral stents: results from a clinical pilot study in 194 patients.

July 26, 2017

Prevalence of potentially harmful multidrug interactions on medication lists of elderly ambulatory patients.

December 22, 2021

Handling anticipated exceptions in clinical care: investigating clinician use of 'exit strategies' in an electronic health records system.

November 9, 2011

The effects of crew resource management on teamwork and safety climate at Veterans Health Administration facilities.

December 6, 2017

Implementation of the I-PASS handoff program in diverse clinical environments: a multicenter prospective effectiveness implementation study.

November 16, 2022

Second victim experiences of nurses in obstetrics and gynaecology: a Second Victim Experience and Support Tool Survey

December 23, 2020

Understanding the second victim experience among multidisciplinary providers in obstetrics and gynecology.

May 19, 2021

Evaluation of a second victim peer support program on perceptions of second victim experiences and supportive resources in pediatric clinical specialties using the second victim experience and support tool (SVEST).

November 3, 2021

Patient safety after implementation of a coproduced family centered communication programme: multicenter before and after intervention study.

December 19, 2018

Improving end-of-rotation transitions of care among ICU patients

December 4, 2019

Associations between national board exam performance and residency program emphasis on patient safety and interprofessional teamwork.

September 11, 2019

Related Resources

Safety and Human Performance in the Operating Room and Other Extreme Environments.

March 27, 2024

Creating a just culture in the perioperative setting.

March 13, 2024

The ritualisation of the surgical safety checklist and its decoupling from patient safety goals.

March 13, 2024

WebM&M Cases

Airway Obstruction during Anterior Cervical Spine Surgery

February 28, 2024

Handbook of Perioperative and Procedural Patient Safety.

February 7, 2024

Taking up the challenge to improve name and role recognition in the operating room.

February 7, 2024

Psychological safety and hierarchy in operating room debriefing: reflexive thematic analysis.

January 31, 2024

WebM&M Cases

Syringe Swap During Regional Block: A Case of Medication Error and Recovery.

January 31, 2024

Surgical safety does not happen by accident: learning from perioperative near miss case studies.

January 24, 2024

Patient Safety Primers

Retained Surgical Items: Definition and Epidemiology.

January 4, 2024

Perceptions of use of names, recognition of roles, and teamwork after labeling surgical caps.

December 6, 2023

Facilitators and barriers to the implementation of surgical safety checklist (SSC): an integrative review.

November 15, 2023

Technology, Education and Safety

November 15, 2023

Beyond the surgical safety checklist: using intraoperative handoff to facilitate team situation awareness in the OR.

October 25, 2023

CheckPOINT: a simple tool to measure Surgical Safety Checklist implementation fidelity.

October 18, 2023

Perioperative team-based morbidity and mortality conferences: a systematic review of the literature.

October 11, 2023

Standardization and visualization of the surgical time-out.

October 4, 2023

Surgeons' leadership style and team behavior in the hybrid operating room: prospective cohort study.

October 4, 2023

Fire safety in the operating room.

October 1, 2023

Barriers and facilitators associated with the implementation of surgical safety checklists: a qualitative systematic review.

September 27, 2023

Anesthesia Risk Alert program: a proactive safety initiative.

August 30, 2023

Anaesthesia and patient safety in the socio-technical operating theatre: a narrative review spanning a century.

August 23, 2023

Implementation of barcode medication administration (BMCA) technology on infusion pumps in the operating rooms.

August 9, 2023

The things we carry: the scope and impact of second victim syndrome.

August 2, 2023

From aviation to pediatric surgery.

July 26, 2023

The role of an assistant nurse in implementing the WHO Surgical Safety Checklist: perception and perspectives.

July 5, 2023

Perioperative handoff enhancement opportunities through technology and artificial intelligence: a narrative review.

June 14, 2023

Green Cross method in a postanaesthesia care unit: a qualitative study of the healthcare professionals' experiences after 3 years, including the COVID-19 pandemic period.

June 14, 2023

Use of technology to improve the adherence to surgical safety checklists in the operating room.

May 31, 2023

Proactive patient safety: focusing on what goes right in the perioperative environment.

May 24, 2023

See More About The Topic

Operating Room

Anesthesiology

Surgery

Medical/Surgical Nursing

Anesthesia Nursing

Remote assessment of real-world surgical safety checklist performance using the OR Black Box: a multi-institutional evaluation.

Retained Surgical Items: Definition and Epidemiology.

Connect With Us

Sign up for Email Updates

Agency for Healthcare Research and Quality

Remote assessment of real-world surgical safety checklist performance using the OR Black Box: a multi-institutional evaluation.

Retained Surgical Items: Definition and Epidemiology.

Connect With Us

Sign up for Email Updates

Agency for Healthcare Research and Quality

Submit Your Innovations

Continue as a Guest

Continue Logged In

Submit Your Innovations

Continue as a Guest

Continue logged in

New Users to the PSNet site