Large language models for preventing medication direction errors in online pharmacies.

Cristobal Pais; Jianfeng Liu; Robert Voigt; Vin Gupta; Elizabeth Wade; Mohsen Bayati

Study

Large language models for preventing medication direction errors in online pharmacies.

June 5, 2024

Pais C, Liu J, Voigt R, et al. Nat Med. 2024;Epub Apr 25.

View more articles from the same authors.

Large language models (LLMs) are artificial intelligence (AI) based tools which are increasingly used in healthcare to improve clinical decision-making and patient safety. This article describes the MEDIC (medication direction copilot) system, which uses LMMs to reduce prescribing errors by improving medication direction-related communication. The researchers tested MEDIC within an existing pharmacy workflow and found that the tool led to a 3% reduction in direction-related near miss events.

PubMed citation

Free full text

Related Resources From the Same Author(s)

It is time to define antimicrobial never events.

February 27, 2019

Crowding in the Emergency Department: Challenges for the Care of Children.

March 15, 2023

ASHP Guidelines on the Safe Use of Automated Compounding Devices for the Preparation of Parenteral Nutrition Admixtures.

June 15, 2022

Optimizing Pediatric Patient Safety in the Emergency Care Setting.

October 19, 2022

The frequency of intravenous medication administration errors related to smart infusion pumps: a multihospital observational study.

March 16, 2016

A multi-hospital before–after observational study using a point-prevalence approach with an infusion safety intervention bundle to reduce intravenous medication administration errors.

June 27, 2018

Use of an interactive, telephone-based self-management support program to identify adverse events among ambulatory diabetes patients.

April 16, 2008

Statewide perinatal quality improvement, teamwork, and communication activities in Oklahoma and Texas.

July 26, 2023

Development of a high-value care culture survey: a modified Delphi process and psychometric evaluation.

November 16, 2016

Components of hospital perioperative infrastructure can overcome the weekend effect in urgent general surgery procedures.

November 4, 2015

Financial incentives and mortality: taking pay for performance a step too far.

March 16, 2016

Association between elements of electronic health record systems and the weekend effect in urgent general surgery.

April 12, 2017

Measuring and comparing safety climate in intensive care units.

March 17, 2010

Video technology to advance safety in the operating room and perioperative environment.

May 2, 2007

Filling a gap in safety metrics: development of a patient-centred framework to identify and categorise patient-reported breakdowns related to the diagnostic process in ambulatory care.

October 27, 2021

Long-term sustainability and adaptation of I-PASS handovers.

September 13, 2023

The effects of physical environments in medical wards on medication communication processes affecting patient safety.

February 26, 2014

Understanding medication safety in healthcare settings: a critical review of conceptual models.

November 23, 2011

Safety culture and mortality after acute myocardial infarction: a study of Medicare beneficiaries at 171 hospitals.

October 25, 2017

Clinical practice guideline: safe medication use in the ICU.

August 30, 2017

What's going well: a qualitative analysis of positive patient and family feedback in the context of the diagnostic process.

March 6, 2024

Crisis resource management: evaluating outcomes of a multidisciplinary team.

August 1, 2007

Association of adverse effects of medical treatment with mortality in the United States: a secondary analysis of the Global Burden of Diseases, Injuries, and Risk Factors study.

January 30, 2019

Recommendations for the safe, effective use of adaptive CDS in the US healthcare system: an AMIA position paper.

April 21, 2021

Improving communication and response to clinical deterioration to increase patient safety in the intensive care unit.

October 19, 2022

Emergency department crowding and risk of preventable medical errors.

May 16, 2012

Action on patient safety can reduce health inequalities.

April 13, 2022

Developing a culture of collaboration in the operating room: more than effective communication.

March 4, 2015

Wrong-site and wrong-patient procedures in the Universal Protocol era: analysis of a prospective database of physician self-reported occurrences.

October 27, 2010

Disclosure and reporting of surgical complications: a double-edged sword?

August 18, 2010

Risk of medication safety incidents with antibiotic use measured by defined daily doses.

December 11, 2013

A review of verbal order policies in acute care hospitals.

January 18, 2012

Patient safety in the cardiac operating room: human factors and teamwork: a scientific statement from the American Heart Association.

August 21, 2013

Sustaining reductions in catheter related bloodstream infections in Michigan intensive care units: observational study.

March 10, 2010

Collaborative cohort study of an intervention to reduce ventilator-associated pneumonia in the intensive care unit.

March 9, 2011

Evaluating independent double checks in the pediatric intensive care unit: a human factors engineering approach.

February 21, 2024

Seroprevalence of SARS-CoV-2 among frontline health care personnel in a multistate hospital network--13 academic medical centers, April-June 2020.

September 23, 2020

Virtual urgent care quality and safety in the time of Coronavirus.

January 20, 2021

Identifying trigger concepts to screen emergency department visits for diagnostic errors.

December 16, 2020

Indication alerts to improve problem list documentation.

January 26, 2022

Racial and ethnic differences in emergency department pain management of children with fractures.

April 22, 2020

Implementation of the I-PASS handoff program in diverse clinical environments: a multicenter prospective effectiveness implementation study.

November 16, 2022

The impact of racism on child and adolescent health.

July 1, 2019

Mandating limits on workload, duty, and speed in radiology.

July 6, 2022

Improving allergy documentation: a retrospective electronic health record system-wide patient safety initiative.

January 1, 2022

Meta-analyses of the effects of standardized handoff protocols on patient, provider, and organizational outcomes.

February 22, 2017

Operating room traffic as a modifiable risk factor for surgical site infection.

January 11, 2017

Improving healthcare systems' disclosures of large-scale adverse events: a Department of Veterans Affairs leadership, policymaker, research and stakeholder partnership.

November 19, 2014

Association of hospital participation in a surgical outcomes monitoring program with inpatient complications and mortality.

February 18, 2015

Safety of overlapping surgery at a high-volume referral center.

January 18, 2017

Wide variation and overprescription of opioids after elective surgery.

October 11, 2017

Impact of initial hospital diagnosis on mortality for acute myocardial infarction: a national cohort study.

September 14, 2016

What are the critical success factors for team training in health care?

August 5, 2009

Time motion study in a pediatric emergency department before and after computer physician order entry.

December 10, 2008

Achieving rapid door-to-balloon times: how top hospitals improve complex clinical systems.

March 8, 2006

Near miss research in the healthcare system: a scoping review.

May 25, 2022

Outcomes of concurrent operations: results from the American College of Surgeons' National Surgical Quality Improvement Program.

October 11, 2017

Autopsy interrogation of emergency medicine dispute cases: how often are clinical diagnoses incorrect?

February 7, 2018

Fighting against COVID-19: innovative strategies for clinical pharmacists.

May 6, 2020

Effectiveness of N95 respirators versus surgical masks against influenza: a systematic review and meta-analysis.

April 29, 2020

Assessment of patient retention of inpatient care information post-hospitalization.

February 22, 2023

How physicians think: a case-based diagnostic simulation exercise.

September 16, 2020

Preventable morbidity and mortality among non-trauma emergency surgery patients: the role of personal performance and system flaws in adverse events.

May 12, 2021

A comprehensive estimation of the costs of 30-day postoperative complications using actual costs from multiple, diverse hospitals.

October 14, 2020

The abrupt expansion of ambulatory telemedicine: implications for patient safety.

February 9, 2022

Standardization of pediatric noncardiac operating room to intensive care unit handoffs improves communication and patient care.

October 5, 2022

Factors associated with malpractice claim payout: an analysis of closed emergency department claims.

July 13, 2022

Associations between hospitalist shift busyness, diagnostic confidence, and resource utilization: a pilot study.

October 11, 2023

Five strategies for how patients and families can improve patient safety: World Patient Safety Day 2023.

October 4, 2023

Checklists to reduce diagnostic error: a systematic review of the literature using a human factors framework.

June 1, 2022

Multispecialty physician online survey reveals that burnout related to adverse event involvement may be mitigated by peer support.

May 18, 2022

Prevalence and causes of diagnostic errors in hospitalized patients under investigation for COVID-19.

April 12, 2023

Reevaluation of diagnosis in adults with physician-diagnosed asthma.

February 1, 2017

Perioperative safety in plastic surgery: is the World Health Organization checklist useful in a broad practice?

April 22, 2015

Practice and quality improvement: successful implementation of TeamSTEPPS tools into an academic interventional ultrasound practice.

March 11, 2015

December 2, 2015

Improving resident morning sign-out by use of daily events reports.

March 4, 2015

Automated and electronically assisted hand hygiene monitoring systems: a systematic review.

June 18, 2014

Decisions and repercussions of second victim experiences for mothers in medicine (SAVE DR MoM).

February 20, 2019

Performing an inadvertent procedure.

January 30, 2019

Electronic health records, communication, and data sharing: challenges and opportunities for improving the diagnostic process.

August 14, 2019

Inpatient notes: just what the doctor ordered—checklists to improve diagnosis.

May 1, 2019

Ranking hospitals based on preventable hospital death rates: a systematic review with implications for both direct measurement and indirect measurement through standardized mortality rates.

April 3, 2019

What happens between visits? Adverse and potential adverse events among a low-income, urban, ambulatory population with diabetes.

May 5, 2010

November 4, 2009

Implementing a pre-operative checklist to increase patient safety: a 1-year follow-up of personnel attitudes.

September 16, 2009

Consumer rankings and health care: toward validation and transparency.

October 12, 2016

Developing a quality and safety curriculum for fellows: lessons learned from a neonatology fellowship program.

October 30, 2013

Building collaborative teams in neonatal intensive care.

April 10, 2013

Errors during the preparation of drug infusions: a randomized controlled trial.

August 22, 2012

Factors associated with emergency department visits and hospital admissions after invasive outpatient procedures in the Veterans Health Administration.

May 30, 2018

Mind the overlap: how system problems contribute to cognitive failure and diagnostic errors.

October 24, 2018

Hiding in plain sight—resurrecting the power of inspecting the patient.

April 26, 2017

Examining the July Effect: a national survey of academic leaders in medicine.

August 10, 2016

Association of the Hospital Readmissions Reduction Program implementation with readmission and mortality outcomes in heart failure.

November 22, 2017

Malpractice claims related to diagnostic errors in the hospital.

August 23, 2017

Opioid prescribing practices from 2010 through 2015 among dentists in the United States: what do claims data tell us?

April 11, 2018

Inter-hospital transfer is an independent risk factor for hospital-associated infection.

March 20, 2024

Developing a tool for assessing competency in root cause analysis.

January 21, 2009

Database construction for improving patient safety by examining pathology errors.

September 28, 2005

Related Resources

Understanding risk factors for complaints against pharmacists: a content analysis.

June 19, 2024

A narrative review of the well-being and burnout of U.S. community pharmacists.

April 3, 2024

Analysis of intervention employability in pharmacy-related medication safety reports at a tertiary medical center.

March 27, 2024

Designing human-centered AI to prevent medication dispensing errors: focus group study with pharmacists.

March 20, 2024

Dispensing error rates in pharmacy: a systematic review and meta-analysis.

March 13, 2024

E-prescribing and medication safety in community settings: a rapid scoping review.

January 24, 2024

A multi-method exploratory evaluation of a service designed to improve medication safety for patients with monitored dosage systems following hospital discharge.

October 25, 2023

A survey of pharmacists' perception of the work environment and patient safety in community pharmacies during the COVID-19 pandemic.

October 18, 2023

Pharmacy e-prescription dispensing before and after CancelRx implementation.

September 20, 2023

California pharmacies are making millions of mistakes. They’re fighting to keep that secret.

September 20, 2023

The state of health, burnout, healthy behaviors, workplace wellness support, and concerns of medication errors in pharmacists during the COVID-19 pandemic.

August 23, 2023

Status of patient safety culture in community pharmacy settings: a systematic review.

August 23, 2023

Risk Evaluation and Mitigation Strategy (REMS) Programs and Medication Safety: Parts I and II.

August 9, 2023

Using sociotechnical theory to understand medication safety work in primary care and prescribers' use of clinical decision support: a qualitative study.

May 24, 2023

Perceived discrimination in the community pharmacy: a cross-sectional, national survey of adults.

May 10, 2023

ISMP Targeted Medication Safety Best Practices for Community Pharmacy.

April 19, 2023

Creating a stronger culture of safety within US community pharmacies.

April 12, 2023

Perspectives on Safety

Annual Perspective

Technology as a Tool for Improving Patient Safety

March 29, 2023

WebM&M Cases

Duplicate Therapies in Retail Pharmacy

March 15, 2023

Medication errors in community pharmacies: evaluation of a standardized safety program.

March 15, 2023

Pharmacists reducing medication risk in medical outpatient clinics: a retrospective study of 18 clinics.

March 8, 2023

Defining and enhancing collaboration between community pharmacists and primary care providers to improve medication safety.

February 22, 2023

Concerns regarding tablet splitting: a systematic review.

December 7, 2022

Journal Article

Study

Patient Safety Innovations

Predicting dispensing errors in community pharmacies: an application of the Systematic Human Error Reduction and Prediction Approach (SHERPA).

November 16, 2022

Understanding factors that could influence patient acceptability of the use of the PINCER intervention in primary care: a qualitative exploration using the Theoretical Framework of Acceptability.

November 9, 2022

Walgreens will stop judging its pharmacy staffers by how fast they work.

November 9, 2022

Medication adverse events in the ambulatory setting: a mixed-methods analysis.

October 26, 2022

The impact of electronic communication of medication discontinuation (CancelRx) on medication safety: a pilot study.

October 5, 2022

Changes to primary care delivery during the COVID-19 pandemic and perceived impact on medication safety: a survey study.

June 29, 2022

The effect of a transitional pharmaceutical care program on the occurrence of ADEs after discharge from hospital in patients with polypharmacy.

April 27, 2022

See More About The Topic

Technologic Approaches

Large language models for preventing medication direction errors in online pharmacies.

Predicting dispensing errors in community pharmacies: an application of the Systematic Human Error Reduction and Prediction Approach (SHERPA).

Connect With Us

Sign up for Email Updates

Agency for Healthcare Research and Quality

Large language models for preventing medication direction errors in online pharmacies.

Predicting dispensing errors in community pharmacies: an application of the Systematic Human Error Reduction and Prediction Approach (SHERPA).

Connect With Us

Sign up for Email Updates

Agency for Healthcare Research and Quality

Submit Your Innovations

Continue as a Guest

Continue Logged In

Submit Your Innovations

Continue as a Guest

Continue logged in

New Users to the PSNet site