Adversarial attacks on medical machine learning.

Samuel G. Finlayson; John D. Bowers; Joichi Ito; Jonathan L. Zittrain; Andrew L. Beam; Isaac S. Kohane

Study

Adversarial attacks on medical machine learning.

April 3, 2019

Finlayson SG, Bowers JD, Ito J, et al. Science (1979). 2019;363(6433):1287-1289.

View more articles from the same authors.

This review article delineates how artificial intelligence approaches to medical diagnosis are vulnerable to adversarial attacks. The authors suggest that regulatory review of devices that employ machine learning include an assessment of resilience against such attacks.

PubMed citation

Available at

Related news article

Related Resources From the Same Author(s)

Framing the challenges of artificial intelligence in medicine.

November 7, 2018

Machine learning in medicine.

April 10, 2019

Postsurgical prescriptions for opioid naive patients and association with overdose and misuse: retrospective cohort study.

January 31, 2018

Parents as partners in obtaining the medication history.

June 29, 2005

Intervening in interruptions: what exactly is the risk we are trying to manage?

October 11, 2017

Society for Maternal-Fetal Medicine Special Statement: telemedicine in obstetrics-quality and safety considerations.

February 1, 2023

Utilization of a role-based head covering system to decrease misidentification in the operating room.

August 7, 2019

The causes of errors in clinical reasoning: cognitive biases, knowledge deficits, and dual process thinking.

November 16, 2016

Adverse incidents, patient flow and nursing workforce variables on acute psychiatric wards: the Tompkins Acute Ward Study.

February 28, 2007

An embedded checklist in the Anesthesia Information Management System improves pre-anaesthetic induction setup: a randomised controlled trial in a simulation setting.

October 5, 2016

Characteristics associated with postdischarge medication errors.

August 6, 2014

Exposure to incivility hinders clinical performance in a simulated operative crisis.

June 26, 2019

Effect of number of open charts on intercepted wrong-patient medication orders in an emergency department.

May 30, 2018

To do no harm - and the most good - with AI in health care.

March 13, 2024

Association of measured quality with financial health among U.S. hospitals.

May 4, 2022

Look back and talk openly: responding to and communicating about the risk of large-scale error in pathology diagnoses.

February 15, 2012

Surgeon information transfer and communication: factors affecting quality and efficiency of inpatient care.

February 7, 2007

The tension between needing to improve care and knowing how to do it.

August 15, 2007

Multimorbidity and patient safety incidents in primary care: a systematic review and meta-analysis.

October 14, 2015

An empirical model to estimate the potential impact of medication safety alerts on patient safety, health care utilization, and cost in ambulatory care.

September 23, 2009

Communication techniques for patients with low health literacy: a survey of physicians, nurses, and pharmacists.

October 24, 2007

Interception of potential adverse drug events in long-term psychiatric care units.

August 10, 2005

Does learning from mistakes have to be painful? Analysis of 5 years' experience from the Leeds radiology educational cases meetings identifies common repetitive reporting errors and suggests acknowledging and celebrating excellence (ACE) as a more positive way of teaching the same lessons.

August 28, 2019

Pediatric antidepressant medication errors in a national error reporting database.

February 17, 2010

Is bias in the eye of the beholder? A vignette study to assess recognition of cognitive biases in clinical case workups.

February 17, 2016

Communication failures in the operating room: an observational classification of recurrent types and effects.

March 6, 2005

The relationship between patients' perception of care and measures of hospital quality and safety.

June 23, 2010

Realistic distractions and interruptions that impair simulated surgical performance by novice surgeons.

July 25, 2012

The Second Victim Experience and Support Tool: validation of an organizational resource for assessing second victim effects and the quality of support resources.

October 22, 2014

Innovative approach to reconstruct bedside handoff: using simple rules of complexity science to promote partnership with patients.

May 30, 2018

Medical errors in neurosurgery.

December 3, 2014

Medication errors in the ambulatory treatment of pediatric attention deficit hyperactivity disorder.

September 3, 2008

Patient safety attitudes of paediatric trainee physicians.

January 6, 2010

A preliminary taxonomy of medical errors in family practice.

March 6, 2005

Simulation based teamwork training for emergency department staff: does it improve clinical team performance when added to an existing didactic teamwork curriculum?

April 5, 2006

Persistence of unsafe practice in everyday work: an exploration of organizational and psychological factors constraining safety in the operating room.

June 14, 2006

Medicare's policy not to pay for treating hospital-acquired conditions: the impact.

September 30, 2009

A concept analysis of psychological safety: further understanding for application to health care.

February 23, 2022

Should electronic differential diagnosis support be used early or late in the diagnostic process? A multicentre experimental study of Isabel.

October 27, 2021

Among the elderly, many mental illnesses go undiagnosed.

May 20, 2015

Organizational learning in hospitals: a realist review.

August 21, 2019

Patient safety problems in adolescent medical care.

January 18, 2006

Knowledge retention after simulated crisis: importance of independent practice and simulated mortality.

June 5, 2019

Readiness of US general surgery residents for independent practice.

October 4, 2017

Profiles in patient safety: a "perfect storm" in the emergency department.

June 20, 2007

Pediatric vaccination errors: application of the "5 rights" framework to a national error reporting database.

July 29, 2009

Medicine for the wandering mind: mind wandering in medical practice.

December 21, 2011

Automated medication error studies with audit supplementation were effectively designed and analyzed by time series.

August 23, 2006

Crowdsourcing a diagnosis? Exploring the accuracy of the size and type of group diagnosis: an experimental study.

April 10, 2024

Prevalence of preventable medication-related hospitalizations in Australia: an opportunity to reduce harm.

May 2, 2012

Improving end of life care: an information systems approach to reducing medical errors.

June 15, 2005

National study on the frequency, types, causes, and consequences of voluntarily reported emergency department medication errors.

June 29, 2011

Patient safety measures in burn care: do national reporting systems accurately reflect quality of burn care?

February 3, 2010

High rates of adverse drug events in a highly computerized hospital.

May 25, 2005

Patient identification error among prostate needle core biopsy specimens—are we ready for a DNA time-out?

November 7, 2007

Are Patient Safety Indicators related to widely used measures of hospital quality?

July 9, 2008

Preventable errors in organ transplantation: an emerging patient safety issue?

July 11, 2012

A new professionalism? Surgical residents, duty hours restrictions, and shift transitions.

November 17, 2010

Incidence of adverse drug events and potential adverse drug events: implications for prevention.

March 27, 2005

Healthcare in a land called PeoplePower: nothing about me without me.

March 6, 2005

Transforming healthcare: a safety imperative.

December 9, 2009

Patient-centered prescription opioid tapering in community outpatients with chronic pain.

March 7, 2018

Motivational influences on anaesthetists' use of practice guidelines.

May 13, 2009

Applying modern error theory to the problem of missed injuries in trauma.

April 2, 2008

Incidence and preventability of adverse drug events in hospitalized patients.

March 6, 2005

Increasing the use of 'smart' pump drug libraries by nurses: a continuous quality improvement project.

February 29, 2012

Board of pharmacy practices related to medication errors and their potential impact on patient safety.

August 1, 2018

A review of best practices for intravenous push medication administration.

December 20, 2017

Practice-based learning and improvement: a two-year experience with the reporting of morbidity and mortality cases by general surgery residents.

June 27, 2012

Nurse–pharmacist collaboration on medication reconciliation prevents potential harm.

August 22, 2012

Influence of language barriers on outcomes of hospital care for general medicine inpatients.

July 7, 2010

Burden of difficult encounters in primary care: data from the Minimizing Error, Maximizing Outcomes Study.

March 4, 2009

Trends in healthcare incident reporting and relationship to safety and quality data in acute hospitals: results from the National Reporting and Learning System.

February 25, 2009

Testing process errors and their harms and consequences reported from family medicine practices: a study of the American Academy of Family Physicians National Research Network.

June 11, 2008

Interruptions and medication administration in critical care.

July 29, 2015

Effectiveness of a graduate medical education program for improving medical event reporting attitude and behavior.

October 12, 2005

What is the return on investment for implementation of a crew resource management program at an academic medical center?

October 14, 2015

Lessons learned from implementation of a computerized application for pending tests at hospital discharge.

December 22, 2010

Effect of genetic diagnosis on patients with previously undiagnosed disease.

November 7, 2018

Diagnostic reasoning in cardiovascular medicine.

January 19, 2022

Getting teams to talk: development and pilot implementation of a checklist to promote interprofessional communication in the OR.

October 19, 2005

Evaluation of an automated surveillance system using trigger alerts to prevent adverse drug events in the intensive care unit and general ward.

April 1, 2015

Doctors debate safety of their white coats.

December 2, 2015

Applying Lean methods to improve quality and safety in surgical sterile instrument processing.

March 13, 2013

Improving hospital systems for the care of women with major obstetric hemorrhage.

May 17, 2006

Using Six Sigma to reduce medication errors in a home-delivery pharmacy service.

June 1, 2005

Antibiotic prescribing in ambulatory pediatrics in the United States.

January 11, 2012

Effects of rapid response systems on clinical outcomes: systematic review and meta-analysis.

January 2, 2008

Interhospital transfer patients discharged by academic hospitalists and general internists: characteristics and outcomes.

January 6, 2016

"July Effect": impact of the academic year-end changeover on patient outcomes. A systematic review.

July 27, 2011

Contributing factors identified by hospital incident report narratives.

October 22, 2008

Computerized surveillance of adverse drug events in hospital patients.

March 27, 2005

A comparison of voluntarily reported medication errors in intensive care and general care units.

March 24, 2010

Patient-reported safety incidents in older patients with long-term conditions: a large cross-sectional study.

June 14, 2017

I-CaRe: a case review tool focused on improving inpatient care.

February 4, 2009

Trends in primary care clinician perceptions of a new electronic health record.

February 11, 2009

Doing well by doing good: assessing the cost savings of an intervention to reduce central line-associated bloodstream infections in a Hawaii hospital.

June 12, 2013

Improving transfusion safety: implementation of a comprehensive computerized bar code-based tracking system for detecting and preventing errors.

April 9, 2008

Leveraging a redesigned morbidity and mortality conference that incorporates the clinical and educational missions of improving quality and patient safety.

April 20, 2016

Rural inpatient telepharmacy consultation demonstration for after-hours medication review.

October 3, 2012

Related Resources

Perspective

Cybersecurity and How to Maintain Patient Safety

March 27, 2024

Interview

In Conversation with...Barbara Pelletreau and John Riggi about Cybersecurity

March 27, 2024

Perspective

Artificial Intelligence and Patient Safety: Promise and Challenges

March 27, 2024

Interview

In Conversation with...Patrick Tighe about Artificial Intelligence

March 27, 2024

Patient Safety Innovations

Ambulatory Safety Nets to Reduce Missed and Delayed Diagnoses of Cancer

July 31, 2023

A "Do No Harm" novel safety checklist and research approach to determine whether to launch an artificial intelligence-based medical technology: introducing the Biological-Psychological, Economic, and Social (BPES) Framework.

July 5, 2023

Patient Safety Innovations

Remote Response Team and Customized Alert Settings Help Improve Management of Sepsis

May 31, 2023

Use of recalled devices in new device authorizations under the US Food and Drug Administration's 510(k) pathway and risk of subsequent recalls.

January 25, 2023

The impact of an electronic alert to reduce the risk of co-prescription of low molecular weight heparins and direct oral anticoagulants.

July 6, 2022

Workarounds in electronic health record systems and the revised Sociotechnical Electronic Health Record Workaround Analysis Framework: scoping review.

April 13, 2022

Preventing delayed and missed care by applying artificial intelligence to trigger radiology imaging follow-up.

March 30, 2022

The impact of health information management professionals on patient safety: a systematic review.

December 22, 2021

Identifying health information technology usability issues contributing to medication errors across medication process stages.

July 7, 2021

Recommendations for the safe, effective use of adaptive CDS in the US healthcare system: an AMIA position paper.

April 21, 2021

Health information technology-related wrong-patient errors: context is critical.

January 27, 2021

Variation in electronic test results management and its implications for patient safety: a multisite investigation.

August 19, 2020

Cascades of care after incidental findings in a US national survey of physicians.

November 6, 2019

Surgical data recording technology: a solution to address medical errors?

September 18, 2019

Error Reduction and Prevention in Surgical Pathology, Second Edition.

August 28, 2019

How to prevent or reduce prescribing errors: an evidence brief for policy authors.

August 7, 2019

Assessing the safety of electronic health records: a national longitudinal study of medication-related decision support.

August 7, 2019

Accuracy of computer-aided diagnosis of melanoma: a meta-analysis.

July 10, 2019

WebM&M Cases

Delayed Clozapine Prescription in an Elderly Man With Dementia

July 2, 2019

Comparison of the accuracy of human readers versus machine-learning algorithms for pigmented skin lesion classification: an open, web-based, international, diagnostic study.

June 26, 2019

Responding to health information technology reported safety events: insights from patient safety event reports.

June 12, 2019

Structured override reasons for drug–drug interaction alerts in electronic health records.

May 15, 2019

Effects of chemotherapy prescription clinical decision-support systems on the chemotherapy process: a systematic review.

April 24, 2019

Essential activities for electronic health record safety: a qualitative study.

March 20, 2019

Measuring the rate of manual transcription error in outpatient point-of-care testing.

March 13, 2019

Approaches and Challenges to Electronically Matching Patients' Records Across Providers.

March 6, 2019

See More About The Topic

Risk Managers

Information Professionals

Policy Makers

Diagnostic Errors

Latent Errors

Adversarial attacks on medical machine learning.

Ambulatory Safety Nets to Reduce Missed and Delayed Diagnoses of Cancer

Remote Response Team and Customized Alert Settings Help Improve Management of Sepsis

Connect With Us

Sign up for Email Updates

Agency for Healthcare Research and Quality

Adversarial attacks on medical machine learning.

Ambulatory Safety Nets to Reduce Missed and Delayed Diagnoses of Cancer

Remote Response Team and Customized Alert Settings Help Improve Management of Sepsis

Connect With Us

Sign up for Email Updates

Agency for Healthcare Research and Quality

Submit Your Innovations

Continue as a Guest

Continue Logged In

Submit Your Innovations

Continue as a Guest

Continue logged in

New Users to the PSNet site