Examining the validity of AHRQ's Patient Safety Indicators (PSIs): is variation in PSI composite score related to hospital organizational factors?

Marlena H. Shin; Jennifer L. Sullivan; Amy K. Rosen; Jeffrey L. Solomon; Edward J. Dunn; Stephanie L. Shimada; Jennifer Hayes; Peter E. Rivard

Study

Examining the validity of AHRQ's Patient Safety Indicators (PSIs): is variation in PSI composite score related to hospital organizational factors?

November 26, 2014

Shin MH, Sullivan JL, Rosen AK, et al. Med Care Res Rev. 2014;71(6):599-618.

View more articles from the same authors.

The AHRQ Patient Safety Indicators (PSIs) are increasingly used as publicly reported measures of hospital quality performance. This study investigated Veterans Health Administration hospitals with low and high PSI composite scores. Although high performers exhibited some distinctions in leadership and communication, overall the relationship between PSI score and organizational processes was inconsistent.

PubMed citation

Available at

Related Resources From the Same Author(s)

Applying the high reliability health care maturity model to assess hospital performance: a VA case study.

August 31, 2016

Partnering with VA stakeholders to develop a comprehensive patient safety data display: lessons learned from the field.

February 11, 2015

Development of trigger tools for surveillance of adverse events in ambulatory surgery.

November 10, 2010

Consensus building for development of outpatient adverse drug event triggers.

June 15, 2011

How hospitals select their patient safety priorities: an exploratory study of four Veterans Health Administration hospitals.

September 25, 2019

Improving patient care through leadership engagement with frontline staff: a Department of Veterans Affairs case study.

July 31, 2013

Using AHRQ Patient Safety Indicators to detect postdischarge adverse events in the Veterans Health Administration.

September 18, 2013

Assessing the potential adoption and usefulness of concurrent, action-oriented, electronic adverse drug event triggers designed for the outpatient setting.

June 24, 2015

Evaluating the implementation of Project Re-Engineered Discharge (RED) in five Veterans Health Administration (VHA) hospitals.

October 17, 2018

Testing the association between Patient Safety Indicators and hospital structural characteristics in VA and nonfederal hospitals.

November 18, 2009

Quality improvement for patient safety: project-level versus program-level learning.

February 22, 2012

Using estimated true safety event rates versus flagged safety event rates: does it change hospital profiling and payment?

May 21, 2014

Identifying risks and opportunities in outpatient surgical patient safety: a qualitative analysis of Veterans Health Administration staff perceptions.

January 31, 2018

Examining the impact of the AHRQ Patient Safety Indicators (PSIs) on the Veterans Health Administration: the case of readmissions.

October 17, 2012

Validity of selected patient safety indicators: opportunities and concerns.

October 27, 2010

Detecting adverse events in surgery: comparing events detected by the Veterans Health Administration Surgical Quality Improvement Program and the Patient Safety Indicators.

June 4, 2014

Using patient safety indicators to estimate the impact of potential adverse events on outcomes.

January 30, 2008

Evaluating the Patient Safety Indicators: how well do they perform on Veterans Health Administration data?

September 7, 2005

Tracking rates of patient safety indicators over time: lessons from the Veterans Administration.

September 6, 2006

Validating the Patient Safety Indicators in the Veterans Health Administration: do they accurately identify true safety events?

November 2, 2011

Validity of selected AHRQ Patient Safety Indicators based on VA National Surgical Quality Improvement program data.

October 15, 2008

Applying trigger tools to detect adverse events associated with outpatient surgery.

March 16, 2011

Standardizing patient safety event reporting between care delivered or purchased by the Veterans Health Administration (VHA).

April 10, 2024

Medical team training: applying crew resource management in the Veterans Health Administration.

May 30, 2007

Residency training at a crossroads: duty-hour standards 2010.

November 3, 2010

Resistance to patient safety initiatives.

December 14, 2005

Automated identification of postoperative complications within an electronic medical record using natural language processing.

August 31, 2011

Patient misidentification in laboratory medicine: a qualitative analysis of 227 root cause analysis reports in the Veterans Health Administration.

February 17, 2010

Failure-to-rescue: comparing definitions to measure quality of care.

October 10, 2007

Improving patient safety and uniformity of care by a standardized regimen for the use of oxytocin.

April 9, 2008

Use of cellular telephones in the hospital environment.

March 28, 2007

A toolkit to disseminate best practices in inpatient medication reconciliation: Multi-Center Medication Reconciliation Quality Improvement Study (MARQUIS).

July 31, 2013

Physicians-in-training attitudes on patient safety: 2003 to 2008.

September 7, 2011

Association of a web-based handoff tool with rates of medical errors.

August 17, 2016

Front-line staff perspectives on opportunities for improving the safety and efficiency of hospital work systems.

June 18, 2008

Impact of resident workload and handoff training on patient outcomes.

April 4, 2012

The impact of resident duty hour reform on hospital readmission rates among Medicare beneficiaries.

April 27, 2011

Development of an online morbidity, mortality, and near-miss reporting system to identify patterns of adverse events in surgical patients.

April 22, 2009

Designing an abstraction instrument: lessons from efforts to validate the AHRQ Patient Safety Indicators.

January 12, 2011

A systematic review of patient safety measures in adult primary care.

May 18, 2016

Factors influencing providers' willingness to deprescribe medications.

December 1, 2021

Development and testing of tools to detect ambulatory surgical adverse events.

June 5, 2013

Patient safety in geriatrics: a call for action.

December 15, 2010

Using the patient safety indicators to detect potential safety events among US veterans with psychotic disorders: clinical and research implications.

August 1, 2012

Hospital-based medication reconciliation practices: a systematic review.

July 11, 2012

Impact of regionalized care on concordance of plan and preventable adverse events on general medicine services.

March 16, 2016

Nature of blame in patient safety incident reports: mixed methods analysis of a national database.

September 27, 2017

Prolonged hospital stay and the resident duty hour rules of 2003.

January 13, 2010

Teaching hospital financial status and patient outcomes following ACGME duty hour reform.

September 26, 2012

Effects of resident duty hour reform on surgical and procedural patient safety indicators among hospitalized Veterans Health Administration and Medicare patients.

July 1, 2009

Using harm-based weights for the AHRQ Patient Safety for Selected Indicators composite (PSI-90): does it affect assessment of hospital performance and financial penalties in Veterans Health Administration hospitals?

February 1, 2017

Cultural transformation after implementation of crew resource management: is it really possible?

July 27, 2016

Pharmacist workload and pharmacy characteristics associated with the dispensing of potentially clinically important drug-drug interactions.

May 9, 2007

Mortality among patients in VA hospitals in the first 2 years following ACGME resident duty hour reform.

September 12, 2007

Comparing safety climate in naval aviation and hospitals: implications for improving patient safety.

April 21, 2010

Implementing strategies to identify and mitigate adverse safety events: a case study with unplanned extubations.

February 27, 2019

Prevalence of adverse events in pediatric intensive care units in the United States.

October 13, 2010

Safe practices for copy and paste in the EHR. Systematic review, recommendations, and novel model for health IT collaboration.

February 8, 2017

Patient and physician experience with interhospital transfer: a qualitative study.

May 29, 2019

Did duty hour reform lead to better outcomes among the highest risk patients?

November 4, 2009

New persistent opioid use after minor and major surgical procedures in US adults.

April 26, 2017

Design and evaluation of simulation scenarios for a program introducing patient safety, teamwork, safety leadership, and simulation to healthcare leaders and managers.

August 31, 2011

Hospital safety climate and safety outcomes: is there a relationship in the VA?

March 10, 2010

Effects of a multifaceted medication reconciliation quality improvement intervention on patient safety: final results of the MARQUIS study.

September 12, 2018

Medical record review of deaths, unexpected intensive care unit admissions and clinician referrals: detection of adverse events and insight into the system.

November 9, 2005

Improving detection of intraoperative medical errors (iMEs) and intraoperative adverse events (iAEs) and their contribution to postoperative outcomes.

March 6, 2019

Teaching hospital five-year mortality trends in the wake of duty hour reforms.

August 7, 2013

Toward a new paradigm in hospital-based pediatric education: the development of an onsite simulator program.

November 23, 2005

Workforce perceptions of hospital safety culture: development and validation of the patient safety climate in healthcare organizations survey.

September 26, 2007

Medication errors in pediatrics—the octopus evading defeat.

March 6, 2005

An initiative to improve the management of clinically significant test results in a large health care network.

October 30, 2013

The Rural VA Multi-Center Medication Reconciliation Quality Improvement Study (R-VA-MARQUIS).

February 12, 2020

I-PASS Mentored Implementation Handoff Curriculum: implementation guide and resources.

March 10, 2019

Nurse workarounds in the electronic health record: an integrative review.

August 12, 2020

Cognitive bias in clinical medicine.

November 7, 2018

Relationship of hospital organizational culture to patient safety climate in the Veterans Health Administration.

March 25, 2009

One hospital's initiatives to encourage safe opioid use.

July 15, 2015

Implementation of patient safety rounds in a children's hospital.

January 14, 2009

Potentially inappropriate prescribing in elderly veterans: are we using the wrong drug, wrong dose, or wrong duration?

August 24, 2005

A safety evaluation of the impact of maternity-orientated human factors training on safety culture in a tertiary maternity unit.

June 19, 2019

Incorrect surgical procedures within and outside of the operating room.

November 25, 2009

Clinical pharmacists and inpatient medical care: a systematic review.

May 17, 2006

The effect of emergency department boarding on order completion.

January 13, 2016

Clinical decision support in the era of artificial intelligence.

November 21, 2018

Identifying organizational cultures that promote patient safety.

November 18, 2009

Recruitment of hospitals for a safety climate study: facilitators and barriers.

April 30, 2008

I-PASS mentored implementation handoff curriculum: champion training materials.

March 13, 2019

How residents think and make medical decisions: implications for education and patient safety.

August 15, 2007

A case for safety leadership team training of hospital managers.

March 2, 2011

Factors associated with hospital admission after outpatient surgery in the Veterans Health Administration.

February 28, 2018

Acceptance of recommendations by inpatient pharmacy case managers: unintended consequences of hospitalist and specialist care.

March 27, 2013

Hospital quality and patient safety competencies: development, description, and recommendations for use.

January 30, 2005

Incidence of multiple sclerosis misdiagnosis in referrals to two academic centers.

May 1, 2019

Patient safety in the office-based setting.

April 19, 2006

Nurses as antimicrobial stewards: recognition, confidence, and organizational factors across nine hospitals.

February 12, 2020

Classifying and predicting errors of inpatient medication reconciliation.

July 9, 2008

An overview of patient safety climate in the VA.

April 9, 2008

How does patient safety culture in the operating room and post-anesthesia care unit compare to the rest of the hospital?

April 1, 2009

Medication complexity, medication number, and their relationships to medication discrepancies.

July 27, 2016

Understanding diagnostic errors in medicine: a lesson from aviation.

June 21, 2006

Related Resources

Patient Safety Primers

Patient Safety Indicators.

April 26, 2023

Association of measured quality with financial health among U.S. hospitals.

May 4, 2022

Hospital Performance Report.

October 28, 2021

Hospital Compare.

May 13, 2021

Unintended consequences of health care reform: impact of changes in payor mix on patient safety indicators,

October 7, 2020

HANYS' Report on Report Cards.

November 20, 2019

Handoffs, safety culture, and practices: evidence from the hospital survey on patient safety culture.

August 24, 2016

Unit-based incident reporting and root cause analysis: variation at three hospital unit types.

August 17, 2016

Hospital at night: an organizational design that provides safer care at night.

August 10, 2016

Investigating adverse event free admissions in Medicare inpatients as a patient safety indicator.

June 22, 2016

A systematic review of patient safety measures in adult primary care.

May 18, 2016

Validity of the Agency for Healthcare Research and Quality Patient Safety Indicators and the Centers for Medicare and Medicaid Hospital-acquired Conditions: a systematic review and meta-analysis.

May 18, 2016

Sustaining reliability on accountability measures at the Johns Hopkins Hospital.

January 27, 2016

Hospital characteristics associated with penalties in the Centers for Medicare & Medicaid Services Hospital-Acquired Condition Reduction Program.

August 5, 2015

Development and measurement of perioperative patient safety indicators.

March 18, 2015

Disentangling quality and safety indicator data: a longitudinal, comparative study of hand hygiene compliance and accreditation outcomes in 96 Australian hospitals.

October 8, 2014

Challenges and remediation for Patient Safety Indicators in the transition to ICD-10-CM.

September 17, 2014

Unexpectedly long hospital stays as an indicator of risk of unsafe care: an exploratory study.

June 25, 2014

Characterisations of adverse events detected in a university hospital: a 4-year study using the Global Trigger Tool method.

June 18, 2014

Detecting adverse events in surgery: comparing events detected by the Veterans Health Administration Surgical Quality Improvement Program and the Patient Safety Indicators.

June 4, 2014

Using estimated true safety event rates versus flagged safety event rates: does it change hospital profiling and payment?

May 21, 2014

Patient safety: let's measure what matters.

May 21, 2014

Implementing the Safety Thermometer tool in one NHS trust.

April 16, 2014

Evidence-based organization and patient safety strategies in European hospitals.

March 19, 2014

Hospital patient safety grades may misrepresent hospital performance.

February 12, 2014

Assessing the state of safe medication practices using the ISMP Medication Safety Self Assessment for Hospitals: 2000 and 2011.

February 5, 2014

National trends in patient safety for four common conditions, 2005–2011.

January 29, 2014

The Orthopaedic Error Index: development and application of a novel national indicator for assessing the relative safety of hospital care using a cross-sectional approach.

December 18, 2013

Demonstrating high reliability on accountability measures at The Johns Hopkins Hospital.

December 4, 2013

Improving America's Hospitals: The Joint Commission's Annual Report on Quality and Safety 2013.

November 13, 2013

See More About The Topic

Hospitals

Health Care Executives and Administrators

Safety Scientists

Hospital Medicine

Epidemiology of Errors and Adverse Events

Examining the validity of AHRQ's Patient Safety Indicators (PSIs): is variation in PSI composite score related to hospital organizational factors?

Patient Safety Indicators.

Connect With Us

Sign up for Email Updates

Agency for Healthcare Research and Quality

Examining the validity of AHRQ's Patient Safety Indicators (PSIs): is variation in PSI composite score related to hospital organizational factors?

Patient Safety Indicators.

Connect With Us

Sign up for Email Updates

Agency for Healthcare Research and Quality

Submit Your Innovations

Continue as a Guest

Continue Logged In

Submit Your Innovations

Continue as a Guest

Continue logged in

New Users to the PSNet site