Advancing Patient Safety Through State Reporting Systems
Seven years ago, the Institute of Medicine (IOM) called on states to create mandatory reporting systems as part of a strategy to identify and learn about medical errors and ultimately to improve patient safety.(1) Since then, many states have responded by creating or improving reporting systems to collect information about hospital-based adverse events. These systems can provide states with an opportunity to strengthen their facility oversight functions, safeguard the public, and partner with providers to improve health care quality.
As of April 2007, more than half of states (27) had passed legislation or created regulations related to hospital reporting of adverse events (26 are mandatory systems, one is voluntary).(2)
The goals of state reporting systems may be twofold. First, many of these requirements are intended to hold health care facilities accountable for weaknesses in their systems. Secondly, they may strive to improve patient safety through analysis and dissemination of best practices and lessons learned, which could prevent recurrences.
In this article, I will review the evolution of state error reporting systems, current trends, common criticisms, and state responses.
State Reporting Systems Continue to Improve
Despite their potential, there has been significant discussion and controversy about the purpose and usefulness of these systems. Reasons vary, from the perception that they are punitive, to fear of malpractice litigation associated with reporting, to lack of confidence in the usefulness or availability of the data gathered.
To be sure, states face challenges in patient safety data collection, analysis, and feedback. Reporting systems that were created prior to 2000 were designed for different purposes (including responses to medical malpractice insurance crises of the 1970s and 1980s and as regulatory tools to increase oversight of hospitals) and therefore may have lacked advanced data-gathering and analytic capability. However, since 2000, the number of states with authorized systems has almost doubled, and many of the original systems have been updated and refined. As state experience with reporting systems grows, the systems continue to evolve and mature.
State systems do not punish facilities for events but do seek to hold them accountable for correcting system weaknesses. They do so by investigating events, providing expertise or information to help remedy problems, and insuring that appropriate changes are made and sustained to avoid similar problems in the future.
Patient safety improvement requires both internal and external pressure to drive change. As To Err Is Human observed, external reporting systems can help create an environment that encourages organizations to identify errors, evaluate causes, and take appropriate actions to improve performance.(1) As Leape and Berwick have noted, systemic nationwide patient safety improvements require, among other things, pressure on the health care industry from public outrage, reformed reimbursement policies, and regulation.(3)
Although institutions may already report errors internally and analyze them for lessons and opportunities for system change, external reporting requirements can increase the priority of patient safety within institutions. The majority of state reporting systems now require facilities to conduct root cause analyses (RCAs) and submit information about root causes and corrective action plans with their reports. This process is critical to state efforts to reduce recurring problems and can also help facilities make internal process improvements.
In discussing the need to foster innovation and improve the delivery of care, the IOM called for public accountability by emphasizing transparency as one of ten principles that should guide the redesign of the health care system.(4) States have recognized the tension inherent in promoting transparency with regard to medical errors: although transparency can drive improvements, care must be taken to avoid penalizing institutions for honestly seeking opportunities for improvement. In response, states are beginning to encourage more transparency while providing strong protections for certain data (patient and provider identifiers). The majority of states now report aggregate data of some kind, and legislation authorizing several of the more recent systems requires the availability of facility-specific data. Minnesota has set the stage, having produced annual reports with facility-specific data for the past 3 years.(5) To date, concerns that such facility-specific reporting would lead to massive recriminations or unfair press coverage have generally not been realized. And, despite fears of litigation, there is no evidence to suggest that data available through state patient safety reporting systems have been used to generate malpractice claims. In fact, these systems often have stronger confidentiality protections than other state data (statements of deficiencies, complaints, report cards, etc.).(6)
In addition to analyzing individual event reports, most states also aggregate data over time and/or across facilities to assess the patient safety performance of a facility, region, or state. Although small numbers can hinder some analyses, states have discovered that extracting useful data from reporting systems is not dependent on the existence of epidemiological risk-adjusted data. Simple, routine analysis using aggregated event report data identifies information that is not apparent from a review of individual incidents. Anecdotal information sharingin the form of trends, stories, and lessons learnedcan be useful in providing facilities with opportunities for improvement.(7)
New York, for example, invites hospitals to participate in expert subcommittees with local health department staff to review de-identified findings from RCAs and extract lessons that may have broader applicability for release in a hospital alert. Analysis of wrong-patient/wrong-site surgical errors led to development of the New York preoperative protocols final report in January 2001. Hospitals were expected to develop and implement procedures based on the report. Following the analysis and subsequent protocols, the number of such events decreased from 25 in 2002 to 17 in 2003.(8)
Although it is unrealistic to expect states to achieve full reporting, they can achieve a critical mass for analysis. During 2006, Pennsylvania collected the greatest number of adverse event and near miss reports (almost 196,000), which enabled opportunities for analysis in many areas.
Feedback for Improvement
Patient safety alerts and advisories provide an opportunity for state reporting systems to share timely, specific, actionable information. Pennsylvania, for example, distributes its quarterly Patient Safety Advisories electronically to an estimated 10,000 recipients around the country. Pennsylvania facility patient safety officers, in responding to a survey, reported implementing more than 500 changes in their facilities as a result of Patient Safety Advisories, including using color-coded patient wristbands to communicate clinical information, forming a skin integrity task force, restricting the use of propofol to the anesthesia department, and reducing the use of verbal orders.(9)
A growing number of states are developing Web-based systems that enable providers to access their own data and create comparative reports with their own data over time, to a peer group, and statewide. This improvement enables users to access timely information and enhances learning from the data. Utah, for example, developed a Web site that enables users to query hospital discharge data for occurrences of AHRQ Patient Safety Indicators (PSI), ICD-9 codes, and Utah's adverse drug event (ADE) indicators.(10) Users can investigate PSIs and ADEs in relation to length of stay and total charges; compare indicator trends for a hospital with hospitals in its peer group, a hospital corporate system, and aggregate state data; and stratify results by sociodemographic factors, payer, and service.
Information from reporting systems, combined with other quality data, may also be useful to purchasers and consumers. Health plans and payers may find information about adverse events useful to target their quality improvement projects and to assess overall quality of care. Tufts Health Plan in Massachusetts, for example, uses publicly available state data to monitor opportunities for improvement within its network. When appropriate, the plan follows up with a contracted facility to determine if corrective action plans submitted to the state have been implemented. Examples of follow-up may include requesting policies and procedures, reviewing training content and attendance records, and scheduling site visits.
In recent years, the national call for transparency and public reporting has increased and states have gained more experience partnering with providers and outside experts to create systems that can have a meaningful impact on patient safety. As a result, the political opposition and lack of technical expertise that initially kept many states from moving forward in developing effective systems have been abating.
However, challenges remain. Lack of standardized reporting continues, although there is a growing trend of new systems adopting, unaltered or with modifications, the National Quality Forum's list of serious reportable events for adverse event reporting systems (Table 1 and Table 2).
Funding remains a persistent challenge. Although the IOM recommended that Congress provide funding and technical expertise to all state governments to establish or adapt error reporting, funding has not been made available. States have used various mechanisms to support reporting systems, including general revenue funds and facility assessments. Although some program costs can be absorbed into existing state budgets, analysis and dissemination of useful information are likely to represent substantial new costs. Pennsylvania, an exception in terms of funding level, budgeted $2.5 million, or about $17 per report, for aggregating, analyzing, and disseminating information from 150,000 reports in 2005.(7)
Patient safety issues are also complex, particularly for consumers. Disseminating information in a useful and meaningful way continues to be a challenge: What is an error, event, incident? What is a system weakness? Can the information be used to compare facilities? Are facilities with fewer numbers safer? What are effective corrective actions? Should these reports be used as stand-alone documents or are they better used in conjunction with other quality information?
There is general agreement that nationwide progress in improving patient safety is slow. Patient safety reporting represents just one tool to promote patient safety. Since we have yet to develop a nationwide system or identify one ideal system, states continue to serve a valuable role as laboratories of innovation to examine how best to monitor facilities for safety, assist with quality improvement processes, and keep stakeholders informed about progress in improving patient safety.
Jill Rosenthal, MPHNational Academy for State Health Policy
1. Kohn L, Corrigan J, Donaldson M, eds. To Err Is Human: Building a Safer Health System. Washington, DC: National Academy Press; 2000.
4. Committee on Quality of Health Care in America, Institute of Medicine. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: National Academy Press; 2001:4.
6. Marchev M, Rosenthal J, Booth M. How States Report Medical Errors to the Public: Issues and Barriers. Portland, ME: National Academy for State Health Policy; 2003:21.
7. Rosenthal J, Booth M. Maximizing the Use of State Adverse Event Data to Improve Patient Safety. Portland, ME: National Academy for State Health Policy; 2005.
8. Flink E, Chevalier CL, Ruperto A, et al. Lessons learned from the evolution of mandatory adverse event reporting systems. In: Advances in Patient Safety: From Research to Implementation. Vol 3. Rockville, MD: Agency for Healthcare Research and Quality; April 2005. AHRQ Publication No. 05-0021-CD.
9. Patient Safety Authority: 2006 Annual Report. Harrisburg, PA: Commonwealth of Pennsylvania Patient Safety Authority; April 2007. Available at: http://patientsafety.pa.gov/PatientSafetyAuthority/Documents/annual_report_2006.pdf
11. Serious Reportable Events in Healthcare2006 Update. Washington, DC: National Quality Forum; 2007.
12. National Quality Forum Updates Endorsement of Serious Reportable Events in Healthcare. Washington, DC: The National Quality Forum; October 16, 2006. Available at: http://www.qualityforum.org/pdf/news/prSeriousReportableEvents10-15-06.pdf. Accessed May 22, 2007.
|NQF's Serious Reportable Events Unaltered or with Modifications, Exclusions, or Additions
|Other State-Generated List
|CA, CT, IL, IN, MN, NJ, OR, VT,* WA, WY
|CO, FL, GA, KS, MA, MD, ME, NV, NY, PA, OH, RI, SC, SD, TN, TX, UT
*VT update added by author.
|Product or Device Events
|Patient Protection Events
|Care Management Events