The National Outcomes Evaluation Programme in Italy: The Impact of Publication of Health Indicators

Impact of the Italian Healthcare Outcomes Program (PNE) on the Care Quality of the Poorest Performing Hospitals

One of the main aims of the Italian National Healthcare Outcomes Program (Programma Nazionale Esiti, PNE) is the identification of the hospitals with the lowest performance, leading them to improve their quality. In order to evaluate PNE impact for a subset of outcome indicators, we evaluated whether the performance of the hospitals with the lowest scores in 2016 had significantly improved after five years. The eight indicators measured the risk-adjusted likelihood of the death of each patient (adjusted relative risk-RR) 30 days after the admission for acute myocardial infarction, congestive heart failure, stroke, chronic obstructive pulmonary disease, chronic kidney disease, femur fracture or lung and colon cancer. In 2016, the PNE identified 288 hospitals with a very low performance in at least one of the selected indicators. Overall, 51.0% (n = 147) of these hospitals showed some degree of improvement in 2021, and 27.4% of them improved so much that the death risk of their patients fell below the national mean value. In 34.7% of the hospitals, however, the patients still carried a mean risk of death >30% higher than the average Italian patient with the same disease. Only 38.5% of the hospitals in Southern Italy improved the scores of the selected indicators, versus 68.0% in Northern and Central Italy. Multivariate analyses, adjusting for the baseline performance in 2016, confirmed univariate results and showed a significantly lower likelihood of improvement with increasing hospital volume. Despite the overall methodological validity of the PNE system, current Italian policies and actions aimed at translating hospital quality scores into effective organizational changes need to be reinforced with a special focus on larger southern regions.

Development of a Set of Indicators for Measuring and Improving Quality of Rehabilitation Care after Ischemic Stroke

Stroke is the leading global cause of permanent disability and the second leading cause of dementia within the first year of the event. Systematic quality improvement interventions such as Audit & Feedback (A&F) can monitor and improve the performance of post-stroke care in conjunction with the use of quality indicators (QIs). The scientific literature shows limited studies on quality improvement and QIs design for poststroke rehabilitation. In Italy, the National Outcomes Evaluation Programme (PNE) annually provides several QIs concerning the acute wards. On the contrary, indicators for quality assessment of post-acute stroke rehabilitation are not available nationwide. In recent years, the Italian Ministry of Health has funded a national network project, the aim of which is to provide and evaluate the effectiveness of A&F strategies in healthcare improvement. Part of this project is the development of a set of IQs for ischemic stroke rehabilitation used to conduct an A&F. In this study, we describe the design and development process of these QIs from administrative databases and report the results of the pilot test conducted on a small sample of Sicilian rehabilitation facilities, comparing them from 2019 to 2021. Feedback from the participating centers was mainly positive, and the quality indicators were found to be comprehensible and appreciated. However, the study highlighted the need for better adherence to indicators measuring processes of rehabilitation care. The set of quality indicators presented in this study, relevant to inpatient settings, could be considered a starting point on which to base quality improvement initiatives both nationally and internationally.

EASY-NET Program: Methods and Preliminary Results of an Audit and Feedback Intervention in the Emergency Care for Acute Myocardial Infarction in the Lazio Region, Italy

Within the EASY-NET network program (NET-2016-02364191), Work Package 1 Lazio evaluates the effectiveness of a structured audit and feedback (A&F) intervention compared with the web-based regional periodic publication of indicators in improving the appropriateness and timeliness of emergency healthcare for acute myocardial infarction (AMI). This work describes the A&F methodology and presents the results of the first feedback delivered. The intervention involves sending periodic reports via e-mail to participating hospitals. The feedback reports include a set of volume and quality (process and outcome) indicators, calculated by facility through the health information system of the Lazio Region and compared with regional mean, target values and values calculated for hospitals with similar volumes of activity. Health managers and clinicians of each participating hospital represent the "feedback recipients". They are invited to organize clinical and organizational audit meetings to identify possible critical issues in the care pathway and define, where necessary, improvement actions. A total of 16 facilities are involved. Twelve facilities present high volumes in all volume indicators, while three facilities present low volumes for each indicator. Concerning the quality indicators, four facilities do not present critical indicators or had average results, three facilities do not present critical indicators but show average results in at least one of the indicators and six facilities present a critical value for at least one of the indicators. The first report highlighted some critical issues in some facilities on several indicators. During the audit meetings, each facility analyzes these issues, defining appropriate improvement actions. The outcome of these actions will be monitored through subsequent reporting to support the continuous care quality improvement process.