Publishing outcome data: is it an effective approach?

Information usefulness of public disclosure in Taiwan: Does it vary across specific diseases/conditions and contexts?

OBJECTIVES

This study discusses issues regarding tailored information for report cards, including what kinds of information patients with different diseases need and how the necessary information changes for these patients given alterations to a specific context. This study aimed to determine whether there is consistent, essential quality information across different diseases and in diverse contexts. The priority of needs related to interpersonal and technical quality information for different diseases is also discussed.

METHODS

Fifty-five patients from 5 hospitals in Taiwan were interviewed or invited to participate in a focus group. Patients were diagnosed with five different diseases or conditions: stroke, dialysis, AMI, diabetes, and knee problems. We conducted in-depth interviews to identify the most requested types of information for every disease or condition in general and in different contexts (e.g., relocation). We applied the Kano model to verify the relative priority of the information that emerged from the interviews for each disease.

RESULTS

The 3 most requested types of information among patients with various diseases or conditions in the general context were medical professionalism, physician communication skills, and accessibility. Only a few types of information were valued by patients with specific diseases. In addition, patients focused on specific and mutually relevant information in certain contexts (e.g., in the context of conflict with physicians, patients considered communication skills most important). This information was similar to the 3 most common types of information in the general context regardless of the disease, with the exception of stroke. Finally, technical quality information was treated as basic or necessary information. However, most important information was treated as expected information regardless of the disease.

CONCLUSIONS

There is somewhat consistent essential quality information across different diseases and diverse contexts. According to the results of the Kano model, the report card should disclose interpersonal and technical quality simultaneously.

A Value-Based Steering Model for Healthcare

This article aims to answer how a commissioning body can steer health services based on value in an environment where the commissioner is responsible for the health services of a population with varying health service needs. In this design science study, we constructed a value-based steering model consisting of three parts: (1) the principles of steering; (2) the steering process; and (3) Value Steering Canvas, a concrete tool for steering. The study is based on Finland, a tax-funded healthcare system, where healthcare is a public service. The results can be applied in any system where there is a commissioner and a service provider, whether they are two separate organizations or not. We conclude that steering can be done based on value. The commissioning body can start using value-based steering without changes in legislation or in the present service system. Further research is needed to test the model in practice.

Results of the standard set for pulmonary sarcoidosis: feasibility and multicentre outcomes

Our study presents findings on a previously developed standard set of clinical outcome data for pulmonary sarcoidosis patients. We aimed to assess whether changes in outcome varied between the different centres and to evaluate the feasibility of collecting the standard set retrospectively.

This retrospective observational comparative benchmark study included six interstitial lung disease expert centres based in the Netherlands, Belgium, the UK and the USA. The standard set of outcome measures included 1) mortality, 2) changes in pulmonary function (forced vital capacity (FVC), forced expiratory volume in 1 s, diffusing capacity of the lung for carbon monoxide), 3) soluble interleukin-2 receptor (sIL-2R) change, 4) weight changes, 5) quality-of-life (QoL) measures, 6) osteoporosis and 7) clinical outcome status (COS). Data collection was considered feasible if the data were collected in ≥80% of all patients.

509 patients were included in the retrospective cohort. In total six patients died, with a mean survival of 38±23.4 months after the diagnosis. Centres varied in mean baseline FVC, ranging from 110 (95% CI 92–124)% predicted to 99 (95% CI 97–123)% pred. Mean baseline body mass index (BMI) of patients in the different centres varied between 27 (95% CI 23.6–29.4) kg·m⁻² and 31.8 (95% CI 28.1–35.6) kg·m⁻². 310 (60.9%) patients were still on systemic therapy 2 years after the diagnosis. It was feasible to measure mortality, changes in pulmonary function, weight changes and COS. It is not (yet) feasible to retrospectively collect sIL-2R, osteoporosis and QoL data internationally.

This study shows that data collection for the standard set of outcome measures for pulmonary sarcoidosis was feasible for four out of seven outcome measures. Trends in pulmonary function and BMI were similar for different hospitals when comparing different practices.

Clinical outcome data have been used to compare outcomes in pulmonary sarcoidosis patients and improve care delivery. Data collection for the standard set of outcome measures for pulmonary sarcoidosis was feasible for four out of seven outcome measures.http://bit.ly/2F8bQ6s

First patient-centred set of outcomes for pulmonary sarcoidosis: a multicentre initiative

Introduction

Routine and international comparison of clinical outcomes enabling identification of best practices for patients with pulmonary sarcoidosis is lacking. The aim of this study was to develop a standard set of outcome measures for pulmonary sarcoidosis, using the value-based healthcare principles.

Methods

Six expert clinics for interstitial lung diseases in four countries participated in a consensus-driven RAND-modified Delphi study. A mixed-method approach was applied for the identification of an outcome measures set and initial conditions for patients with pulmonary sarcoidosis. The expert team consisted of multidisciplinary professionals (n=14) from Cleveland Clinic, Cincinnati MC, Erasmus MC, Leuven UZ, Royal Brompton and St. Antonius Hospital. During a ranking process, participants were instructed to rank variables on a scale from 1 to 10 based on whether it has (1) impact of the outcome on quality of life, (2) impact of quality of care on the outcome and (3) the number of patients negatively affected by the outcome.

Results

An outcome measures set was defined consisting of seven outcome measures: mortality, pulmonary function, soluble interleukin-2 receptor change as an activity biomarker, weight gain, quality of life, osteoporosis and clinical outcome status.

Discussion

Collecting outcomes in pulmonary sarcoidosis internationally and the use of a broadly accepted set can enable international comparison. Differences in outcomes can potentially be used as a starting point for quality improvement initiatives.

Mapping standard ophthalmic outcome sets to metrics currently reported in eight eye hospitals

BACKGROUND

To determine alignment of proposed international standard outcomes sets for ophthalmic conditions to metrics currently reported by eye hospitals.

METHODS

Mixed methods comparative benchmark study, including eight eye hospitals in Australia, India, Singapore, Sweden, U.K., and U.S. All are major international tertiary care and training centers in ophthalmology. Main outcome measure is consistency of ophthalmic outcomes measures reported.

RESULTS

International agreed standard outcomes (ICHOM) sets are available for cataract surgery (10 metrics) and macular degeneration (7 metrics). The eight hospitals reported 22 different metrics for cataract surgery and 2 for macular degeneration, which showed only limited overlap with the proposed ICHOM metrics. None of the hospitals reported patient reported visual functioning or vision-related quality of life outcomes measures (PROMs). Three hospitals (38%) reported rates for uncomplicated cataract surgeries only. There was marked variation in how and at what point postoperatively visual outcomes following cataract, cornea, glaucoma, strabismus and oculoplastics procedures were reported. Seven (87.5%) measured post-operative infections and four (50%) measured 30 day unplanned reoperation rates.

CONCLUSIONS

Outcomes reporting for ophthalmic conditions currently widely varies across hospitals internationally and does not include patient-reported outcomes. Reaching consensus on measures and consistency in data collection will allow meaningful comparisons and provide an evidence base enabling improved sharing of "best practices" to improve eye care globally. Implementation of international standards is still a major challenge and practice-based knowledge on measures should be one of the inputs of the international standardization process.

Risk adjustment in measurements of predicted mortality after myocardial infarction

BACKGROUND

In 2014, the government introduced elements of quality-based funding (pay-for-performance) for the hospital sector. Survival is included as a quality indicator. If such quality indicators are to be used for funding purposes, it must be established that the observed variations are caused by conditions that the hospital trusts are able to influence, and not by any underlying variables. The objective of this study was to investigate how the predicted mortality after myocardial infarction was influenced by various forms of risk adjustment.

MATERIAL AND METHOD

Data from the Norwegian Patient Register on 10,717 patients who had been discharged with the diagnosis of myocardial infarction in 2009 were linked to data on socioeconomic status, comorbidity, travel distances and mortality. The predicted 30-day mortality after myocardial infarction was analysed at the hospital-trust level, using three different models for risk adjustment.

RESULTS

Unadjusted 30-day mortality was highest in the catchment area of Førde Hospital Trust (12.5%) and lowest in Asker og Bærum (5.2%). Risk adjustment changed the estimates of mortality for many of the hospital trusts. In the model involving the most comprehensive risk adjustment, mortality was highest in the catchment area of Akershus University Hospital (10.9%) and lowest in the catchment areas of Sunnmøre Hospital Trust (5.2%) and Nordmøre og Romsdal Hospital Trust (5.2%).

INTERPRETATION

The variation in treatment quality between the hospital trusts, as measured by predicted mortality after myocardial infarction, is influenced by the methods used for risk adjustment. If the quality-based funding scheme is to continue, well-documented models for risk adjustment of the quality indicators need to be established.

"Managed competition" for Ireland? The single versus multiple payer debate

BACKGROUND

A persistent feature of international health policy debate is whether a single-payer or multiple-payer system can offer superior performance. In Ireland, a major reform proposal is the introduction of 'managed competition' based on the recent reforms in the Netherlands, which would replace many functions of Ireland's public payer with a system of competing health insurers from 2016. This article debates whether Ireland meets the preconditions for effective managed competition, and whether the government should implement the reform according to its stated timeline. We support our arguments by discussing the functioning of the Dutch and Irish systems.

DISCUSSION

Although Ireland currently lacks key preconditions for effective implementation, the Dutch experience demonstrates that some of these can be implemented over time, such as a more rigorous risk equalization system. A fundamental problem may be Ireland's sparse hospital distribution. This may increase the market power of hospitals and weaken insurers' ability to exclude inefficient or poor quality hospitals from contracts, leading to unwarranted spending growth. To mitigate this, the government proposes to introduce a system of price caps for hospital services.The Dutch system of competition is still in transition and it is premature to judge its success. The new system may have catalyzed increased transparency regarding clinical performance, but outcome measurement remains crude. A multi-payer environment creates some disincentives for quality improvement, one of which is free-riding by insurers on their rivals' quality investments. If a Dutch insurer invests in improving hospital quality, hospitals will probably offer equivalent quality to consumers enrolled with other insurance companies. This enhances equity, but may weaken incentives for improvement. Consequently the Irish government, rather than insurers, may need to assume responsibility for investing in clinical quality. Plans are in place to assure consumers of free choice of insurer, but a key concern is a potential shortfall of institutional capacity to regulate managed competition.

SUMMARY

Managed competition requires a long transition period and the requisite preconditions are not yet in place. The Irish government should refrain from introducing managed competition until sufficient preconditions are in place to allow effective performance.

Dissemination of performance information and continuous improvement: A narrative systematic review

PURPOSE

Developing a performance measure and reporting the results to support decision making at an individual level has yielded poor results in many health systems. The purpose of this paper is to highlight the factors associated with the dissemination of performance information that generate and support continuous improvement in health organizations.

DESIGN/METHODOLOGY/APPROACH

A systematic data collection strategy that includes empirical and theoretical research published from 1980 to 2010, both qualitative and quantitative, was performed on Web of Science, Current Contents, EMBASE and MEDLINE. A narrative synthesis method was used to iteratively detail explicative processes that underlie the intervention. A classification and synthesis framework was developed, drawing on knowledge transfer and exchange (KTE) literature. The sample consisted of 114 articles, including seven systematic or exhaustive reviews.

FINDINGS

Results showed that dissemination in itself is not enough to produce improvement initiatives. Successful dissemination depends on various factors, which influence the way collective actors react to performance information such as the clarity of objectives, the relationships between stakeholders, the system's governance and the available incentives.

RESEARCH LIMITATIONS/IMPLICATIONS

This review was limited to the process of knowledge dissemination in health systems and its utilization by users at the health organization level. Issues related to improvement initiatives deserve more attention.

PRACTICAL IMPLICATIONS

Knowledge dissemination goes beyond better communication and should be considered as carefully as the measurement of performance. Choices pertaining to intervention should be continuously prompted by the concern to support organizational action.

ORIGINALITY/VALUE

While considerable attention was paid to the public reporting of performance information, this review sheds some light on a more promising avenue for changes and improvements, notably in public health systems.

Chances and risks of publication of quality data - the perspectives of Swiss physicians and nurses

BACKGROUND

The release of quality data from acute care hospitals to the general public is based on the aim to inform the public, to provide transparency and to foster quality-based competition among providers. Due to the expected mechanisms of action and possibly the adverse consequences of public quality comparison, it is a controversial topic. The perspective of physicians and nurses is of particular importance in this context. They are mainly responsible for the collection of quality-control data, and are directly confronted with the results of public comparison. The research focus of this qualitative study was to discover what the views and opinions of the Swiss physicians and nurses were regarding these issues. It was investigated as to how the two professional groups appraised the opportunities as well as the risks of the release of quality data in Switzerland.

METHODS

A qualitative approach was chosen to answer the research question. For data collection, four focus groups were conducted with physicians and nurses who were employed in Swiss acute care hospitals. Qualitative content analysis was applied to the data.

RESULTS

The results revealed that both occupational groups had a very critical and negative attitude regarding the recent developments. The perceived risks were dominating their view. In summary, their main concerns were: the reduction of complexity, the one-sided focus on measurable quality variables, risk selection, the threat of data manipulation and the abuse of published information by the media. An additional concern was that the impression is given that the complex construct of quality can be reduced to a few key figures, and it that it is constructed from a false message which then influences society and politics. This critical attitude is associated with the different value system and the professional self-concept that both physicians and nurses have, in comparison to the underlying principles of a market-based economy and the economic orientation of health care business.

CONCLUSIONS

The critical and negative attitude of Swiss physicians and nurses must, under all conditions, be heeded to and investigated regarding its impact on work motivation and identification with the profession. At the same time, the two professional groups are obligated to reflect upon their critical attitude and take a proactive role in the development of appropriate quality indicators for the publication of quality data in Switzerland.

Using discrete choice experiment to elicit doctors' preferences for the report card design of diabetes care in Taiwan - a pilot study

OBJECTIVES

Little is known about doctors' preferences regarding public report card design. Taiwan just announced the first diabetes report card on April 2008. The aim of this study was to investigate the Diabetes Mellitus (DM) providers' preferences towards four report card attributes: update frequency, risk adjustment, content information and display format.

METHODS

A discrete choice questionnaire was mailed to hospital and primary care doctors in the northern part of Taiwan, with 221 study targets. The response rate was 29%.

RESULTS

Using random effect logistic regression, doctors' preference attribute rankings were risk adjustment for patients (44.7%), content information (25.2%), display format (18.3%) and update frequency (11.8%). One-year update frequency, risk adjustment, detailed scores of technical quality and interpersonal quality and bar chart display were the most important items noted in our survey.

CONCLUSIONS

This is the first study to investigate provider's preferences for a diabetes report card. It enables the policy maker to clearly see the implication of trade-offs between different choices when designing a report card that doctors will like. Our findings suggest that doctors do not favour the 'less is more' principle, or the higher frequency of updates that patients may prefer. Rather, our findings suggest that risk adjustment and more information content are the most important factors for doctors. Future studies should use discrete choice experiment on different aspects of report card design, such as vulnerable patients or health care administrations.

Consumer use of publicly released hospital performance information: assessment of the National Hospital Evaluation Program in Korea

OBJECTIVE

To assess the extent of consumer use of publicly released hospital performance information by the National Health Evaluation Program (HEP) in Korea.

DESIGN

A questionnaire survey with 385 outpatients visiting four general hospitals in Seoul.

MAIN OUTCOME MEASURES

The consumer use of performance information was assessed by the consumers' intention to: (1) recommend hospitals with good performance reports, according to HEP, to their relatives; (2) switch to other hospitals with a better performance and (3) keep the performance report for future use.

RESULTS

Overall, 52-75% of the respondents expressed their intention to use the hospital performance information. Logistic regression analysis results showed that people would use the performance information if they considered HEP to be effective in improving the quality of health care and the performance reports to be trustworthy and useful in choosing hospitals.

CONCLUSION

This study provides evidence that consumers in a health care system with few restrictions for provider choice, such as in Korea, have a high potential to utilize the provider performance information in their decision making. If public use of the performance information becomes common, policy makers should acknowledge the critical value of the quality of the performance report in order to avoid misleading consumers.

Using quality report cards for reshaping dentist practice patterns: a pre-play communication approach

Rationale, aims and objectives Understanding how information disclosure influences dentists' patterns of practice change is important in developing quality-improvement policies and cost containment. Thus, using quality report cards is a promising strategy for investigating whether dentists will reshape their patterns of practice because of the influence of peer comparison. Methods Based on the coordination game, a data warehouse decision support system (DWDSS) was used as a pre-play communication instrument, along with the disclosure of quality report cards, which allow dentists to search their own service rates of dental restoration and restoration replacement as well as compare those results with others. Results and conclusions The group using the DWDSS had a greater decrease in two indicators (i.e. service rates of dental restoration and restoration replacement) than the dentists who did not use it, which implies that the DWDSS is a useful facility for helping dentists filter and evaluate information for establishing the maximum utility in their practice management. The disclosure of information makes significant contributions to solving managerial problems associated with dentists' deviation of practice patterns.

[The objective assessment of the quality of hospital care: dream or reality?]

One of the hottest topics of the international journals is the question: what is the effect of the public indicator-based quality assessment on the quality of care and on the decision of stakeholders, and which criteria should be applied for development of public quality assessment system. According to the international literature the paper discusses 6 topics: (1) the ability of indicators to distinguish providers from the point of view of quality; (2) the appropriateness of outcome indicators to assess providers; (3) the ability of league tables to rank providers; (4) the people's behaviour during choosing providers; (5) the impact of indicator-based public report; (6) recommendations for developing quality assessment system. Based on the literature review, the ability of indicators in distinguishing providers from the point of view of quality is doubtful primarily because of risk-adjustment problems. Other reasons are: the outcomes of care do not definitely refer to the quality of care process; the rankings of providers (league tables) based on more indicators are not reliable; people take into account mainly distance and the opinions of acquaintance when they choose providers; as a result of public reports the overall quality of care is declining. The publication of the results of measurement to assess providers has to be considered as a tool. For the purpose of helping people in choosing providers, the publication of patient satisfaction survey designed according to their preferences could achieve the desired effect. The quality improvement aims are definitely helped by the direct feedback to providers about the indicator values. Furthermore, much finer picture can be made if the standardized audits of care and organisational processes are inserted into external assessment procedures.