Development of an International Standard Set of Outcomes and Measurement Methods for Routine Practice for Infants, Children, and Adolescents with Epilepsy: The International Consortium for Health Outcomes Measurement Consensus Recommendations

At present, there is no internationally accepted set of core outcomes or measurement methods for epilepsy clinical practice. The International Consortium for Health Outcomes Measurement (ICHOM) convened an international working group of experts in epilepsy, people with epilepsy, and their representatives to develop minimum sets of standardized outcomes and outcome measurement methods for clinical practice. Using modified Delphi consensus methods with consecutive rounds of online voting over 12 months, a core set of outcomes and corresponding measurement tool packages to capture the outcomes were identified for infants, children, and adolescents with epilepsy. Consensus methods identified 20 core outcomes. In addition to the outcomes identified for the ICHOM Epilepsy adult standard set, behavioral, motor, and cognitive/language development outcomes were voted as essential for all infants and children with epilepsy. The proposed set of outcomes and measurement methods will facilitate the implementation of the use of patient-centered outcomes in daily practice.

Development of an International Standard Set of Outcomes and Measurement Methods for Routine Practice for Adults with Epilepsy: The International Consortium for Health Outcomes Measurement Consensus Recommendations

At present, there is no internationally accepted set of core outcomes or measurement methods for epilepsy clinical practice. Therefore, the International Consortium for Health Outcomes Measurement (ICHOM) convened an international working group of experts in epilepsy, people with epilepsy and their representatives to develop minimum sets of standardized outcomes and outcomes measurement methods for clinical practice that support patient-clinician decision-making and quality improvement. Consensus methods identified 20 core outcomes. Measurement tools were recommended based on their evidence of strong clinical measurement properties, feasibility, and cross-cultural applicability. The essential outcomes included many non-seizure outcomes: anxiety, depression, suicidality, memory and attention, sleep quality, functional status, and the social impact of epilepsy. The proposed set will facilitate the implementation of the use of patient-centered outcomes in daily practice, ensuring holistic care. They also encourage harmonization of outcome measurement, and if widely implemented should reduce the heterogeneity of outcome measurement, accelerate comparative research, and facilitate quality improvement efforts.

An International, Multidisciplinary Consensus Set of Patient-Centered Outcome Measures for Substance-Related and Addictive Disorders

Background: In 1990, the United States' Institute of Medicine promoted the principles of outcomes monitoring in the alcohol and other drugs treatment field to improve the evidence synthesis and quality of research. While various national outcome measures have been developed and employed, no global consensus on standard measurement has been agreed for addiction. It is thus timely to build an international consensus. Convened by the International Consortium for Health Outcomes Measurement (ICHOM), an international, multi-disciplinary working group reviewed the existing literature and reached consensus for a globally applicable minimum set of outcome measures for people who seek treatment for addiction. Methods: To this end, 26 addiction experts from 11 countries and 5 continents, including people with lived experience (n = 5; 19%), convened over 16 months (December 2018-March 2020) to develop recommendations for a minimum set of outcome measures. A structured, consensus-building, modified Delphi process was employed. Evidence-based proposals for the minimum set of measures were generated and discussed across eight videoconferences and in a subsequent structured online consultation. The resulting set was reviewed by 123 professionals and 34 people with lived experience internationally. Results: The final consensus-based recommendation includes alcohol, substance, and tobacco use disorders, as well as gambling and gaming disorders in people aged 12 years and older. Recommended outcome domains are frequency and quantity of addictive disorders, symptom burden, health-related quality of life, global functioning, psychosocial functioning, and overall physical and mental health and wellbeing. Standard case-mix (moderator) variables and measurement time points are also recommended. Conclusions: Use of consistent and meaningful outcome measurement facilitates carer-patient relations, shared decision-making, service improvement, benchmarking, and evidence synthesis for the evaluation of addiction treatment services and the dissemination of best practices. The consensus set of recommended outcomes is freely available for adoption in healthcare settings globally.

Balancing adaptability and standardisation: insights from 27 routinely implemented ICHOM standard sets

BACKGROUND

Healthcare systems around the world experience increasing pressure to control future growth of healthcare expenditures. Among other initiatives, quality and value-based benchmarking has become an important field to inform clinical evaluation and reimbursement questions. The International Consortium for Health Outcomes Measurement (ICHOM) has become one of the driving forces to translate scientific evidence into standardized assessments that are routinely applicable in day-to-day care settings. These aim to provide a benchmarking tool that allows the comparison and competition of health care delivery on the basis of value-based health care principles.

METHODS

This work focuses on the consolidation of the ICHOM methodology and presents insights from 27 routinely implemented Standard Sets. The analysis is based on a literature review of the ICHOM literature repository, a process document review and key informant interviews with ICHOM's outcomes research and development team.

RESULTS

Key findings are that the scope of ICHOM Standard Sets shifted from a more static focus on burden of disease and poorly standardized care pathways to a more dynamic approach that also takes into account questions about the setting of care, feasibility of implementing a benchmarking tool and compatibility of different Standard Sets. Although certain overlaps exist with other initiatives in the field of patient reported outcomes (PRO), their scopes differ significantly and they hence rather complement each other. ICHOM pursues a pragmatic approach to enable the benchmarking and the analysis of healthcare delivery following the principles of value-based healthcare.

CONCLUSION

The ICHOM Standard Sets complement other initiatives in the field of patient-reported outcomes (PRO) and functional reporting by placing a particular focus on healthcare delivery, while other initiatives primarily focus on evaluation of academic endpoints. Although ICHOM promotes a pragmatic approach towards developing and devising its Standard Sets, the definition of standardized decision making processes emerged as one of the key challenges. Furthermore, the consolidation of core metrics across number of disease areas to enable the parallel implementation of different Standard Sets in the same care setting is an important goal that will enable the widespread implementation of patient-reported outcome measures (PROM).

Development of an international standard set of outcome measures for patients with venous thromboembolism: an International Consortium for Health Outcomes Measurement consensus recommendation

The International Consortium for Health Outcomes Measurement assembled an international working group of venous thromboembolism experts and patient representatives to develop a standardised minimum set of outcomes and outcome measurements for integration into clinical practice and potentially research to support clinical decision making and benchmarking of quality of care. 15 core outcomes important to patients and health-care professionals were selected and categorised into four domains: patient-reported outcomes, long term consequences of the disease, disease-specific complications, and treatment-related complications. The outcomes and outcome measures were designed to apply to all patients with venous thromboembolism aged 16 years or older. A measurement tool package was selected for inclusion in the core standard set, with a minimum number of items to be measured at predefined timepoints, which capture all core outcomes. Additional measures can be introduced to the user by a cascade opt-in system that allows for further assessment if required. This set of outcomes and measurement tools will facilitate the implementation of the use of patient-centred outcomes in daily practice.

Developing an International Standard Set of Patient-Reported Outcome Measures for Psychotic Disorders

OBJECTIVE

The objective of this project was to develop a set of patient-reported outcome measures for adolescents and adults who meet criteria for a psychotic disorder.

METHODS

A research team and an international consensus working group, including service users, clinicians, and researchers, worked together in an iterative process by using a modified Delphi consensus technique that included videoconferencing calls, online surveys, and focus groups. The research team conducted systematic literature searches to identify outcomes, outcome measures, and risk adjustment factors. After identifying outcomes important to service users, the consensus working group selected outcome measures, risk adjustment factors, and the final set of outcome measures. International stakeholder groups consisting of >100 professionals and service users reviewed and commented on the final set.

RESULTS

The consensus working group identified four outcome domains: symptoms, recovery, functioning, and treatment. The domains encompassed 14 outcomes of importance to service users. The research team identified 131 measures from the literature. The consensus working group selected nine measures in an outcome set that takes approximately 35 minutes to complete.

CONCLUSIONS

A set of patient-reported outcome measures for use in routine clinical practice was identified. The set is free to service users, is available in at least two languages, and reflects outcomes important to users. Clinicians can use the set to improve clinical decision making, and administrators and researchers can use it to learn from comparing program outcomes.

Standard set of patient-reported outcomes for personality disorder

PURPOSE

The purpose of the article is to present standard set of outcomes for people with personality disorder (PD), in order to facilitate patient outcome measurement worldwide.

METHODS

The International Consortium for Health Outcomes Measurement (ICHOM) gathered a multidisciplinary international working group, consisting of 16 experts, including clinicians, nurses, psychologists, methodologists and patient representatives, to develop a standard set of outcome measures for people with PD. The Delphi method was used to reach consensus on the scope of the set, outcome domains, outcome measures, case-mix variables and time points for measuring outcomes in service users. For each phase, a project team prepared materials based on systematic literature reviews and consultations with experts.

RESULTS

The working group decided to include PD, as defined by International Classification of Diseases 11th revision (ICD-11). Eleven core outcomes and three optional outcomes across four health domains (mental health, behaviour, functioning and recovery) were defined as those relevant for people with PD. Validated measures for the selected outcomes were selected, some covering more than one outcome. Case-mix variables were aligned to other ICHOM mental health standard sets and consisted of demographic factors and those related to the treatment that people received. The group recommended that most outcomes are measured at baseline and annually.

CONCLUSION

The international minimum standard set of outcomes has the potential to improve clinical decision making through systematic measurement and comparability. This will be key in improving the standard of health care for people with PD across the world.

Defining a standard set of outcomes for patients with psychosis

Background

A working group (WG) of researchers, clinicians, and service users was created to develop a Standard Set of Psychotic Disorder Outcomes. This study describes the ICHOM framework to create a minimum Standard Set of outcomes for Psychotic Disorders.

Methods

The WG defined the scope of the project to include adolescents and adults meeting DSM-5 criteria for schizophrenia spectrum disorders or bipolar I disorder. A systematic literature review was conducted to extract patient outcomes. The WG then selected outcomes for this minimum standard set using an online modified Delphi consensus technique, throughout a series of video-conference calls. Outcome measures were identified through additional literature searches using a Terwee filter. These were evaluated by inclusion criteria, namely psychometric properties, feasibility of implementation, licensing fees and available translations.

Results

In total, 7074 studies were screened for outcome extraction. Outcomes were extracted from the 239 of these which passed eligibility criteria. The WG voted to include 17 outcomes, grouped into 7 domains (symptoms, treatment, recovery, functioning, quality of life, physical health and safety). A further 24 outcomes were identified for bipolar disorder, grouped within the same domains.

Conclusions

The outcomes recommended by the working group enable meaningful and standardized assessment of psychotic disorders worldwide. Adoption of the ICHOM framework can facilitate informed decision-making by healthcare providers, long term monitoring and improved global treatment outcomes in the long term.

Key messages

Standard set provides a valid and easy tool for healthcare workers for measuring outcomes. Value based health care and outcomes measures could globally improve healthcare and at the same time reduce healthcare cost.