An emerging framework for fully incorporating public involvement (PI) into patient-reported outcome measures (PROMs)

Development of a new health-related quality of life measure for people with diabetes who experience hypoglycaemia: the Hypo-RESOLVE QoL

AIMS/HYPOTHESIS

Valid and reliable patient-reported outcome measures are vital for assessing disease impact, responsiveness to healthcare and the cost-effectiveness of interventions. A recent review has questioned the ability of existing measures to assess hypoglycaemia-related impacts on health-related quality of life for people with diabetes. This mixed-methods project was designed to produce a novel health-related quality of life patient-reported outcome measure in hypoglycaemia: the Hypo-RESOLVE QoL.

METHODS

Three studies were conducted with people with diabetes who experience hypoglycaemia. In Stage 1, a comprehensive health-related quality of life framework for hypoglycaemia was elicited from semi-structured interviews (N=31). In Stage 2, the content validity and acceptability of draft measure content were tested via three waves of cognitive debriefing interviews (N=70 people with diabetes; N=14 clinicians). In Stage 3, revised measure content was administered alongside existing generic and diabetes-related measures in a large cross-sectional observational survey to assess psychometric performance (N=1246). The final measure was developed using multiple evidence sources, incorporating stakeholder engagement.

RESULTS

A novel conceptual model of hypoglycaemia-related health-related quality of life was generated, featuring 19 themes, organised by physical, social and psychological aspects. From a draft version of 76 items, a final 14-item measure was produced with satisfactory structural (χ2=472.27, df=74, p<0.001; comparative fit index =0.943; root mean square error of approximation =0.069) and convergent validity with related constructs (r=0.46-0.59), internal consistency (α=0.91) and test-retest reliability (intraclass correlation coefficient =0.87).

CONCLUSIONS/INTERPRETATION

The Hypo-RESOLVE QoL is a rigorously developed patient-reported outcome measure assessing the health-related quality of life impacts of hypoglycaemia. The Hypo-RESOLVE QoL has demonstrable validity and reliability and has value for use in clinical decision-making and as a clinical trial endpoint.

DATA AVAILABILITY

All data generated or analysed during this study are included in the published article and its online supplementary files ( https://doi.org/10.15131/shef.

DATA

23295284.v2 ).

Patient perspectives of quality of life in chronic limb-threatening ischemia: a qualitative study

BACKGROUND

Quality of life (QOL) is an outcome that matters to patients with chronic limb-threatening ischemia (CLTI). However, we identified the lack of and need for a CLTI-specific QOL instrument. Our group is developing this instrument which requires a deep understanding of patient perspectives of QOL in CLTI.

METHODS

Qualitative inquiry with patient and public involvement was performed in accordance with the Standards for Reporting Qualitative Research. Reflexive thematic analysis of semi-structured interviews was conducted within a constructivist-interpretivist research paradigm. Data were organized and managed in NVivo. Techniques to enhance trustworthiness included maintaining an audit trail, member checking, mentoring, and peer-debriefing. Patient and the public were consulted for feedback on codes, themes, and thematic maps.

RESULTS

Thirteen participants (median age: 74 years, range: 43-90 years) with a variety of patient demographics were interviewed. Four themes were developed on QOL in CLTI: (i) 'independence as key to life satisfaction', (ii) 'change in identity when continuity is needed', (iii) 'coping with intractable disease', and (iv) 'not wanting to be alone'. Member checking with patient and public involvement confirmed the relevance and centrality of these themes to the lived experiences of patients with CLTI.

CONCLUSIONS

The thematic outputs contribute important insights into what QOL truly means to patients with CLTI and what matters for their QOL. The content validity of the new CLTI-specific QOL instrument is improved by giving patients voice. This study highlights the value of qualitative inquiry and patient and public involvement in vascular surgical research.

Using Implementation Science Frameworks to Guide the Use of Electronic Patient-Reported Outcome Symptom Monitoring in Routine Cancer Care

PURPOSE

Electronic patient-reported outcomes (ePROs) are an evidence-based means of detecting symptoms earlier and improving patient outcomes. However, there are few examples of successful implementation in routine cancer care. We conducted a qualitative study to identify barriers and facilitators to implementing ePRO symptom monitoring in routine cancer care using the Consolidated Framework for Implementation Research (CFIR).

METHODS

Participants were adult patients with cancer, their caregivers, or health care professionals involved in ePRO monitoring or processes. Focus groups or individual interviews were conducted using a semistructured approach informed by the CFIR. Data were analyzed deductively using the CFIR. Barriers were matched to theory-informed implementation strategies using the CFIR-Expert Recommendations for Implementing Change (ERIC) matching tool.

RESULTS

Thirty participants were interviewed: 22 females (73%), aged 31-70 years (28, 94%), comprising patients (n = 8), caregivers (n = 2), medical oncologists (n = 4), nurses (n = 4), hospital leaders (n = 6), clinic administrators (n = 2), pharmacists (n = 2), and information technology specialists (n = 2). Barriers pertaining to four CFIR domains were identified and several were novel, including the challenge of adapting ePROs for different anticancer treatments. Facilitators pertaining to all CFIR domains were identified, such as leveraging acceptability of remote care post-COVID-19 to drive implementation. Conducting consensus discussions with stakeholders to tailor ePROs to the local setting, identifying/preparing individual and group-level champions, and assessing readiness for change (including leveraging technological advances and increased confidence in using remote monitoring post-COVID-19) were the most frequently recommended implementation strategies.

CONCLUSION

The CFIR facilitated identification of known and novel barriers and facilitators to implementing ePRO symptom monitoring in routine cancer care. Implementation strategies summarized in a conceptual framework will be used to codesign an ePRO symptom monitoring system for immunotherapy side effects.

Monitoring and responding to signals of suicidal ideation in pragmatic clinical trials: Lessons from the GRACE trial for Chronic Sickle Cell Disease Pain

Sickle cell disease (SCD) is a hemoglobin disorder and the most common genetic disorder that affects 100,000 Americans and millions worldwide. Adults living with SCD have pain so severe that it often requires opioids to keep it in control. Depression is a major global public health concern associated with an increased risk in chronic medical disorders, including in adults living with sickle cell disease (SCD). A strong relationship exists between suicidal ideation, suicide attempts, and depression. Researchers enrolling adults living with SCD in pragmatic clinical trials are obligated to design their methods to deliberately monitor and respond to symptoms related to depression and suicidal ideation. This will offer increased protection for their participants and help clinical investigators meet their fiduciary duties. This article presents a review of this sociotechnical milieu that highlights, analyzes, and offers recommendations to address ethical considerations in the development of protocols, procedures, and monitoring activities related to suicidality in depressed patients in a pragmatic clinical trial.

The impact of COVID-19 on PRO development, collection and implementation: views of UK and Ireland professionals

BACKGROUND

PROs are valuable tools in clinical care to capture patients' perspectives of their health, symptoms and quality of life. However the COVID-19 pandemic has had profound impacts on all aspects of life, in particular healthcare and research. This study explores the views of UK and Irish health professionals, third sector and pharmaceutical industry representatives and academic researchers on the impact of COVID-19 on PRO collection, use and development in clinical practice.

METHODS

A volunteer sample took part in a 10 question cross sectional qualitative survey, on the impact of COVID-19, administered online via Qualtrics. Demographic data was descriptively analysed, and the qualitative free text response data was subject to thematic analysis and summarised within the Strengths, Weaknesses, Opportunities and Threats (SWOT) framework.

RESULTS

Forty nine participants took part located in a range of UK settings and professions. Participants highlighted staff strengths during the pandemic including colleagues' flexibility and ability to work collaboratively and the adoption of novel communication tools. Weaknesses were a lack of staff capacity to continue or start PRO projects and insufficient digital infrastructure to continue studies online. Opportunities included the added interest in PROs as useful outcomes, the value of electronic PROs for staff and patients particularly in relation to integration into systems and the electronic patient records. However, these opportunities came with an understanding that digital exclusion may be an issue for patient groups. Threats identified included that the majority of PRO research was stopped or delayed and funding streams were cut.

CONCLUSIONS

Although most PRO research was on hold during the pandemic, the consensus from participants was that PROs as meaningful outcomes were valued more than ever. From the opportunities afforded by the pandemic the development of electronic PROs and their integration into electronic patient record systems and clinical practice could be a lasting legacy from the COVID-19 pandemic.

The development of the People with Aphasia and Other Layperson Involvement (PAOLI) framework for guiding patient and public involvement (PPI) in aphasia research

BACKGROUND

Patient and Public Involvement (PPI) in aphasia research requires researchers to include people with aphasia as research partners from the beginning of the study. Yet the quality of reporting on the level and type of involvement is poorly documented in the absence of a framework to guide PPI in aphasia research. This study aimed to extract the items and statements relevant for the development of the People with Aphasia and Other Layperson Involvement (PAOLI) framework for designing and implementing PPI in aphasia research, in collaboration with people with aphasia.

METHOD

The method recommended by the EQUATOR network was followed. This involved: (1) evidence from a scoping review, (2) a thematic analysis of the in-depth interviews, of people with stroke and aphasia, on the topics to be included in the pilot draft, (3) a two round Delphi survey for item/statement selection and (4) an experts' consensus meeting. The research team involved two PPI partners with chronic stroke-induced aphasia. The research process involved co-design and was informed by the Dialogue model.

RESULTS

Twenty-three panellists, from 13 countries, voted in round one with 87% (20/23) responding in round two. The final PAOLI framework includes the following 17 items (with 66 descriptive statements): establish collaborations, recruit patients, gain informed consent, organize induction meetings, train patient partners, create communication links, engage communication partners, conceptualize topics, establish research priorities, reach consensus, work with co-design methods, develop proposals, assist with dissemination of results, promote implementation of the outcomes, support patient partners and promote self-evaluation, monitor progress and assess impact of the patient involvement. These items were considered by the panellists as the most relevant for the involvement of people with aphasia as research partners.

CONCLUSION

The PAOLI is the first international consensus framework for guiding patient involvement in aphasia research. Researchers are encouraged to adopt the framework to improve the quality of their research by promoting the meaningful involvement of people with aphasia within the research team from the start.

Identifying patient-valued outcomes for use in early phase trials of ocular surface disease interventions

BACKGROUND

Patient-reported outcomes (PROs) can be used to evaluate the impact of dry eye symptoms (DES) on daily life. Early-phase clinical trials provide an opportunity to evaluate PRO strategies. Existing measures identified through systematic review omitted important concepts that mattered to patients. The aim of our work was to develop a conceptual map of DES and assess the relative importance of identified concepts.

METHODS

Web-based group concept mapping software was used to develop a conceptual map. This semi-quantitative mixed-methods approach consists of three stages 1) statement generation, 2) thematic sorting, 3) rating of statements for importance [1 (not important), 2 (important), 3 (very important)] and relevance [1 (not my experience), 2 (sometimes my experience); 3 (definitely my experience)]. Thirty-nine participants were recruited from two UK-based patient support groups (British Sjögren's Syndrome Association, PemFriends). Three withdrew, two for health reasons and one struggled with the web-based format.

RESULTS

125 statements and six thematic clusters were generated. The Environmental Impacts cluster scored highest for importance (2.45), followed by Pain and Discomfort (2.35), Eye Treatments (2.32), Daily Impact (2.07), Psychosocial Issues (1.78) and Miscellaneous (1.78). Mapping statements against existing PRO measures confirmed a number of important missing issues including the impact of 'UV levels' (2.50), hot dry weather (2.33), the temporal aspects of pain (2.64), and issues with night-driving (2.59).

CONCLUSIONS

Group concept mapping identified important issues for people living with DES not currently captured by existing PROs, highlighting the need for additional PRO items to be considered for use in clinical trials.

Improving the Understanding and Managing of the Quality of Life of Patients With Lung Cancer With Electronic Patient-Reported Outcome Measures: Scoping Review

BACKGROUND

Electronic patient-reported outcome measures (ePROMs) are essential to clinical practice and research. The growth of eHealth technologies has provided unprecedented opportunities to collect information systematically through ePROMs. Although they are widely used in scientific research, more evidence is needed to determine their use and implementation in daily clinical practice. For example, when diagnosed, patients with lung cancer are at an advanced stage of the disease. This entails tremendous burden because of high mortality and losses in the different dimensions of the human being. In this case, monitoring symptoms and other outcomes help improve the patient's quality of life.

OBJECTIVE

ePROMs offered unprecedented opportunities to collect information systematically. Our goal was to demonstrate that ePROMs are more useful in controlling patient symptoms, lung cancer, and overall survival than their alternatives, such as nonelectronic PROMs.

METHODS

This exploratory review considered articles published between 2017 and 2022 identified through searches of PubMed, Scopus, Cochrane, CINAHL, and PsycINFO. We found 5097 articles; after removing the duplicates, we reduced them to 3315. After reading the summary, we were left with 56. Finally, after applying the exclusion criteria, we reviewed 12. The 5-step framework by Arksey and O'Malley was used to refine the initial search results with the following research questions: Do ePROMs help physician-patient communication? To what extent do they improve decision-making? Are institutions and their digitization policies barriers to or facilitators of this process? and What else is needed for routine implementation?

RESULTS

This review included 12 articles. We found that ePROMs are an integrative and facilitative communication tool, highlighting their importance in the relationship between palliative care and medical oncology. ePROMs help assess patient symptoms and functionality more accurately and facilitate clinical decision-making. In addition, it allows for more precise predictions of overall patient survival and the adverse effects of their treatments. The main institutional obstacles are the initial investment, which can be costly, and the data protection policy. However, enablers included better funding through the development of telemedicine, support from institutional leaders to overcome resistance to change, and transparent policies to ensure the safe and secure use of ePROMs.

CONCLUSIONS

Routine collection of remote ePROMs is an effective and valuable strategy for providing real-time clinical feedback. In addition, it provides satisfaction to patients and professionals. Optimizing ePROMs in patients with lung cancer leads to a more accurate view of health outcomes and ensures quality patient follow-up. It also allows us to stratify patients based on their morbidity, creating specific follow-ups for their needs. However, data privacy and security are concerns when using ePROMs to ensure compliance with local entities. At least four barriers were identified: cost, complex programming within health systems, safety, and social and health literacy.

Post-TB health and wellbeing

TB affects around 10.6 million people each year and there are now around 155 million TB survivors. TB and its treatments can lead to permanently impaired health and wellbeing. In 2019, representatives of TB affected communities attending the '1st International Post-Tuberculosis Symposium´ called for the development of clinical guidance on these issues. This clinical statement on post-TB health and wellbeing responds to this call and builds on the work of the symposium, which brought together TB survivors, healthcare professionals and researchers. Our document offers expert opinion and, where possible, evidence-based guidance to aid clinicians in the diagnosis and management of post-TB conditions and research in this field. It covers all aspects of post-TB, including economic, social and psychological wellbeing, post TB lung disease (PTLD), cardiovascular and pericardial disease, neurological disability, effects in adolescents and children, and future research needs.

Producing a preference-based quality of LIFE measure to quantify the impact of HYPOGLYCAEMIA on people living with diabetes: A mixed-methods research protocol

BACKGROUND

Assessment of patient-reported outcome measures (PROMs), including quality of life (QoL), is essential in diabetes research and care. However, a recent review concluded that current hypoglycaemia-specific PROMs have limited evidence of validity, reliability and responsiveness for assessing the impact of hypoglycaemia on QoL in people living with diabetes. None of the PROMs identified could be used directly to inform the cost-effectiveness of treatments and interventions. There is a need for a new hypoglycaemia-specific QoL PROM, which can be used directly to inform economic evaluations.

AIMS

This project has three aims: (a) To develop draft PROM content for measuring the impact of hypoglycaemia on QoL in adults with diabetes. (b) To refine the draft content using cognitive debriefing interviews and psychometrics. This will result in a condition-specific PROM that can be used to quantify the impact of hypoglycaemia upon QoL. (c) To generate a preference-based measure (PBM) that will enable utility values to be calculated for economic evaluation.

METHODS

A mixed-methods, three-stage design is used: (a) Qualitative interviews will inform the draft PROM content. (b) Cognitive debriefing interview data will be used to refine the draft PROM content. The PROM will be administered in a large-scale survey to enable psychometric validation. Final item selection for the PROM will be informed by psychometric performance, translatability assessment and input from stakeholder groups. (c) A classification system will be generated, comprising a reduced number of items from the PROM. A valuation survey will be conducted to derive a value set for the PBM.

The importance of children and young person involvement in scoping the need for a paediatric glucocorticoid-associated patient reported outcome measure

Background

For many children and young people (CYP) with paediatric rheumatic conditions, glucocorticoid medications and their associated side-effects have a substantial impact on disease experience. Whilst there are physician-rated measures of glucocorticoid toxicity, no parallel patient reported measure has been developed to date for CYP with rheumatic disease. This manuscript describes a series of public patient involvement (PPI) events to inform the development of a future paediatric glucocorticoid-associated patient reported outcome measure (PROM).

Methods

One large group PPI event was advertised to CYP with experience of glucocorticoid medication use and their parents through clinicians, charities and existing PPI groups. This featured education on the team’s research into glucocorticoid medication and interactive polls/structured discussion to help participants share their experiences. Further engagement was sought for PPI group work to co-develop future glucocorticoid studies, including development of a glucocorticoid associated PROM. Quantitative and qualitative feedback was collected from online questionnaires. The initiative was held virtually due to the Covid-19 pandemic.

Results

Nine families (n = 15) including 6 CYP joined the large group PPI event. Online pre-attendance and post-attendance questionnaires showed improvement in mean self-reported confidence [1 = not at all confident, 5 = very confident] in the following: what steroid medications are (pre = 3.9, post = 4.8), steroid side effects (pre = 3.8, post = 4.6), patient-reported outcome measures (pre = 2.0, post = 4.5), available research on steroids (pre = 2.2, post = 3.5). Five families (n = 7) were involved in a monthly PPI group who worked alongside the research team to identify priorities in glucocorticoid research, produce age-appropriate study materials, identify barriers to study participation (e.g. accessibility & convenience) and recommend appropriate modalities for dissemination. The participants found discussing shared experiences and learning about research to be the most enjoyable aspects of the initiative.

Conclusions

This PPI initiative provided a valuable forum for families, including young children, to share their perspectives. Here, the authors explore the effective use of PPI in a virtual setting and provide a unique case study for the involvement of CYP in PROM development. The monthly PPI group also identified a need for the development of a new PROM related to glucocorticoid medication use and provided unique insights into how such a study could be structured.

Supplementary Information

The online version contains supplementary material available at 10.1186/s41927-022-00312-9.

Capturing Meaningful Outcomes in -Pediatric Neurology: Further Reflections on Principles, Challenges, and Opportunities

Patient and public involvement in health care is considered indispensable in the way we conduct daily pediatric neurology practice, and in the development and utilization of health outcome measurements. This essay examines what meaningful quality evaluations and measurements are, describes the development of approaches to measuring health and outcomes, explores the potential applications of patient-reported outcome measures in pediatric neurology, and identifies opportunities and challenges in using patient-reported outcome measurements in our daily clinical practice. Recent developments have transformed our attitude on how to help children with neurological and developmental conditions and their families: specifically, (1) the recognition of the fundamental rights of children with disabilities; (2) the application of the framework of the International Classification of Functioning, Disability and Health by the World Health Organization that views health from the perspective of both biopsychosocial strengths and functional abilities; (3) the application of qualitative research methodologies to children with neurological conditions and their caregivers to elucidate what they consider essential for their own good health and well-being; and (4) the development of core outcome measurements sets for children and adults with various neurological and developmental conditions. In summary, supporting patients in their role as full partners in clinical care and research enables them to contribute their experiential knowledge and helps ensure that results are relevant and address patient needs, preferences, and priorities. Recognizing the importance of involving young people in their health management decisions has become central in contemporary medicine and needs to be part of the curriculum of all health care professionals.

Living with a left ventricular assist device: Capturing recipients experiences using group concept mapping software

Background

Left ventricular assist device (LVAD) implantation significantly impacts on a recipient’s symptoms and quality of life. Capturing their experiences and post implant journey is an important part of clinical practice, research and device design evolution. Patient reported outcome measures (PROMs) are a useful tool for capturing that experience. However, patient reported outcome measures need to reflect recipients’ experiences. Discussions with a patient partner group found that none of the frequently used cardiology PROMs captured their unique experiences.

Aims

To capture the experiences and important issues for LVAD recipients. Develop a conceptual map of domains and items that should be reflected in patient reported outcomes.

Methods

Group concept mapping (GCM) web-based software was used to remotely capture and structure recipients’ experiences across a wide geographical area. GCM is a semi-quantitative mixed method consisting of 3 stages: item generation, item sorting and rating (importance, relevance and frequency). Patient partners were involved in all aspects of the study design and development.

Results

18 LVAD recipients consented to take part. 101 statements were generated and multi-dimensional scaling, and hierarchical cluster analysis identified 9 clusters. Cluster themes included: Activities, Partner/family support, Travel, Mental wellbeing, Equipment and clothing, Physical and cognitive limitations, LVAD Restrictions, LVAD Challenges and positive impact of the LVAD (LVAD Positives). LVAD Positives were scored highest across all the rating variables, e.g., frequency (2.85), relevance (2.44) and importance (2.21). Other domains rated high for importance included physical and cognitive limitations (2.19), LVAD restrictions (2.11), Partner/family support (2.02), and Equipment and clothing (2.01).

Conclusion

Online GCM software facilitated the inclusion of geographically dispersed recipients and provided useful insights into the experiences of LVAD recipients. The conceptual framework identifies important domains and items that should be prioritised and included in patient reported outcomes in future research, LVAD design evolution, and clinical practice.

The Hopkins Symptom Checklist (SCL-90-R): A Patient-Reported Outcome Measure in Parkinson's Disease

Objective: This is the first study applying Clinimetric Patient-Reported Outcome Measures (CLIPROM) criteria to evaluate the construct validity, sensitivity, and clinical utility of the SCL-90-R in patients with Parkinson's disease (PD). Methods: A Rasch analysis was conducted using a sample of 488 PD outpatients. Results: Testing for dimensionality revealed that less than 5% of t-tests were significant, indicating that the SCL-90-R subscales entailed the property of construct validity. As to the total score, a Person Separation Reliability Index of .96 was found. Conclusions: The SCL-90-R total score is a sensitive screening measure that can be used not only to differentiate healthy stress reactions from symptoms of psychological distress but also to detect PD patients with an increased risk for psychiatric complications. As to the subscales, the brief versions that did not include misfitting items should be used to assess the severity of specific symptoms of psychological distress affecting PD patients.

An international collaborative study to co-produce a patient-reported outcome measure of cardiac arrest survivorship and health-related quality of life (CASHQoL): A protocol for developing the long-form measure

Background

Current measures of health-related quality of life are neither sufficiently sensitive or specific to capture the complex and heterogenous nature of the recovery and survivorship associated with cardiac arrest. To address this critical practice gap, we plan a mixed-methods study to co-produce and evaluate a new cardiac arrest-specific patient/survivor-reported outcome measure (PROM).

Methods

International guidelines have informed a two-stage, iterative, and interactive process.

Stage one will establish what is important to measure following cardiac arrest. A meta-ethnography of published qualitative research and a qualitative exploration of the experiences of survivors and their key supporters will inform the development of a measurement framework. This will be supplemented by existing, extensive reviews describing concepts that have previously been measured in this population. Focus groups with survivors, key supporters, and healthcare professionals, followed by further interviews with survivors and key supporters, will inform the iterative refinement of the framework, candidate items, and PROM structure.

Stage two will involve a psychometric evaluation following completion by a large cohort of survivors. Measurement theory will inform: the identification of items that best measure important outcomes; item reduction; and provide robust evidence of measurement and practical properties.

Discussion

An international, collaborative approach to PROM development will engage survivors, key supporters, researchers, and health professionals from study commencement. Successful co-production of the cardiac arrest survivorship and health-related quality of life (CASHQoL) measure will provide a robust, relevant, and internationally applicable measure, suitable for completion by adult survivors, and integration into research, registries, and routine care settings.

Ethical approval: University of Warwick Biomedical & Scientific Research Ethics Committee (BSREC 22/20-21 granted 10/11/20).

Addressing inequity in palliative care provision for older people living with multimorbidity. Perspectives of community-dwelling older people on their palliative care needs: A scoping review

BACKGROUND

Older people living with multimorbidity are projected to become the main recipients of palliative care in the coming decades, yet there is limited evidence regarding their expressed palliative care needs to inform person-centred care.

AIM

To understand the palliative care needs of community-dwelling people aged ⩾60 living with multimorbidity in the last 2 years of life.

DESIGN

A scoping review following Arksey and O'Malley.

DATA SOURCES

Three international electronic databases (CINAHL, Ovid Medline, PsycINFO) were searched from March 2018 to December 2021. Reference lists were hand searched. Eligible papers were those reporting empirical data on older people's needs.

RESULTS

From 985 potential papers, 28 studies were included, published between 2002 and 2020; sixteen quantitative, nine qualitative and three mixed methods. Data were extracted and presented under the holistic palliative care domains of need: physical, psychological, social, spiritual, and additionally practical needs. Different measurement tools (n = 29) were used, of which 20 were multidimensional. Primacy in reporting was given to physical needs, most commonly pain and function. Social and practical needs were often prioritised by older people themselves, including maintaining social connections and accessing and receiving individualised care.

CONCLUSION

Identifying the palliative care needs that matter most to older people with multimorbidity requires the recognition of their concerns, as well as their symptoms, across a continuum of living and dying. Available evidence is superficial. Supporting end of life provision for this growing and underserved population necessitates a shift to tailored multidimensional tools and community focussed integrated care services.

Conceptualization and content validation of the MEDication literacy assessment of geriatric patients and informal caregivers (MED-fLAG)

Background

The assessment of patients’ medication literacy skills (i.e., abilities to access, comprehend and interact with medication-related information) is an important step in assisting clinicians to plan for appropriate care. Despite several attempts by researchers to develop measures of medication literacy, an instrument tailored to the specific needs of older adults remains a significant shortfall. Therefore, an interprofessional team that included a citizen co-researcher conceptualized a new standardised measure of medication literacy—the MEDedication Literacy Assessment of Geriatric patients and informal caregivers (MED-fLAG). MED-fLAG was designed as a three-dimensional self-reported measure of functional, interactive and critical skills. This study describes the conceptualization process and provides the results of an evaluation of MED-fLAG’s content validity, acceptability, and feasibility during a hospital stay.

Methods

MED-fLAG was developed in accordance with the guidance on scale development and standards for good content validity, by using the following steps: (I) conceptualization of a provisional version of MED-fLAG; (II) iterative qualitative evaluation of its content validity by older adults, informal caregivers and healthcare professionals.

Results

The qualitative assessment of the initial 54-item MED-fLAG was conducted in 36 participants, namely 13 home-dwelling older adults and/or informal caregivers and 23 healthcare professionals. Six rounds of revisions were performed to achieve content validity and to propose a 56-item revised MED-fLAG. Participants reported benefits of using a standardized assessment of medication literacy during a hospital stay but warned about certain limitations and prerequisites. The extent to which MED-fLAG could be integrated into discharge planning needs to be further investigated.

Conclusions

MED-fLAG is the first medication literacy measure tailored to the specific needs of older patients and informal caregivers. A unique feature of this measure is that it includes prescribed and non-prescribed medications, irrespective of the galenic form. Additional studies are required to evaluate the other measurement properties of MED-fLAG, and to reduce the number of items before considering its clinical application.

Supplementary Information

The online version contains supplementary material available at 10.1186/s41687-022-00495-2.

On the basis of what has been written about medication literacy and the experiences of experts, we developed a new questionnaire to measure medication literacy (MED-fLAG) in older adults and/or informal caregivers. MED-fLAG was then submitted to older adults, informal caregivers and healthcare professionals to retrieve their feedback concerning the relevance, comprehensibility and exhaustiveness of the proposed items. In future, MED-fLAG will allow health professionals to evaluate medication literacy skills in older patients during hospitalization and/or in their informal caregivers when they are responsible for preparing or administering the medications, and then propose individualised support.

The role of patient and public involvement and engagement (PPIE) within the development of the EQ Health and Wellbeing (EQ-HWB)

Objectives

The value of patient and public involvement and engagement (PPIE) within the development and refinement of outcome measures is becoming increasingly recognized. The aim of this paper is to provide an overview of how PPIE was integrated within the development of a new measure designed for use in economic evaluations across health and social care, the EQ Health and Wellbeing (EQ-HWB™).

Methods

Four PPIE sessions were held at key stages. Discussions from each session and the outcome of any tasks were shared with the wider research team and used to help inform decision-making.

Results and discussion

PPIE covered several components of outcome measure development including; review of conceptual model; discussion on sub-domain inclusion; item refinement and reduction; pre-testing of items; selection of items for the measure; and design of the measure. Key learning points for future projects were highlighted including; consideration of practicalities, resources and logistics of PPIE activities; how sessions and activities are managed effectively; and how to managing expectations and communication from both researcher and PPIE perspectives.

Conclusions

The PPIE group provided invaluable insight into perspectives of future patients and carers. Their input was fed into a number of developmental stages. The formal involvement from the PPIE group meant that the voice of the general public was heard. This helped ensure the appropriateness of the design of the final measure.

Patient-reported outcome measures in MS: Do development processes and patient involvement support valid quantification of clinically important variables?

Background

Patient-reported outcomes (PROs) are widely measured in multiple sclerosis (MS) studies. However, the quality of instrument development processes varies, raising concerns about the meaningfulness of associated data.

Objectives

To review the development of selected PROs commonly used in MS studies, including definitions of the concepts measured, use of conceptual frameworks, and degree of input from people living with MS (PlwMS). To gain insights and recommendations from PlwMS on their experience with these PROs.

Methods

We assessed 6 PROs (FSIQ-RMS, modified-FIS, MSQoL-54, Leeds 8-item MSQoL, MSIS-29 and EQ-5D) for alignment with regulatory and scientific requirements on PRO structure/development. PlwMS evaluated the degree to which the PROs reflect disease aspects they perceive important.

Results

Definitions, clarifications and conceptualisations of the measurement variables were often lacking. PlwMS were variably involved in PRO development. Ethnic diversity was rarely documented. PlwMS identified individualisation, ease of understanding, time burden, and mode of administration as factors affecting PRO usability.

Conclusions

To date, the PRO development process has consistently lacked clear definitions of concepts of interest, use of conceptual frameworks and patient involvement, thereby compromising the validity of data they generate. PRO instrument development must be conducted more robustly to maximise the value of pivotal clinical trials.

A Comparison of a Preliminary Version of the EQ-HWB Short and the 5-Level Version EQ-5D

OBJECTIVES

The EQ Health and Wellbeing Short (EQ-HWB-S) is a new broad generic measure of health and wellbeing for use in economic evaluations of interventions across healthcare, social care, and public health. This measure conceptually overlaps with the 5-level version EQ-5D (EQ-5D-5L), while expanding on the coverage of health and social care related dimensions. This study aims to examine the extent to which the EQ-HWB-S and EQ-5D-5L overlap and are different.

METHODS

A sample of US-based respondents (n = 903; n = 400 cancer survivors and n = 503 general population) completed a survey administered via an online panel. The survey included the EQ-HWB item pool (62 items, including 11 items used in this analysis), EQ-5D-5L, and questions about sociodemographic and health characteristics. The analysis included (Spearman's) correlations, the comparison of patterns of response (distributions and ceiling effects), and the ability to discriminate between known groups.

RESULTS

Moderate to strong associations were found between conceptually overlapping dimensions of the EQ-5D-5L and the EQ-HWB-S (r_s > 0.5, P < .001). Among respondents reporting full health on the EQ-5D-5L (n = 161, 18.23%), the EQ-HWB-S identified ceiling effects, particularly with the item "feeling exhausted." Most EQ-5D-5L and EQ-HWB-S items demonstrated discriminative ability among those with and without physical and mental conditions, yielding medium (> 0.5) to large effect sizes (> 0.8). Nevertheless, only EQ-HWB-S items distinguished between caregivers and noncaregivers and those with low and high caregiver burden, albeit with small effect sizes (0.2-0.5).

CONCLUSIONS

Results indicate a convergence between the measures, especially between overlapping dimensions, lending support to the validity of the EQ-HWB-S. The EQ-HWB-S performed similarly or better than the EQ-5D-5L among patient groups and is better able to differentiate among caregivers and respondents closer to full health.

Priority recommendations for the implementation of patient-reported outcomes in clinical cancer care: a Delphi study

Purpose

The aim of this study was to develop priority recommendations for the service level implementation of patient-reported outcomes (PROs) into clinical cancer care.

Methods

Development of draft guidance statements was informed by a literature review, the Knowledge to Action (KTA) implementation framework, and discussion with PRO experts and cancer survivors. A two-round modified Delphi survey with key stakeholders including cancer survivors, clinical and research experts, and Information Technology specialists was undertaken. Round 1 rated the importance of the statements and round 2 ranked statements in order of priority.

Results

Round 1 was completed by 70 participants with round 2 completed by 45 participants. Forty-seven statements were rated in round 2. In round 1, the highest agreement items (>90% agreement) included those that focused on the formation of strong stakeholder partnerships, ensuring ongoing communication within these partnerships, and the use of PROs for improvement and guidance in clinical care. Items ranked as the highest priorities in round 2 included assessment of current staff capabilities and service requirements, mapping of workflows and processes to enable collection, and using collected PROs to guide improved health outcomes.

Conclusions

This stakeholder consultation process has identified key priorities in PRO implementation into clinical cancer care that include clinical relevance, stakeholder engagement, communication, and integration within the existing processes and capabilities.

Implication for Cancer Survivors

Routine adoption of PRO collection by clinical cancer services requires multiple implementation steps; of highest priority is strong engagement and communication with key stakeholders including cancer survivors.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11764-021-01135-2.

Measuring Duchenne muscular dystrophy impact: development of a proxy-reported measure derived from PROMIS item banks

BACKGROUND

Person-reported outcomes measurement development for rare diseases has lagged behind that of more common diseases. In studies of caregivers of patients with rare diseases, one relies on proxy report to characterize this disability. It is important to measure the child's disability accurately and comprehensively because it affects caregiver burden. We aimed to create a condition-specific caregiver proxy-report measure for Duchenne Muscular Dystrophy (DMD) in order to understand the impact of DMD on the caregiver. Drawing on relevant item banks from the Patient-Reported Outcome Measurement Information System (PROMIS), we sought to confirm their reliability and validity in the target sample of DMD caregivers.

METHODS

This web-based study recruited DMD caregivers via Rare Patient Voice, patient-advocacy groups, and word of mouth. Recruitment was stratified by age of the caregiver's child with DMD, which broadly represents stages of DMD progression: 2-7, 8-12, 13-17, and > 18. Telephone interviews with DMD parent-caregivers pretested possible measures for content validity. The web-based study utilized an algorithm to categorize respondents' ambulatory status for tailored administration of PROMIS Parent-Proxy items as well as some new items developed based on caregiver interviews. Item response theory analyses were implemented.

RESULTS

The study sample included 521 DMD caregivers representing equally the four age strata. The proxy-report measure included the following domains: fatigue impact, strength impact, cognitive function, upper extremity function, positive affect, negative affect, sleep-device symptoms, and mobility. The first five domains had strong psychometric characteristics (unidimensionality; acceptable model fit; strong standardized factor loadings; high marginal reliability). Negative Affect, covering anger, anxiety, depressive symptoms, and psychological stress, fit a bifactor model with good model fit, high marginal reliability, and strong factor loadings. The Sleep-device symptoms domain was not unidimensional, and the mobility domain did not have a simple structure due to residual correlations among items at opposite end of the mobility-disability continuum. These two domain scores were retained as clinimetric indices (i.e., uncalibrated scales), to achieve the overall goal of having a content-valid DMD-specific measure across all stages of disease severity.

CONCLUSIONS

The present study derived a DMD-specific proxy-report measure from PROMIS item banks and supplemental items that could potentially be utilized in caregiver research across all stages of the care recipient's DMD. Future research will focus on assessing the responsiveness and validity of the measure over time and its comparison to DMD patient self-report.

Clinimetric Criteria for Patient-Reported Outcome Measures

Patient-reported outcome measures (PROMs) are self-rated scales and indices developed to improve the detection of the patients' subjective experience. Given that a considerable number of PROMs are available, it is important to evaluate their validity and usefulness in a specific research or clinical setting. Published guidelines, based on psychometric criteria, do not fit in with the complexity of clinical challenges, because of their quest for homogeneity of components and inadequate attention to sensitivity. Psychometric theory has stifled the field and led to the routine use of scales widely accepted yet with a history of poor performance. Clinimetrics, the science of clinical measurements, may provide a more suitable conceptual and methodological framework. The aims of this paper are to outline the major limitations of the psychometric model and to provide criteria for clinimetric patient-reported outcome measures (CLIPROMs). The characteristics related to reliability, sensitivity, validity, and clinical utility of instruments are critically reviewed, with particular reference to the differences between clinimetric and psychometric approaches. Of note is the fact that PROMs, rating scales, and indices developed according to psychometric criteria may display relevant clinimetric properties. The present paper underpins the importance of the clini-metric methodology in choosing the appropriate PROMs. CLIPROM criteria may also guide the development of new indices and the validation of existing PROMs to be employed in clinical settings.

The suitability of patient-reported outcome measures used to assess the impact of hypoglycaemia on quality of life in people with diabetes: a systematic review using COSMIN methods

AIMS/HYPOTHESIS

It is generally accepted that hypoglycaemia can negatively impact the quality of life (QoL) of people living with diabetes. However, the suitability of patient-reported outcome measures (PROMs) used to assess this impact is unclear. The aim of this systematic review was to identify PROMs used to assess the impact of hypoglycaemia on QoL and examine their quality and psychometric properties.

METHODS

Systematic searches (MEDLINE, EMBASE, PsycINFO, CINAHL and The Cochrane Library databases) were undertaken to identify published articles reporting on the development or validation of hypoglycaemia-specific PROMs used to assess the impact of hypoglycaemia on QoL (or domains of QoL) in adults with diabetes. A protocol was developed and registered with PROSPERO (registration no. CRD42019125153). Studies were assessed for inclusion at title/abstract stage by one reviewer. Full-text articles were scrutinised where considered relevant or potentially relevant or where doubt existed. Twenty per cent of articles were assessed by a second reviewer. PROMS were evaluated, according to COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) guidelines, and data were extracted independently by two reviewers against COSMIN criteria. Assessment of each PROM's content validity included reviewer ratings (N = 16) of relevance, comprehensiveness and comprehensibility: by researchers (n = 6); clinicians (n = 6); and adults with diabetes (n = 4).

RESULTS

Of the 214 PROMs used to assess the impact of hypoglycaemia on QoL (or domains of QoL), seven hypoglycaemia-specific PROMS were identified and subjected to full evaluation: the Fear of Hypoglycemia 15-item scale; the Hypoglycemia Fear Survey; the Hypoglycemia Fear Survey version II; the Hypoglycemia Fear Survey-II short-form; the Hypoglycemic Attitudes and Behavior Scale; the Hypoglycemic Confidence Scale; and the QoLHYPO questionnaire. Content validity was rated as 'inconsistent', with most as '(very) low' quality, while structural validity was deemed 'unsatisfactory'. Other measurement properties (e.g. reliability) varied, and evidence gaps were apparent across all PROMs. None of the identified studies addressed cross-cultural validity or measurement error. Criterion validity and responsiveness were not assessed due to the lack of a 'gold standard' measure of the impact of hypoglycaemia on QoL against which to compare the PROMS.

CONCLUSIONS/INTERPRETATION

None of the hypoglycaemia-specific PROMs identified had sufficient evidence to demonstrate satisfactory validity, reliability and responsiveness. All were limited in terms of content and structural validity, which restricts their utility for assessing the impact of hypoglycaemia on QoL in the clinic or research setting. Further research is needed to address the content validity of existing PROMs, or the development of new PROM(s), for the purpose of assessing the impact of hypoglycaemia on QoL.

PROSPERO REGISTRATION

CRD42019125153.

Overlap of Depressive Symptoms with Health-Related Quality-of-Life Measures

Because depressive symptoms are a part of health-related quality-of-life (HRQOL) measures, measures of depression will be empirically associated with HRQOL. We discuss examples of published research where authors ignored or did not fully account for overlap between depressive symptom and HRQOL measures. Future researchers need to recognize when their models include conceptually similar variables on the same side or both sides of the equation. This awareness will lead to more accurate conclusions about the prognostic value of depression and other HRQOL measures for health care utilization, mortality, and other outcomes. It will also result in fewer incorrect claims about the effect of depression on HRQOL.

Creativity in public involvement: supporting authentic collaboration and inclusive research with seldom heard voices

BACKGROUND

The role of public involvement (PI) in healthcare research is growing in importance and it is imperative that researchers continuously reflect on how to promote the inclusion of patients and service users in the design and delivery of research. PI offers a mechanism for end-users to be involved planning, executing, and reporting research. Some patient groups, including people who have communication difficulties, may struggle to engage in the methods traditionally employed to promote PI engagement such as questionnaires and focus groups.

METHODS

This article describes a longitudinal case-study of a PI group, consisting of people who have communication difficulties, for a patient-reported outcome development project. Creative methods, informed by the participatory design principles of enacting, seeing and doing, were introduced stepwise into seven PI meetings. Data from video and visual minutes were used to evaluate the impact of the methods, following each group. Feedback, in the form of verbal and visual outputs taken directly from group meeting minutes, along with vignettes evidenced the impact of the methods on the project and group members.

RESULTS

Creative methods enabled the PI group members to successfully contribute in meetings, to interact dynamically and to engage with the aims and processes of the research project. Their involvement facilitated the development of accessible recruitment materials, informed data analysis and supported the dissemination of project outputs. Employing creative methods also enabled both PI group members and the academic team to reflect on their own roles within the research project and the impact that their active involvement in the PI group has had on their personal development and perspectives on research.

CONCLUSION

The impact of using creative methods in PI for this patient-reported outcome measure (PROM) development project improved collaboration and understanding between PI members and the academic team. The authentic engagement of people who have communication difficulties in PI generated a more accessible project in terms of both process and impact. Creativity has applicability beyond people whose communication is non-verbal; it should be harnessed by research teams to identify and breakdown barriers to involvement to develop outcome tools that reflect the diversity of our populations.

Measuring quality of life in Duchenne muscular dystrophy: a systematic review of the content and structural validity of commonly used instruments

Duchenne muscular dystrophy (DMD) is an inherited X-linked neuromuscular disorder. A number of questionnaires are available to assess quality of life in DMD, but there are concerns about their validity. This systematic review aimed to appraise critically the content and structural validity of quality of life instruments for DMD. Five databases (EMBASE, MEDLINE, CINAHL, PsycINFO, and Cochrane Library) were searched, with supplementary searches in Google Scholar. We included articles with evidence on the content and/or structural validity of quality of life instruments in DMD, and/or instrument development. Evidence was evaluated against the Consensus-based Standards for the selection of health Measurement INstruments (COSMIN) criteria. Fifty five articles featured a questionnaire assessing quality of life in DMD. Forty instruments were extracted and 26 underwent assessment. Forty-one articles contained evidence on content or structural validity (including 37 development papers). Most instruments demonstrated low quality evidence and unsatisfactory or inconsistent validity in DMD, with the majority not featuring direct validation studies in this population. Only KIDSCREEN received an adequate rating for instrument design and a satisfactory result for content validity based on its development, yet, like the majority of PROMs, the measure has not been directly validated for use in DMD. Further research is needed on the validity of quality of life instruments in DMD, including content and structural validity studies in this population.

Increasing the Patient-Centeredness of Health Economics and Outcomes Research Through Patient Engagement in Core Outcome Set Development

Core outcome sets (COS) are becoming increasingly popular in clinical research and can provide important inputs for further health economics and outcomes research (HEOR) studies. Use of standard, consistently reported outcomes can demonstrate and allow differentiation of the effectiveness and value of different treatments. Incorporating patient values during COS development increases the patient centeredness of evidence available across decision-making contexts. However, the approach to meaningful patient engagement in the COS process is evolving and poses both unique challenges and opportunities. We describe an approach to patient-centered COS development and discuss challenges and adaptations to improve engagement across COS projects. We provide examples from our experience in patient engagement for COS development using three completed COS projects. This approach includes patient engagement in terms of partnering with patient organizations, orientation and training, and the consensus process. Including COS in clinical development programs and HEOR will ensure that relevant, consistent outcomes are available for healthcare decision making and should result in faster access to high-value and novel therapies for patients. Patient-centered COS development increases the likelihood that further HEOR studies and decisions made using the COS are relevant to patients.