How to develop a condition-specific PROM

Deep and Superficial Dyspareunia Questionnaire: a patient-reported outcome measure for genito-pelvic dyspareunia

INTRODUCTION

Dyspareunia affects 8%-22% of women worldwide and an unknown number of gender-diverse people. Dyspareunia is commonly categorized into deep and superficial subtypes based on pain location and underlying etiology; however, current assessment tools inadequately differentiate between pain locations.

AIM

This study aimed to develop a patient-reported outcome measure (PROM) that independently assesses deep and superficial dyspareunia and its psychosocial correlates: the Deep and Superficial Dyspareunia Questionnaire (DSDQ).

METHODS

The DSDQ development stages included item construction, categorization, review/revision, focus groups, cognitive interviews, final review, and factor analysis. Items were developed by reviewing pre-existing measures related to dyspareunia. Constructs of these measures were adapted to create items for the DSDQ. Developed items were categorized according to a conceptual framework. To review items, 4 patient partners, 2 gynecologists, and 1 psychiatrist participated in a modified eDelphi process. Next, 3 patient focus groups (n = 5, n = 3, n = 4), 1 clinician focus group (n = 2), and patient cognitive interviews (n = 15) were conducted over 2 rounds. A qualitative descriptive approach guided interview analysis, which informed DSDQ modifications and generated evidence of validity. Clinician-researchers (n = 4) and patient partners (n = 2) completed the final revision. Lastly, an exploratory factor analysis (EFA) and a confirmatory factor analysis (CFA) determined the most appropriate factor structure.

OUTCOMES

Generated items, validity, factor structure.

RESULTS

Fifty-nine pre-existing measures were reviewed to generate an initial pool of 163 items. Items created were categorized into domains for characteristics (pain quality, timing, location, and intensity) or psychosocial correlates (impact of pain on cognitions, affect, sexuality, and behavior). The eDelphi modified 40 items, added 23, and excluded 10. After the final review, 175 items were approved for psychometric analysis. The EFA supported a 103-item, 6-factor model. The CFA supported a 45-item, 6-factor model. Factors included: (1) Vaginal Opening Pain; (2) Deep Vaginal/Pelvic/Abdominal Pain; (3) Pain Interference; (4) Affect and Cognitions Related to Provoked Pain; (5) Sexual Distress Related to Sexual Well-being; and (6) Pain Self-efficacy.

CLINICAL IMPLICATIONS

The DSDQ will aid diagnosis, treatment, and assessment of dyspareunia changes over time in research and clinical settings.

STRENGTHS AND LIMITATIONS

Strengths of this work include DSDQ co-development with patient partners, multidisciplinary clinicians, and researchers, as well as the rigorous mixed-methods development. Limitations include demographic and clinical homogeneity of the patient samples and sample sizes for the EFA and CFA.

CONCLUSIONS

The DSDQ is a 45-item measure intended to assess deep and superficial dyspareunia. Future psychometric evaluation will further establish validity and reliability evidence.

A systematic review of patient-reported outcome measures for idiopathic adhesive capsulitis - recommendations based on analyses of 16 existing questionnaires

BACKGROUND

Patient reported outcome measures (PROMs) are essential to measure the patients' perspective in clinical studies. Like any measurement instrument, a PROM should be valid, reliable, and responsive. Adequate content validity relies on patient input, while construct validity can only be ensured by Modern Test Theory (MTT) models. Inadequate PROMs induce a significant risk of measurement errors. Currently, there is no thorough analysis of PROMs used in clinical research on idiopathic adhesive capsulitis (AC). The aim was to identify all PROMs used to evaluate AC, analyze their content and construct validity, and summarize the results in a recommendation on which PROM is the best for trials on AC.

METHODS

Musculoskeletal PROMs used to evaluate patients with AC were identified through PubMed searches in November 2024. Development and validity studies were identified for each PROM. Content validity was assessed based on existing guidelines emphasizing the involvement of patients in the development. Construct validity was assessed based on existing guidelines emphasizing the use of MTT models in the analysis. Both content and construct validity were rated from 1 to 5, and a concluding, aggregated assessment was made.

RESULTS

16 different PROMs, used up to 45 times, were identified. 79 articles on measurement properties were identified and analyzed. None of the PROMs had been developed specifically for patients with AC. Four PROMs were developed by the involvement of patients but with other conditions than AC. Five PROMs had been validated with an MTT model. However, all five possessed inadequate content validity. Hence, it was not possible to identify any PROM with adequate content and construct validity for patients with AC.

CONCLUSION

An adequate PROM for idiopathic AC does not exist and a new condition-specific questionnaire is needed. The existing PROMs should be used with significant reservations and results obtained by these PROMs should be interpreted with caution.

Patient-reported outcome measures (PROMs) used among liver transplant recipients: a systematic review and methodological quality appraisal

AIM

To identify instruments used to measure patient-reported outcomes after LT, and critically evaluate their measurement properties.

METHODS

Five online databases were searched to find English-language LT-specific PROMs from their inception to October 2024. Studies describing the development or validation of PROMs were included. Two reviewers extracted and synthesized information about the characteristics of the studies and instruments. The methodological quality of the included studies was evaluated using the Consensus-Based Standards for the Selection of Health Measurement Instrument (COSMIN). Two reviewers independently evaluated the methodological quality of the included instruments.

RESULTS

A total of 17 studies involving 14 PROMs met the inclusion criteria and were included in this review. The included PROMs assessed a range of outcomes, including health-related quality of life, therapeutic adherence, symptom experience, social participation, feeling for the donor, satisfaction and informational needs. None of the 14 scales reported the ten boxes of measurement properties outlined by the COSMIN. Among all the measurement properties, content validity from expert (64.3%, 9/14) and internal consistency (57.1%, 8/14) were the two most frequently measured attributes. Less than half of the studies evaluated the content validity from the patients' perspective. Four studies evaluated structural validity using exploratory factor analysis, but no study conducted confirmatory factor analysis or used IRT method to measure the structural validity.

CONCLUSION

This systematic review provided an overall picture and detailed analysis of LT-specific PROMs, and highlighted the paucity of well-developed and validated instruments. Further studies are urgently needed, both in terms of exploring patients' health concerns after LT and validating the instruments.

REPORTING METHOD

This study is reported according to the PRISMA Statement.

Understanding data visualization techniques in qualitative studies used to develop and validate patient-reported outcome measures: a targeted literature review

PURPOSE

Qualitative data that reflects patients' experiences are the foundation of any patient-reported outcome measure (PROM) development and validation study; however, there is limited understanding of the type of data visualization techniques that facilitate communication of this data. The goal of this targeted literature review was to investigate data visualization methods that have been used in published PROM development and validation literature to report qualitative results.

METHODS

A literature search in OVID via MEDLINE was conducted among the top 10 non-disease-specific journals publishing PROM qualitative development and validation studies. Studies that reported qualitative methods to develop/validate a PROM and included data visualization in the form of tables or figures were included. Article characteristics and data visualization types were extracted.

RESULTS

A total of 185 articles were included in data extraction. Most articles (n = 109, 59.1%) included figures (n = 172, average 2 relevant figures per article) in the form of hierarchy/flowcharts (n = 124, 72.1%) and bar charts (n = 29, 16.9%). Information reported in figures included depiction of conceptual frameworks (n = 112, 65.1%) and concept frequency (n = 40, 24.4%). Most articles (n = 152, 81.7%) included tables (n = 307, average 2 relevant tables per article). Information reported in tables included concept frequency (n = 133, 43.3%) and cognitive debriefing and revisions (n = 91, 29.6%).

CONCLUSION

Data visualization techniques used to report qualitative results in the identified PROM qualitative development and validation studies were heterogeneous, and many studies did not utilize any data visualization techniques. This study will inform the development of guidance for using data visualizations to report qualitative PROM research.

Health-related quality of life for children with anterior cruciate ligament deficiency: Ensuring content validity of the new KIDS-KNEES-ACL questionnaire

PURPOSE

The existing knee-specific pediatric patient-reported outcome measures (PROMs) lack content and construct validity for children with anterior cruciate ligament (ACL) injury. This impairs their accuracy which can lead to false interpretations of data and inaccurate clinical guidelines. The purpose of this study was to develop a content-valid PROM for children with an ACL injury.

METHODS

The process adhered to the COnsensus-based Standards for the selection of health Measurement INstruments guidelines for PROM development. Informants were children with ACL deficiency and sampled based on age, sex, and treatment. Semistructured interviews were conducted exploring themes within the International Classification of Functioning, Disability and Health model. Interviews continued beyond data saturation. By thematic analysis and by probing items from the adult PROM 'KNEES-ACL', new themes and items emerged. Content coverage, relevance and understandability were continuously evaluated. All interviews were recorded and transcribed verbatim. The NVivo 12 software was used for data analysis and coding of items.

RESULTS

A PROM of 60 items across nine subscales was formed. From cognitive interviews, 19 new items emerged. Forty-one of 55 items from KNEES-ACL were endorsed as relevant; however, all required rewording to ensure understandability. Substantial differences in the psychosocial impact between adults and children were observed. The children experienced a more considerable negative psychosocial impact caused by a loss of participation in sports, lower self-confidence and loss of social networks. This resulted in four new domains. The physical issues were similar to adults, with few exceptions.

CONCLUSION

The 'KIDS-KNEES-ACL' 1.0 (qualitative version) was developed. This version will be subjected to psychometric analysis, resulting in adequate measurement properties of the final KIDS-KNEES-ACL 2.0. As the only adequate pediatric ACL-specific PROM, its use in clinical trials and databases will enhance PROM data quality, and strengthen clinical guidelines and thus the treatment of children with ACL injury.

LEVEL OF EVIDENCE

Not applicable.

Development of a PROM to measure patient-centredness in chronic care consultations in primary care

INTRODUCTION

Validated patient-reported outcome measures (PROMs) are crucial for assessing patients' experiences in the healthcare system. Both clinically and theoretically, patient-centered consultations are essential in patient-care, and are often suggested as the optimal strategy in caring for patients with multimorbidity.

AIM

To either identify or develop and validate a patient-reported outcome measure (PROM) to assess patient-centredness in consultations for patients with multimorbidity in general practice.

METHODS

We attempted to identify an existing PROM through a systematic literature review. If a suitable PROM was not identified, we planned to (1) construct a draft PROM based on items from existing PROMs, (2) conduct group and individual interviews among members of the target population to ensure comprehensibility, comprehensiveness and relevance, and (3) perform a psychometric validation in a broad sample of patients from primary care.

RESULTS

We did not identify an eligible PROM in the literature review. The item extraction and face validity meetings resulted in a new PROM consisting of 47 items divided into five domains: biopsychosocial perspective; `patient-as-person'; sharing power and responsibility; therapeutic alliance; and coordinated care. The interviews resulted in a number of changes to the layout and phrasing as well as the deletion of items. The PROM used in the psychometric validation consisted of 28 items. Psychometric validation showed high internal consistency, overall high reliability, and moderate fit indices in the confirmatory factor analysis for all five domains. Few items demonstrated differential item functioning concerning variables such as age, sex, and education.

CONCLUSIONS

This study successfully developed and validated a PROM to measure patient-centredness in consultations for patients with multimorbidity. The five domains demonstrated high reliability and validity, making it a valuable tool for measuring patient-centredness of consultations in general practice.

TRIAL REGISTRATION

Trial registration number (data for psychometric validation): https://clinicaltrials.gov : NCT05676541 Registration Date: 2022-12-16.

Development of ICF-based patient-reported outcome and experience measures to study social participation among people with chronic diseases: a mixed-methods protocol

INTRODUCTION

Living with a chronic disease impacts many aspects of life, including the ability to participate in activities that enable interactions with others in society, that is, social participation (SP). Despite efforts to monitor the quality of care and life of chronically ill people in Belgium, no disease-specific patient-reported measures (PRMs) have been used. These tools are essential to understand SP and to develop evidence-based recommendations to support its improvement. This protocol presents the phases for the disease-specific development of patient-reported outcome and experience measures to assess SP and its potential determinants among people living in Belgium with cancer, cystic fibrosis, diabetes, HIV or a neuromuscular disease.

METHODS AND ANALYSIS

This protocol applies the PROMIS Instrument Development and Validation Scientific Standards and COnsensus-based Standards for the selection of health Measurement INstruments to develop PRMs in a disease-specific manner to quantify the components of the International Classification of Functioning, Disability and Health (ICF). A mixed-method approach is used to create broad initial item pools based on patient (focus groups) and literature perspectives which are compared within ICF-standardised language by applying the refined ICF linking rules. An item set is first created based on this cross-matching exercise and then validated by multidisciplinary expert panels. Cognitive assessment and pilot testing are followed by the dissemination of the survey to a representative sample in Belgium. Advanced psychometric testing (classical test theory and item response theory) is applied to inform an item reduction strategy for the final measures and to develop scales for the ICF components.

ETHICS AND DISSEMINATION

Ethical approval was granted by the Ethics Committee of the Ghent University Hospital on 20 February 2023 to organise the patient focus groups (ONZ-2022-0470). Ethical approval for dissemination of the PRMs and psychometric testing will be sought at the Ghent University Hospital Ethics Committee at the start of Phase 6. Results will be disseminated through peer-reviewed journals and professional conferences.

Measurement of acute postoperative pain intensity in orthopedic trials: a qualitative concept elicitation study

BACKGROUND AND PURPOSE

Pain intensity is an important outcome in clinical trials of surgery because pain relief is important to patients. Currently, recommended scales are the numeric rating scale 0-10 and visual analogue scale. However, these scales allow for considerable influence of individual imagination, previous experience, and coping skills, limiting proficiency in comparative clinical trials. We aimed to explore postoperative expressions of "how much it hurts"-the first step to improve pain intensity measurement.

METHODS

This was a qualitative study using inductive content analysis: words and visual cues describing pain intensity were collected from (i) existing pain intensity measures by search of COSMIN, PubMed, and Google, (ii) patient interviews recorded and transcribed word-for-word, (iii) clinician interviews transcribed likewise, and (iv) 100 patient telephone interviews with notes taken. After familiarization, the collected expressions were labelled inductively in categories and assembled in tables (case and theme-based matrices).

RESULTS

Descriptors fell into 12 categories: intensity (slight/strong), evaluative (negligible/unbearable), cognitive impact (distracting/can be ignored), activity impact (limits some/all activity), sleep impact (can/cannot sleep), examples (like stubbing a toe), physical signs (crying/writhing), associated symptoms (nauseating/tiring), treatment (ice helps/need morphine), affective (annoying/dreadful), discriminative (aching/piercing), and general recovery (hindering recovery/functional interference). Many visual cues were also identified. Literature and recorded interviews gave rise to the categories, and telephone interviews found saturation, providing no further categories.

CONCLUSION

Pain intensity is expressed by terms that fall into 12 categories and by a variety of graphic elements. This advances development of a patient-reported outcome measure of pain intensity for orthopedic trials.

The Influence of Kinesiophobia and Pain Catastrophizing on Disease-Specific Quality of Life in Patients With Recurrent Patellofemoral Instability

BACKGROUND

The Banff Patellofemoral Instability Instrument 2.0 (BPII 2.0) is a disease-specific, quality of life patient-reported outcome measure (PROM) that is valid and reliable in patients with recurrent lateral patellofemoral instability (LPI). Quality of life encompasses the physical, emotional, and psychological aspects of patient functioning and recovery.

PURPOSES

To concurrently validate the BPII 2.0 to the Tampa Scale for Kinesiophobia (TSK-11), the Pain Catastrophizing Scale (PCS), and the Anterior Cruciate Ligament-Return to Sport after Injury Scale (ACL-RSI) in patients presenting with recurrent LPI and to assess baseline values for the PROMs in patients with LPI.

STUDY DESIGN

Cohort study (Diagnosis); Level of evidence, 2.

METHODS

A total of 107 consecutive patients with recurrent LPI were assessed between January and October 2021. Patients completed the BPII 2.0, TSK-11, PCS, and ACL-RSI. A Pearson r correlation coefficient was employed to examine relationships between the PROMs. Baseline values, as well as floor and ceiling effects and Cronbach alpha, were assessed for all PROMs.

RESULTS

All 107 patients completed the 4 PROMs. Patients included 28 men (26.2%) and 79 women (73.8%), with a mean (SD) age of 25.7 (9.8) years. The mean (SD) age at first dislocation was 14.8 (6.3) years. The TSK-11, PCS, and ACL-RSI were all statistically significantly correlated with the BPII 2.0 (P < .01; 2-tailed), with moderate correlations (r = -0.361-0.628) The R2 values indicated an overlap of the constructs measured by the PROMs.

CONCLUSION

A statistically significant correlation was evident between the BPII 2.0 and the other PROMs. The BPII 2.0 does not explicitly measure kinesiophobia or pain catastrophizing; however, the significant statistical relationship of the TSK-11 and PCS to the BPII 2.0 suggests that this information is being captured and reflected.

Item generation for a new patient-reported outcome measure: The non-traumatic anterior knee pain (AKP)-YOUTH scale

BACKGROUND

Non-traumatic anterior knee pain affects one in every five adolescents. Despite the commonality of the condition, there are no patient-reported outcome measures developed specifically for this population. The aim of this study was to identify domains and develop a preliminary item bank for adolescents with non-traumatic anterior knee pain.

PARTICIPANTS

Twenty-one adolescents with anterior knee pain participated in semi-structured interviews which explored their experience of living with knee pain. Following thematic analysis, we generated an item bank based on the domains which emerged from the impact their knee pain had on their daily life. Ten clinical experts provided input on the preliminary item bank via an online survey. Cognitive interviews were conducted using the think-aloud approach with ten adolescents to evaluate the comprehensibility and face validity of the items.

RESULTS

From the interviews we identified four overarching domains where adolescents were impacted by their knee pain: knee symptoms, limitations in physical activity/sport, limitations in social activities, and emotional impact of pain. Eighteen items were initially developed and expanded to 23 following clinical expert input. The cognitive interviews with adolescents demonstrated that the items were comprehensive, understandable, and relevant for adolescents.

CONCLUSION

This study developed an item bank of 23 items. These spanned four domains of impact for adolescents with anterior knee pain. The items had good face validity and were deemed relevant and understandable for adolescents with knee pain. Further steps are needed to validate and reduce the items for the non-traumatic anterior knee pain (AKP)-YOUTH scale.

English Translation and Cultural Adaptation of the Knee Numeric-Entity Evaluation Score (KNEES-ACL): A Condition-Specific Patient-Reported Outcome Measure for Anterior Cruciate Ligament Injuries

BACKGROUND

The Knee Numeric-Entity Evaluation Score (KNEES-ACL) is a 41-item condition-specific patient-reported outcome measure (PROM) that was developed for patients with an anterior cruciate ligament (ACL) deficiency and patients after ACL reconstruction. This measure is intended to be used for longitudinal clinical studies. The KNEES-ACL has demonstrated face and content validity and superior responsiveness compared with other PROMs commonly used in patients with an ACL injury. However, this PROM was developed in Danish and has not been appropriately translated and culturally adapted into North American English.

PURPOSE

To translate and culturally adapt the KNEES-ACL from Danish to North American English.

STUDY DESIGN

Cross-sectional study.

METHODS

Translation from Danish to English and cultural adaptation to a North American context were performed according to the dual panel method. First, the Danish KNEES-ACL was translated by a bilingual panel, which provided multiple English wording options for each item. Second, an English lay panel focus group was formed to determine the wording for each item that best reflected everyday spoken language. Finally, individual think-aloud cognitive interviews were conducted with patients after an ACL injury to evaluate the relevance, comprehensiveness, and comprehensibility of the PROM content and questions. Repeated modifications and testing were performed until a final English version of the KNEES-ACL was constructed.

RESULTS

Participants in the lay panel focus group were able to reach unanimous decisions for each of the 41 items. Further changes to 17 items were made after 8 think-aloud interviews with patients with ACL injuries at various time points to ensure that items were relevant and being interpreted consistently among different types of patients. The final KNEES-ACL consisted of 6 domains: Problems with Daily Activities, Mental Impact, Stability, Strength and Control, Pain, and Sport and Physical Activity.

CONCLUSION

The English KNEES-ACL for patients with ACL injuries has undergone appropriate translation and cultural adaptation using established dual panel and cognitive interviewing methods in the population of interest. The psychometric properties of the English KNEES-ACL will likely mirror those established with the Danish version. However, direct validation of the psychometric properties of the English version would be beneficial before widespread use.

Preliminary test of Polish translation of the Rheumatoid and Arthritis Outcome Score - observational study

Introduction

Today, patients with inflammatory joint diseases participate in more physical activities, including sports and recreation. The tools currently used to assess quality of life and functioning in rheumatic diseases, available in Polish, do not address these problems. The Rheumatoid and Arthritis Outcome Score (RAOS) questionnaire was developed but is not available in the Polish language. This tool is used to evaluate the functional limitations of physically active people who suffer from arthritis and associated lower limb disorders. The objective of this study is the translation and cross-cultural adaptation of the RAOS into Polish.

Material and methods

The process was carried out following the guidelines of the Evidence-Based Medicine Committee of the American Academy of Orthopaedic Surgeons (AAOS). The translation included forward and back translation, and synthesis of the transcripts. The RAOS was pre-tested in a target setting in 19 patients and final amendments were made to address concerns raised by the patients.

Results

The translation, adaptation, and pre-test of the Polish RAOS resulted in the final version of the scale, which can be found in Supplementary material 1.

Conclusions

During pre-testing, the scale demonstrated ease of understanding, with patient feedback leading to minor corrections that were incorporated into the questionnaire structure. Before widespread implementation, a crucial step involves validating the scale through rigorous psychometric tests, including assessments of the reliability, validity and stability of the Polish RAOS. The lack of validation of the translated Polish version limits the use of the RAOS in the research environment. To solve this problem, the validation process is planned to be carried out in the next stage.

Research and practice priorities in pilonidal sinus disease: a consensus from the PITSTOP study

AIM

Pilonidal sinus disease is a common condition treated by colorectal surgeons. There is a lack of literature in the field to guide optimal management of this condition. As part of the PITSTOP study, we aimed to identify policy and research priorities to provide direction to the field.

METHOD

Patients and surgeons were invited to participate. A 'So what, now what' exercise was conducted, informed by data from PITSTOP. This generated statements for research and practice priorities. A three-round online Delphi study was conducted, ranking statements based on policy and research separately. Statements were rated 1 (not important) to 9 (important). Statements that were rated 7-9 by more than 70% of participants were entered into the consensus meeting. Personalized voting feedback was shown between rounds. A face-to-face meeting was held to discuss statements, and participants were asked to rank statements using a weighted choice vote.

RESULTS

Twenty-two people participated in the focus group, generating 14 research and 19 policy statements. Statements were voted on by 56 participants in round 1, 53 in round 2 and 51 in round 3. A total of 15 policy statements and 19 research statements were discussed in the consensus round. Key policy statements addressed treatment strategies and intensity, surgeon training opportunities, need for classification and the impact of treatment on return to work. Research recommendations included design of future trials, methodology considerations and research questions.

CONCLUSION

This study has identified research and policy priorities in pilonidal sinus disease which are relevant to patients and clinicians. These should inform practice and future research.

The identification and measurement of postpartum anxiety in England: A Delphi survey

Postpartum anxiety has negative consequences for both mother and infant, so effective identification and measurement is vital to enable intervention. Despite NICE recommendations to prioritise the measurement of postpartum anxiety in mothers, current clinical measurement in England remains both fragmented and flawed. The Postpartum Specific Anxiety Scale [PSAS] offers an alternative, as it measures maternal-focused anxieties which can enable specifically targeted interventions. However, it is only currently used as a research tool and may require modification for clinical use. To inform modification of the PSAS, nineteen stakeholders from a variety of organisations participated in a two-round Delphi consensus survey to measure its clinical relevance and potential for effective identification of clinical anxiety. Descriptive analyses revealed all subscales of the PSAS scored highly across all domains, excluding Practical Infant Care Anxieties. Analyses also indicated good consensus between stakeholders across specific items, suggesting that the some items on the PSAS are relevant and effective at identifying clinical postpartum anxiety. Participants also expressed a need for a shorter version of the PSAS for clinical use, and that additional items may need including. Future research must now adapt the existing PSAS based on the results of this study and pilot the adapted measure in a clinical population.

Generating Items for Measuring Needs-Based Quality of Life and Self-Perceived Health Inequity in Patients with Multimorbidity: Development of the MultiMorbidity Questionnaire (MMQ)

Purpose

To describe the processes of developing domains and items for the MultiMorbidity Questionnaire (MMQ), a multimorbidity-specific PROM for the assessment of Needs-based QoL.

Patients and Methods

We developed items and domains for the MMQ through 17 qualitative content validity questionnaire interviews with adults with multimorbidity by testing items from an item bank (covering items with content inspired by existing Needs-based QoL measures for single diseases). The interviews alternated between an explorative part and more focused cognitive interview techniques.

Results

Testing the 47 items from the first draft of the MMQ items showed that the Needs-based approach as a framework did not cover all the QoL aspects our informants stated as being important. Therefore, the conceptual framework was supplemented by Self-perceived health inequity, and new items were generated. MMQ, measuring Needs-based QoL (MMQ1) and Self-perceived health inequity (MMQ2), was assembled. MMQ1 covers the domains: "Physical ability" (10 items), "Limitations in everyday life" (15 items), "Worries" (11 items), "My social life" (11 items), "Self-image" (12 items), and "Personal finances" (2 items). Self-perceived health inequity proved to be a relevant framework for other aspects of QoL not covered by the Needs-based approach to QoL. MMQ2 covers the domains: "Experiences of being stigmatized" (five items), "Experiences of not being seen and heard" (four items), "Insufficient understanding of the burden of disease" (three items) and "Experiences of feeling powerless" (five items).

Conclusion

We have developed the final MMQ draft, a multimorbidity-specific PROM for the assessment of Needs-based QoL (MMQ1) and Self-perceived health inequity (MMQ2) with high content validity (regarding content relevance and comprehensiveness). The final MMQ draft will be assessed for its psychometric properties using Modern Test Theory.

Introducing the participant-generated experience and satisfaction (PaGES) index: a novel, longitudinal mixed-methods evaluation tool

BACKGROUND

Patient-Reported Outcomes or Experience Measures (PROMS / PREMS) are routinely used in clinical studies to assess participants' views and experiences of trial interventions and related quality of life. Purely quantitative approaches lack the necessary detail and flexibility to understand the real-world impact of study interventions on participants, according to their own priorities. Conversely, purely qualitative assessments are time consuming and usually restricted to a small, possibly unrepresentative, sub-sample. This paper, which reports a pilot study within a randomised controlled trial of induction of labour, reports the feasibility, and acceptability of the Participant-Generated Experience and Satisfaction (PaGES) Index, a new mixed qualitative / quantitative PREM tool.

METHODS

The single-sheet PaGES Index was completed by hypertensive pregnant women in two hospitals in Nagpur, India before and after taking part in the 'Misoprostol or Oxytocin for Labour Induction' (MOLI) randomised controlled trial. Participants recorded aspects of the impending birth they considered most important, and then ranked them. After the birth, participants completed the PaGES Index again, this time also scoring their satisfaction with each item. Forms were completed on paper in the local language or in English, supported by Research Assistants. Following translation (when needed), responses were uploaded to a REDCap database, coded in Excel and analysed thematically. A formal qualitative evaluation (qMOLI) was also conducted to obtain stakeholder perspectives of the PaGES Index and the wider trial. Semi-structured interviews were conducted with participants, and focus groups with researchers and clinicians. Data were managed using NVivo 12 software and analysed using the framework approach.

RESULTS

Participants and researchers found the PaGES Index easy to complete and administer; mothers valued the opportunity to speak about their experience. Qualitative analysis of the initial 68 PaGES Index responses identified areas of commonality and difference among participants and also when comparing antenatal and postnatal responses. Theme citations and associated comments scores were fairly stable before and after the birth. The qMOLI phase, comprising 53 one-to-one interviews with participants and eight focus groups involving 83 researchers and clinicians, provided support that the PaGES Index was an acceptable and even helpful means of capturing participant perspectives.

CONCLUSIONS

Subjective participant experiences are an important aspect of clinical trials. The PaGES Index was found to be a feasible and acceptable measure that unites qualitative research's explanatory power with the comparative power of quantitative designs. It also offers the opportunity to conduct a before-and-after evaluation, allowing researchers to examine the expectations and actual experiences of all clinical trial participants, not just a small sub-sample. This study also shows that, with appropriate research assistant input, the PaGES Index can be used in different languages by participants with varying literacy levels.

TRIAL REGISTRATION

Clinical Trials.gov (21/11/2018) (NCT03749902).

Placing patient-reported outcomes at the centre of cardiovascular clinical practice: implications for quality of care and management

Patient-reported outcomes (PROs) provide important insights into patients' own perspectives about their health and medical condition, and there is evidence that their use can lead to improvements in the quality of care and to better-informed clinical decisions. Their application in cardiovascular populations has grown over the past decades. This statement describes what PROs are, and it provides an inventory of disease-specific and domain-specific PROs that have been developed for cardiovascular populations. International standards and quality indices have been published, which can guide the selection of PROs for clinical practice and in clinical trials and research; patients as well as experts in psychometrics should be involved in choosing which are most appropriate. Collaborations are needed to define criteria for using PROs to guide regulatory decisions, and the utility of PROs for comparing and monitoring the quality of care and for allocating resources should be evaluated. New sources for recording PROs include wearable digital health devices, medical registries, and electronic health record. Advice is given for the optimal use of PROs in shared clinical decision-making in cardiovascular medicine, and concerning future directions for their wider application.

Pedi-IKDC exhibits questionable measurement properties in a cohort of pediatric patients with ACL rupture

BACKGROUND

Pedi-IKDC is commonly used to evaluate anterior cruciate ligament (ACL) deficiency in children. However, its construct validity has not been thoroughly assessed. The aim was to examine the measurement properties of the Pediatric International Knee Documentation Committee (Pedi-IKDC) by modern test theory (MTT) models, confirmatory factor analysis (CFA), and item response theory (IRT).

METHODS

The cohort consisted of all children and adolescents in Denmark (n = 535, age 9-16) treated with physeal-sparing ACL reconstruction 2011-2020. Patient-reported outcome measure (PROM) data were collected before surgery and at 1 year follow-up. Structural validity of Pedi-IKDC was assessed with MTT models. Reliability was reported as McDonalds coefficient omega. Responsiveness was evaluated with standardized response means.

RESULTS

Sufficient PROM data were available for 372 patients. The original unidimensional construct did not fit CFA model expectations neither before surgery (χ2  = 462.0, df = 163, p < 0.0001; RMSEA: 0.109, CFI: 0.910, TFI: 0.895) nor at follow-up. Neither did a two-factor CFA model with "Symptoms" and "Sports activities" as individual subscales (χ2  = 455.6, df = 162, p < 0.0001) nor a bifactor model (χ2  = 338.9, df = 143, p < 0.0001), although fit indices improved with the latter (RMSEA: 0.094, CFI: 0.941, TFI: 0.922). The IRT models confirmed this pattern. The scale was responsive (SRM 1.66 (95% CI: 1.46-1.88)). Coefficient omega values were 0.866 before surgery and 0.919 at follow-up.

CONCLUSIONS

The Pedi-IKDC exhibited inadequate structural validity. Neither the original construct, a two-factor model, nor bifactor models fitted data well. We advise that data obtained by Pedi-IKDC are interpreted with caution.

Assessment of the Psychometric Properties of the Danish VISA-P

Purpose

The objective of the current study was to conduct a rigorous assessment of the psychometric properties of the Victorian Institute of Sports Assessment-patellar tendinopathy (VISA-P).

Methods

Rasch analysis, confirmatory factor analysis (CFA), and multivariable linear regression were used to assess the psychometric properties of the VISA-P questionnaire in 184 Danish patients with patellar tendinopathy who had symptoms ranging from under 3 months to over 1 year. A group of 100 healthy Danish persons was included as a reference for known-group validation.

Results

The analyses revealed that the 8-item VISA-P did not fit a unidimensional model, yielded at best a 3-factor model, and exhibited differential item functioning (DIF) across healthy subjects versus people with patellar tendinopathy.

Conclusion

VISA-P in its present form does not satisfy a measurement model and is not a robust scale for measuring patellar tendinopathy. A new PROM for patellar tendinopathy should be developed and appropriately validated, and meanwhile, simple pain scoring (e.g., numeric rating scales) and functional tests are suggested as more appropriate outcome measures for studies of patellar tendinopathy.

Patient Reported Outcome Measures in Adult Spinal Muscular Atrophy: A Scoping Review and Graphical Visualization of the Evidence

BACKGROUND

Spinal Muscular Atrophy (SMA) is a hereditary neuromuscular disease with an estimated prevalence of 1/10 000 births. SMA is increasingly recognized as a multi-system disease with a need to study additional under-recognized health domains such as quality of life, fatigue, bulbar function, respiratory function, and independence.

OBJECTIVE

Identify and assess reported evidence from the literature investigating Patient Reported Outcome Measures (PROMs) in adults with SMA. Develop a novel method drawing from network theory to graphically depict the literature, PROMs, and supporting psychometric evidence.

METHODS

A scoping review was completed following PRISM-ScR, COSMIN and JBI scoping review guidelines. Literature investigating PROMs in adult SMA or neuromuscular disease was identified from peer-reviewed and grey databases. A network graph was derived from extracted data.

RESULTS

5292 articles were retrieved, 81 articles met inclusion criteria; corresponding to 31 unique PROMs. Only two PROMs were developed specifically for SMA. Few PROMs covered multiple domains of health. Most PROMs were incompletely validated, focusing on concurrent validity, and few assessed responsiveness or internal consistency.

CONCLUSIONS

PROMs are emerging tools for monitoring and assessing adults with SMA. Despite their potential benefits, additional validation studies should be completed prior to their use for clinical decision-making. Network graphics may represent a technique to aid in the visualization of evidence supporting a scoping review.

Cross-cultural adaptation, reliability, and validity of the Persian version of the Lower Limb Functional Index

BACKGROUND

the Lower Limb Functional Index (LLFI) is a regional patient reported outcome measure (PROM) for evaluation of lower limb musculoskeletal functional status. No Persian-language (LLFI-Pr) version is available.

OBJECTIVES

LLFI translation and cross-cultural adaptation to Persian and psychometric property evaluation.

STUDY DESIGN

prospective diagnostic assessment.

METHODS

to establish the LLFI-Pr face and content validity, double forward-backward translation protocols were used plus cognitive interviews and the 'content validity index'(CVI). Psychometric properties were determined from a convenience sample (n = 307, age 47.18 ± 11.52 years, female = 58.3%) that concurrently completed the LLFI-Pr and Persian Lower Extremity Functional Scale (LEFS-Pr). Test-retest reliability (ICC_2,1, sub-sample, n = 64) was determined during a non-intervention period of 3-7 days. Internal consistency used Cronbach's Alpha (α), error used MDC_90/95 from the SEM, and construct validity used Pearson's r between the LLFI-Pr and LEFS-Pr. Construct validity used exploratory factor analysis (EFA, suppression = 0.30) with non-Gaussian distribution protocols.

RESULTS

psychometric properties were high for test-retest reliability (ICC_2,1 = 0.90) and internal consistency (α = 0.77), moderate for construct validity (r = 0.63), with no floor or ceiling effects, error found SEM = 1.60, MDC₉₀ = 3.7% and MDC₉₅ = 4.42%. A two-factor (EFA) structure (total-variance = 22.01%), that consequently cannot be summated, was determined where five-items failed consistent factor-loading leaving a 20-item version with a high original-LLFI total-equivalency (r = 0.97). However, the general/region-specific item-ratio reduced from the recognized 60/40 ratio to 50/50.

CONCLUSION

the 20-item LLFI-Pr is a valid two-factor solution with sound psychometric properties for research and clinical Persian-language populations with lower limb disorders.

Four of five frequently used orthopedic PROMs possess inadequate content validity: a COSMIN evaluation of the mHHS, HAGOS, IKDC-SKF, KOOS and KNEES-ACL

PURPOSE

Content validity is the most important property of PROMs. The COSMIN initiative has published guidelines for evaluating the content validity of PROMs, but they have only sparsely been applied to relevant PROMs for musculoskeletal conditions. The aim of this study was to use the COSMIN Risk of Bias checklist to evaluate the content validity of five PROMs, that are highly relevant in musculoskeletal research and used by the arthroscopic surgery community: the modified Harris' Hip Score (mHHS), the Copenhagen Hip and Groin Outcome Score (HAGOS), the International Knee Documentation Committee Subjective Knee evaluation Form (IKDC-SKF), the Knee injury and Osteoarthritis Outcome Score (KOOS) and the Knee Numeric-Entity Evaluation Score ACL (KNEES-ACL).

METHODS

The development articles for the five PROMs were identified through searches in PubMed and SCOPUS. A literature search was performed to identify additional studies assessing content validity of the PROMs. Additional information, necessary for the assessments, was obtained from the PROM developers after direct request. To evaluate the quality of the development studies and rate the content validity, the COSMIN Risk of Bias checklist was applied to all studies.

RESULTS

All five development studies were identified. Three subsequent content validity studies were identified, all evaluating KOOS and one also IKDC. One content validity study was of inadequate quality and excluded from further analysis. The development of mHHS, IKDC-SKF, and KOOS was rated inadequate and possess insufficient content validity for their target populations. Due to the irrelevance of multiple items, KOOS was in particular inappropriate to evaluate patients with an ACL injury. The development of HAGOS was also rated inadequate, although the insufficiency aspects can be regarded as minor. KNEES-ACL possessed sufficient content validity.

CONCLUSION

Out of five PROMs, only KNEES-ACL possessed sufficient content validity. Particularly, KOOS should not be used as an outcome for patients with an ACL injury. There is an urgent need for condition-specific PROMs for musculoskeletal conditions, developed with adequate methods.

LEVEL OF EVIDENCE

III.

Patient-reported outcome measures for pain in women with pelvic floor disorders: a systematic review

INTRODUCTION AND HYPOTHESIS

Patient-reported outcome measures (PROMs) are helpful instruments when measuring and reporting changes in patient health status (Al Sayah et al. J Patient Rep Outcomes 5 (Suppl 2):99, 2021) such as the health-related quality of life (HrQoL) of women with pelvic organ prolapse (POP) and stress urinary incontinence (SUI). The Australasian Pelvic Floor Procedure Registry (APFPR) aims to increase capacity for women to report surgical outcomes through the collection of HrQoL data (Ruseckaite et al. Qual Life Res. 2021) but currently lacks a pain-specific PROM for women with pelvic floor disorders (PFDs), particularly POP and SUI. This review aims to systematically review the existing literature and identify instruments that measure pain in women with POP and SUI for inclusion within the APFPR, which reports on complications from these conditions.

METHODS

We conducted a literature search on OVID MEDLINE, Embase, CINAHL, PsycINFO and EMCARE databases in addition to Google Scholar and grey literature to identify studies from inception to April 2021. Full-text studies were included if they used PROMs to measure pain in women with POP and SUI. Two authors independently screened articles, extracted data and assessed methodological quality.

RESULTS

From 2001 studies, 23 publications describing 19 different PROMs were included for analysis. Eight of these instruments were specific to the pelvic floor; four were only specific to pain and used across multiple disorders; three were generic quality of life instruments and four were other non-validated instruments such as focus group interviews. These instruments were not specific to pain in women with POP or SUI, as they did not identify all relevant domains such as the sensation, region and duration of pain, or incidents where onset of pain occurs.

CONCLUSIONS

The findings of this review suggest there are no current PROMs that are suitable pain-specific instruments for women with POP or SUI. This knowledge may inform and assist in the development of a new PROM to be implemented into the APFPR.

Patient reported outcome measure-haemorrhoidal impact and satisfaction score (PROM-HISS): Development, reliability and construct validity

AIM

Haemorrhoidal disease (HD) is a frequently occurring disorder with a significant negative impact on a patient's quality of life. Here, we describe the development and validation of the Dutch patient reported outcome measure-haemorrhoidal impact and satisfaction score (PROM-HISS).

METHODS

The development of the PROM-HISS followed recommended guidelines. Face and content validity, structural properties, reliability and construct validity were evaluated in a HD population. Reliability was tested by assessing the test-retest reliability, defined by the intraclass correlation coefficient (ICC), and internal consistency measured with Cronbach's alpha. Construct validity was evaluated using confirmatory factor analysis (CFA) and hypotheses testing.

RESULTS

The PROM-HISS consists of three domains: (1) HD symptoms (blood loss; pain; prolapse; soiling; itching), (2) impact of symptoms on daily activities, and (3) satisfaction with treatment. The PROM-HISS showed good face and content validity. The PROM-HISS was completed by 102 patients (65% male), with a mean age of 58 years (23-81 years). The ICCs of the different items in the domain HD symptoms ranged between 0.56 and 0.79 and were interpreted as good. The Cronbach's alpha value was 0.80 and considered satisfactory. The CFA provided further evidence for construct validity with a good model fit. A high score on the symptoms of HD correlated with a high impact of HD on daily activities (Pearson's r = 0.632, p < 0.01) and a low degree of satisfaction (Pearson's r = 0.378, p < 0.01).

CONCLUSION

The PROM-HISS is a reliable and valid instrument to evaluate symptoms of HD, impact on daily activities and satisfaction with treatment.

Dual-panel translation to Danish and Rasch validation of the Foot and Ankle Ability Measure (FAAM-DK)

BACKGROUND

The Foot and Ankle Ability Measure (FAAM) was developed by involvement of patients with chronic ankle instability (CAI) and has acceptable measurement properties, but is not available in Danish.

METHODS

FAAM was translated and culturally adapted into Danish, and its measurement properties were assessed using Rasch analyses.

RESULTS

A Danish version was produced with small adaptations, and content relevance was confirmed by Danish patients. The 21-item ADL domain showed misfit to the Rasch model, but after removing six items, the resulting 15-item scale displayed adequate fit. The Sports domain also exhibited misfit, but after removing one item and adjusting due to differential item functioning related to age for another item, a 7-item scale showed good fit. This resulted in a 22-item 2-dimensional Danish version of FAAM.

CONCLUSION

The 22-item Danish FAAM exhibits robust measurement properties for patients with various conditions of the lower leg, ankle, and foot, including CAI.

Tracking Systems in Team Sports: A Narrative Review of Applications of the Data and Sport Specific Analysis

Seeking to obtain a competitive advantage and manage the risk of injury, team sport organisations are investing in tracking systems that can quantify training and competition characteristics. It is expected that such information can support objective decision-making for the prescription and manipulation of training load. This narrative review aims to summarise, and critically evaluate, different tracking systems and their use within team sports. The selection of systems should be dependent upon the context of the sport and needs careful consideration by practitioners. The selection of metrics requires a critical process to be able to describe, plan, monitor and evaluate training and competition characteristics of each sport. An emerging consideration for tracking systems data is the selection of suitable time analysis, such as temporal durations, peak demands or time series segmentation, whose best use depends on the temporal characteristics of the sport. Finally, examples of characteristics and the application of tracking data across seven popular team sports are presented. Practitioners working in specific team sports are advised to follow a critical thinking process, with a healthy dose of scepticism and awareness of appropriate theoretical frameworks, where possible, when creating new or selecting an existing metric to profile team sport athletes.

A catalogue of PROMs in sports science: Quality assessment of PROM development and validation

Choosing the most adequate PROM for a study is a non-trivial process. The aim of this study was to provide a catalogue with analyses of content and construct validity of PROMs relevant to research in sports science, including all published local translations. The most commonly used PROMs in sports research were selected from a PubMed search "patient reported outcome measures sports", identifying 439 articles and 194 different PROMs. Articles describing development of the 61 selected PROMs were assessed for content validity, and all articles regarding construct validity of each PROM and all published translations (in total 622 articles) were analyzed. A catalogue with assessments of the 61 PROMs was produced. The majority were of inferior validity, with few exceptions. The most common reason for this was that the PROM had not been developed by methods that ensure high content validity. Another major reason for inferior validity was that construct validity had not been secured by adequate statistical methods. In conclusion, this catalogue provides a tool for researchers to facilitate choosing the most valid PROM for studies in sports research. Furthermore, it shows for popular PROMs where further validation is needed, and for fields in musculoskeletal medicine where valid PROMs are lacking. It is suggested that a targeted effort is made to develop valid PROMs for major conditions in musculoskeletal research. The current method is easier to practice compared with assessment after COSMIN guidelines.

Choosing the most appropriate PROM for clinical studies in sports medicine

Choosing the most appropriate patient-reported outcome measure (PROM) for a clinical study is essential in order to achieve trustworthy results. This choice will depend on (a) the objective of the study and hence the research question; (b) the choice of a theoretical framework, such as the World Health Organization's International Classification of Functioning, Disability, and Health (ICF); (c) whether there currently is a PROM that possesses high content validity and high construct validity for the specific patient group and objective, and if not; (d) the decision on whether to use a suboptimal PROM or develop and validate a new PROM. This paper presents the steps that should be followed in order to assess the relevance of PROMs and suggests ways to enhance the choice depending on the goal of the study.

Potential problems in the use of patient reported outcome measures (PROMs) and reporting of PROM data in sports science

To use an inadequate patient reported outcome measure (PROM) or use a PROM in an inappropriate way potentially influences the quality of measurement. The objectives of this study were to define potential inadequate uses of PROMs in sports research studies and estimate how often they occur. A consensus group consisting of medical researchers, statisticians, and psychometricians identified and defined potentially irregular applications of PROMs. Occurrence of these in 349 consecutive articles in sports medicine in which PROMs were used as primary outcomes was reviewed. In all, 14 different potential problems were defined, and one or several occurred in 172 of the articles (49%). These were as follows: using a PROM that was developed for a different patient group (100 cases), using two or more PROMs with identical questions (94), aggregation of domain sum scores (82), combinations of subjective and objective measures (27), using a PROM to diagnose or evaluate the individual patient (7), using a PROM for a single limb (3), recall bias (3), exclusion of domains or items (3), construction of a PROM for a specific occasion (2), categorization of the scale (2), and mixing different versions of a PROM (1). Adaption of scale scores (e. g., to percentage) when results are reported (144) carries a risk of miscalculation and distorted impression of results. Data related to uncertainty about completing the PROM and the handling of missing data were not provided in the manuscripts. In conclusion, potential problems in the use and reporting of PROMs are common in sports research, and this can influence the validity of reported results.