How to develop a condition-specific PROM

Research and practice priorities in pilonidal sinus disease: a consensus from the PITSTOP study

AIM

Pilonidal sinus disease is a common condition treated by colorectal surgeons. There is a lack of literature in the field to guide optimal management of this condition. As part of the PITSTOP study, we aimed to identify policy and research priorities to provide direction to the field.

METHOD

Patients and surgeons were invited to participate. A 'So what, now what' exercise was conducted, informed by data from PITSTOP. This generated statements for research and practice priorities. A three-round online Delphi study was conducted, ranking statements based on policy and research separately. Statements were rated 1 (not important) to 9 (important). Statements that were rated 7-9 by more than 70% of participants were entered into the consensus meeting. Personalized voting feedback was shown between rounds. A face-to-face meeting was held to discuss statements, and participants were asked to rank statements using a weighted choice vote.

RESULTS

Twenty-two people participated in the focus group, generating 14 research and 19 policy statements. Statements were voted on by 56 participants in round 1, 53 in round 2 and 51 in round 3. A total of 15 policy statements and 19 research statements were discussed in the consensus round. Key policy statements addressed treatment strategies and intensity, surgeon training opportunities, need for classification and the impact of treatment on return to work. Research recommendations included design of future trials, methodology considerations and research questions.

CONCLUSION

This study has identified research and policy priorities in pilonidal sinus disease which are relevant to patients and clinicians. These should inform practice and future research.

The identification and measurement of postpartum anxiety in England: A Delphi survey

Postpartum anxiety has negative consequences for both mother and infant, so effective identification and measurement is vital to enable intervention. Despite NICE recommendations to prioritise the measurement of postpartum anxiety in mothers, current clinical measurement in England remains both fragmented and flawed. The Postpartum Specific Anxiety Scale [PSAS] offers an alternative, as it measures maternal-focused anxieties which can enable specifically targeted interventions. However, it is only currently used as a research tool and may require modification for clinical use. To inform modification of the PSAS, nineteen stakeholders from a variety of organisations participated in a two-round Delphi consensus survey to measure its clinical relevance and potential for effective identification of clinical anxiety. Descriptive analyses revealed all subscales of the PSAS scored highly across all domains, excluding Practical Infant Care Anxieties. Analyses also indicated good consensus between stakeholders across specific items, suggesting that the some items on the PSAS are relevant and effective at identifying clinical postpartum anxiety. Participants also expressed a need for a shorter version of the PSAS for clinical use, and that additional items may need including. Future research must now adapt the existing PSAS based on the results of this study and pilot the adapted measure in a clinical population.

Generating Items for Measuring Needs-Based Quality of Life and Self-Perceived Health Inequity in Patients with Multimorbidity: Development of the MultiMorbidity Questionnaire (MMQ)

Purpose

To describe the processes of developing domains and items for the MultiMorbidity Questionnaire (MMQ), a multimorbidity-specific PROM for the assessment of Needs-based QoL.

Patients and Methods

We developed items and domains for the MMQ through 17 qualitative content validity questionnaire interviews with adults with multimorbidity by testing items from an item bank (covering items with content inspired by existing Needs-based QoL measures for single diseases). The interviews alternated between an explorative part and more focused cognitive interview techniques.

Results

Testing the 47 items from the first draft of the MMQ items showed that the Needs-based approach as a framework did not cover all the QoL aspects our informants stated as being important. Therefore, the conceptual framework was supplemented by Self-perceived health inequity, and new items were generated. MMQ, measuring Needs-based QoL (MMQ1) and Self-perceived health inequity (MMQ2), was assembled. MMQ1 covers the domains: "Physical ability" (10 items), "Limitations in everyday life" (15 items), "Worries" (11 items), "My social life" (11 items), "Self-image" (12 items), and "Personal finances" (2 items). Self-perceived health inequity proved to be a relevant framework for other aspects of QoL not covered by the Needs-based approach to QoL. MMQ2 covers the domains: "Experiences of being stigmatized" (five items), "Experiences of not being seen and heard" (four items), "Insufficient understanding of the burden of disease" (three items) and "Experiences of feeling powerless" (five items).

Conclusion

We have developed the final MMQ draft, a multimorbidity-specific PROM for the assessment of Needs-based QoL (MMQ1) and Self-perceived health inequity (MMQ2) with high content validity (regarding content relevance and comprehensiveness). The final MMQ draft will be assessed for its psychometric properties using Modern Test Theory.

Introducing the participant-generated experience and satisfaction (PaGES) index: a novel, longitudinal mixed-methods evaluation tool

BACKGROUND

Patient-Reported Outcomes or Experience Measures (PROMS / PREMS) are routinely used in clinical studies to assess participants' views and experiences of trial interventions and related quality of life. Purely quantitative approaches lack the necessary detail and flexibility to understand the real-world impact of study interventions on participants, according to their own priorities. Conversely, purely qualitative assessments are time consuming and usually restricted to a small, possibly unrepresentative, sub-sample. This paper, which reports a pilot study within a randomised controlled trial of induction of labour, reports the feasibility, and acceptability of the Participant-Generated Experience and Satisfaction (PaGES) Index, a new mixed qualitative / quantitative PREM tool.

METHODS

The single-sheet PaGES Index was completed by hypertensive pregnant women in two hospitals in Nagpur, India before and after taking part in the 'Misoprostol or Oxytocin for Labour Induction' (MOLI) randomised controlled trial. Participants recorded aspects of the impending birth they considered most important, and then ranked them. After the birth, participants completed the PaGES Index again, this time also scoring their satisfaction with each item. Forms were completed on paper in the local language or in English, supported by Research Assistants. Following translation (when needed), responses were uploaded to a REDCap database, coded in Excel and analysed thematically. A formal qualitative evaluation (qMOLI) was also conducted to obtain stakeholder perspectives of the PaGES Index and the wider trial. Semi-structured interviews were conducted with participants, and focus groups with researchers and clinicians. Data were managed using NVivo 12 software and analysed using the framework approach.

RESULTS

Participants and researchers found the PaGES Index easy to complete and administer; mothers valued the opportunity to speak about their experience. Qualitative analysis of the initial 68 PaGES Index responses identified areas of commonality and difference among participants and also when comparing antenatal and postnatal responses. Theme citations and associated comments scores were fairly stable before and after the birth. The qMOLI phase, comprising 53 one-to-one interviews with participants and eight focus groups involving 83 researchers and clinicians, provided support that the PaGES Index was an acceptable and even helpful means of capturing participant perspectives.

CONCLUSIONS

Subjective participant experiences are an important aspect of clinical trials. The PaGES Index was found to be a feasible and acceptable measure that unites qualitative research's explanatory power with the comparative power of quantitative designs. It also offers the opportunity to conduct a before-and-after evaluation, allowing researchers to examine the expectations and actual experiences of all clinical trial participants, not just a small sub-sample. This study also shows that, with appropriate research assistant input, the PaGES Index can be used in different languages by participants with varying literacy levels.

TRIAL REGISTRATION

Clinical Trials.gov (21/11/2018) (NCT03749902).

Placing patient-reported outcomes at the centre of cardiovascular clinical practice: implications for quality of care and management

Patient-reported outcomes (PROs) provide important insights into patients' own perspectives about their health and medical condition, and there is evidence that their use can lead to improvements in the quality of care and to better-informed clinical decisions. Their application in cardiovascular populations has grown over the past decades. This statement describes what PROs are, and it provides an inventory of disease-specific and domain-specific PROs that have been developed for cardiovascular populations. International standards and quality indices have been published, which can guide the selection of PROs for clinical practice and in clinical trials and research; patients as well as experts in psychometrics should be involved in choosing which are most appropriate. Collaborations are needed to define criteria for using PROs to guide regulatory decisions, and the utility of PROs for comparing and monitoring the quality of care and for allocating resources should be evaluated. New sources for recording PROs include wearable digital health devices, medical registries, and electronic health record. Advice is given for the optimal use of PROs in shared clinical decision-making in cardiovascular medicine, and concerning future directions for their wider application.

Pedi-IKDC exhibits questionable measurement properties in a cohort of pediatric patients with ACL rupture

BACKGROUND

Pedi-IKDC is commonly used to evaluate anterior cruciate ligament (ACL) deficiency in children. However, its construct validity has not been thoroughly assessed. The aim was to examine the measurement properties of the Pediatric International Knee Documentation Committee (Pedi-IKDC) by modern test theory (MTT) models, confirmatory factor analysis (CFA), and item response theory (IRT).

METHODS

The cohort consisted of all children and adolescents in Denmark (n = 535, age 9-16) treated with physeal-sparing ACL reconstruction 2011-2020. Patient-reported outcome measure (PROM) data were collected before surgery and at 1 year follow-up. Structural validity of Pedi-IKDC was assessed with MTT models. Reliability was reported as McDonalds coefficient omega. Responsiveness was evaluated with standardized response means.

RESULTS

Sufficient PROM data were available for 372 patients. The original unidimensional construct did not fit CFA model expectations neither before surgery (χ2  = 462.0, df = 163, p < 0.0001; RMSEA: 0.109, CFI: 0.910, TFI: 0.895) nor at follow-up. Neither did a two-factor CFA model with "Symptoms" and "Sports activities" as individual subscales (χ2  = 455.6, df = 162, p < 0.0001) nor a bifactor model (χ2  = 338.9, df = 143, p < 0.0001), although fit indices improved with the latter (RMSEA: 0.094, CFI: 0.941, TFI: 0.922). The IRT models confirmed this pattern. The scale was responsive (SRM 1.66 (95% CI: 1.46-1.88)). Coefficient omega values were 0.866 before surgery and 0.919 at follow-up.

CONCLUSIONS

The Pedi-IKDC exhibited inadequate structural validity. Neither the original construct, a two-factor model, nor bifactor models fitted data well. We advise that data obtained by Pedi-IKDC are interpreted with caution.

Assessment of the Psychometric Properties of the Danish VISA-P

Purpose

The objective of the current study was to conduct a rigorous assessment of the psychometric properties of the Victorian Institute of Sports Assessment-patellar tendinopathy (VISA-P).

Methods

Rasch analysis, confirmatory factor analysis (CFA), and multivariable linear regression were used to assess the psychometric properties of the VISA-P questionnaire in 184 Danish patients with patellar tendinopathy who had symptoms ranging from under 3 months to over 1 year. A group of 100 healthy Danish persons was included as a reference for known-group validation.

Results

The analyses revealed that the 8-item VISA-P did not fit a unidimensional model, yielded at best a 3-factor model, and exhibited differential item functioning (DIF) across healthy subjects versus people with patellar tendinopathy.

Conclusion

VISA-P in its present form does not satisfy a measurement model and is not a robust scale for measuring patellar tendinopathy. A new PROM for patellar tendinopathy should be developed and appropriately validated, and meanwhile, simple pain scoring (e.g., numeric rating scales) and functional tests are suggested as more appropriate outcome measures for studies of patellar tendinopathy.

Patient Reported Outcome Measures in Adult Spinal Muscular Atrophy: A Scoping Review and Graphical Visualization of the Evidence

BACKGROUND

Spinal Muscular Atrophy (SMA) is a hereditary neuromuscular disease with an estimated prevalence of 1/10 000 births. SMA is increasingly recognized as a multi-system disease with a need to study additional under-recognized health domains such as quality of life, fatigue, bulbar function, respiratory function, and independence.

OBJECTIVE

Identify and assess reported evidence from the literature investigating Patient Reported Outcome Measures (PROMs) in adults with SMA. Develop a novel method drawing from network theory to graphically depict the literature, PROMs, and supporting psychometric evidence.

METHODS

A scoping review was completed following PRISM-ScR, COSMIN and JBI scoping review guidelines. Literature investigating PROMs in adult SMA or neuromuscular disease was identified from peer-reviewed and grey databases. A network graph was derived from extracted data.

RESULTS

5292 articles were retrieved, 81 articles met inclusion criteria; corresponding to 31 unique PROMs. Only two PROMs were developed specifically for SMA. Few PROMs covered multiple domains of health. Most PROMs were incompletely validated, focusing on concurrent validity, and few assessed responsiveness or internal consistency.

CONCLUSIONS

PROMs are emerging tools for monitoring and assessing adults with SMA. Despite their potential benefits, additional validation studies should be completed prior to their use for clinical decision-making. Network graphics may represent a technique to aid in the visualization of evidence supporting a scoping review.

Cross-cultural adaptation, reliability, and validity of the Persian version of the Lower Limb Functional Index

BACKGROUND

the Lower Limb Functional Index (LLFI) is a regional patient reported outcome measure (PROM) for evaluation of lower limb musculoskeletal functional status. No Persian-language (LLFI-Pr) version is available.

OBJECTIVES

LLFI translation and cross-cultural adaptation to Persian and psychometric property evaluation.

STUDY DESIGN

prospective diagnostic assessment.

METHODS

to establish the LLFI-Pr face and content validity, double forward-backward translation protocols were used plus cognitive interviews and the 'content validity index'(CVI). Psychometric properties were determined from a convenience sample (n = 307, age 47.18 ± 11.52 years, female = 58.3%) that concurrently completed the LLFI-Pr and Persian Lower Extremity Functional Scale (LEFS-Pr). Test-retest reliability (ICC_2,1, sub-sample, n = 64) was determined during a non-intervention period of 3-7 days. Internal consistency used Cronbach's Alpha (α), error used MDC_90/95 from the SEM, and construct validity used Pearson's r between the LLFI-Pr and LEFS-Pr. Construct validity used exploratory factor analysis (EFA, suppression = 0.30) with non-Gaussian distribution protocols.

RESULTS

psychometric properties were high for test-retest reliability (ICC_2,1 = 0.90) and internal consistency (α = 0.77), moderate for construct validity (r = 0.63), with no floor or ceiling effects, error found SEM = 1.60, MDC₉₀ = 3.7% and MDC₉₅ = 4.42%. A two-factor (EFA) structure (total-variance = 22.01%), that consequently cannot be summated, was determined where five-items failed consistent factor-loading leaving a 20-item version with a high original-LLFI total-equivalency (r = 0.97). However, the general/region-specific item-ratio reduced from the recognized 60/40 ratio to 50/50.

CONCLUSION

the 20-item LLFI-Pr is a valid two-factor solution with sound psychometric properties for research and clinical Persian-language populations with lower limb disorders.

Four of five frequently used orthopedic PROMs possess inadequate content validity: a COSMIN evaluation of the mHHS, HAGOS, IKDC-SKF, KOOS and KNEES-ACL

PURPOSE

Content validity is the most important property of PROMs. The COSMIN initiative has published guidelines for evaluating the content validity of PROMs, but they have only sparsely been applied to relevant PROMs for musculoskeletal conditions. The aim of this study was to use the COSMIN Risk of Bias checklist to evaluate the content validity of five PROMs, that are highly relevant in musculoskeletal research and used by the arthroscopic surgery community: the modified Harris' Hip Score (mHHS), the Copenhagen Hip and Groin Outcome Score (HAGOS), the International Knee Documentation Committee Subjective Knee evaluation Form (IKDC-SKF), the Knee injury and Osteoarthritis Outcome Score (KOOS) and the Knee Numeric-Entity Evaluation Score ACL (KNEES-ACL).

METHODS

The development articles for the five PROMs were identified through searches in PubMed and SCOPUS. A literature search was performed to identify additional studies assessing content validity of the PROMs. Additional information, necessary for the assessments, was obtained from the PROM developers after direct request. To evaluate the quality of the development studies and rate the content validity, the COSMIN Risk of Bias checklist was applied to all studies.

RESULTS

All five development studies were identified. Three subsequent content validity studies were identified, all evaluating KOOS and one also IKDC. One content validity study was of inadequate quality and excluded from further analysis. The development of mHHS, IKDC-SKF, and KOOS was rated inadequate and possess insufficient content validity for their target populations. Due to the irrelevance of multiple items, KOOS was in particular inappropriate to evaluate patients with an ACL injury. The development of HAGOS was also rated inadequate, although the insufficiency aspects can be regarded as minor. KNEES-ACL possessed sufficient content validity.

CONCLUSION

Out of five PROMs, only KNEES-ACL possessed sufficient content validity. Particularly, KOOS should not be used as an outcome for patients with an ACL injury. There is an urgent need for condition-specific PROMs for musculoskeletal conditions, developed with adequate methods.

LEVEL OF EVIDENCE

III.

Patient-reported outcome measures for pain in women with pelvic floor disorders: a systematic review

INTRODUCTION AND HYPOTHESIS

Patient-reported outcome measures (PROMs) are helpful instruments when measuring and reporting changes in patient health status (Al Sayah et al. J Patient Rep Outcomes 5 (Suppl 2):99, 2021) such as the health-related quality of life (HrQoL) of women with pelvic organ prolapse (POP) and stress urinary incontinence (SUI). The Australasian Pelvic Floor Procedure Registry (APFPR) aims to increase capacity for women to report surgical outcomes through the collection of HrQoL data (Ruseckaite et al. Qual Life Res. 2021) but currently lacks a pain-specific PROM for women with pelvic floor disorders (PFDs), particularly POP and SUI. This review aims to systematically review the existing literature and identify instruments that measure pain in women with POP and SUI for inclusion within the APFPR, which reports on complications from these conditions.

METHODS

We conducted a literature search on OVID MEDLINE, Embase, CINAHL, PsycINFO and EMCARE databases in addition to Google Scholar and grey literature to identify studies from inception to April 2021. Full-text studies were included if they used PROMs to measure pain in women with POP and SUI. Two authors independently screened articles, extracted data and assessed methodological quality.

RESULTS

From 2001 studies, 23 publications describing 19 different PROMs were included for analysis. Eight of these instruments were specific to the pelvic floor; four were only specific to pain and used across multiple disorders; three were generic quality of life instruments and four were other non-validated instruments such as focus group interviews. These instruments were not specific to pain in women with POP or SUI, as they did not identify all relevant domains such as the sensation, region and duration of pain, or incidents where onset of pain occurs.

CONCLUSIONS

The findings of this review suggest there are no current PROMs that are suitable pain-specific instruments for women with POP or SUI. This knowledge may inform and assist in the development of a new PROM to be implemented into the APFPR.

Patient reported outcome measure-haemorrhoidal impact and satisfaction score (PROM-HISS): Development, reliability and construct validity

AIM

Haemorrhoidal disease (HD) is a frequently occurring disorder with a significant negative impact on a patient's quality of life. Here, we describe the development and validation of the Dutch patient reported outcome measure-haemorrhoidal impact and satisfaction score (PROM-HISS).

METHODS

The development of the PROM-HISS followed recommended guidelines. Face and content validity, structural properties, reliability and construct validity were evaluated in a HD population. Reliability was tested by assessing the test-retest reliability, defined by the intraclass correlation coefficient (ICC), and internal consistency measured with Cronbach's alpha. Construct validity was evaluated using confirmatory factor analysis (CFA) and hypotheses testing.

RESULTS

The PROM-HISS consists of three domains: (1) HD symptoms (blood loss; pain; prolapse; soiling; itching), (2) impact of symptoms on daily activities, and (3) satisfaction with treatment. The PROM-HISS showed good face and content validity. The PROM-HISS was completed by 102 patients (65% male), with a mean age of 58 years (23-81 years). The ICCs of the different items in the domain HD symptoms ranged between 0.56 and 0.79 and were interpreted as good. The Cronbach's alpha value was 0.80 and considered satisfactory. The CFA provided further evidence for construct validity with a good model fit. A high score on the symptoms of HD correlated with a high impact of HD on daily activities (Pearson's r = 0.632, p < 0.01) and a low degree of satisfaction (Pearson's r = 0.378, p < 0.01).

CONCLUSION

The PROM-HISS is a reliable and valid instrument to evaluate symptoms of HD, impact on daily activities and satisfaction with treatment.

Dual-panel translation to Danish and Rasch validation of the Foot and Ankle Ability Measure (FAAM-DK)

BACKGROUND

The Foot and Ankle Ability Measure (FAAM) was developed by involvement of patients with chronic ankle instability (CAI) and has acceptable measurement properties, but is not available in Danish.

METHODS

FAAM was translated and culturally adapted into Danish, and its measurement properties were assessed using Rasch analyses.

RESULTS

A Danish version was produced with small adaptations, and content relevance was confirmed by Danish patients. The 21-item ADL domain showed misfit to the Rasch model, but after removing six items, the resulting 15-item scale displayed adequate fit. The Sports domain also exhibited misfit, but after removing one item and adjusting due to differential item functioning related to age for another item, a 7-item scale showed good fit. This resulted in a 22-item 2-dimensional Danish version of FAAM.

CONCLUSION

The 22-item Danish FAAM exhibits robust measurement properties for patients with various conditions of the lower leg, ankle, and foot, including CAI.

Tracking Systems in Team Sports: A Narrative Review of Applications of the Data and Sport Specific Analysis

Seeking to obtain a competitive advantage and manage the risk of injury, team sport organisations are investing in tracking systems that can quantify training and competition characteristics. It is expected that such information can support objective decision-making for the prescription and manipulation of training load. This narrative review aims to summarise, and critically evaluate, different tracking systems and their use within team sports. The selection of systems should be dependent upon the context of the sport and needs careful consideration by practitioners. The selection of metrics requires a critical process to be able to describe, plan, monitor and evaluate training and competition characteristics of each sport. An emerging consideration for tracking systems data is the selection of suitable time analysis, such as temporal durations, peak demands or time series segmentation, whose best use depends on the temporal characteristics of the sport. Finally, examples of characteristics and the application of tracking data across seven popular team sports are presented. Practitioners working in specific team sports are advised to follow a critical thinking process, with a healthy dose of scepticism and awareness of appropriate theoretical frameworks, where possible, when creating new or selecting an existing metric to profile team sport athletes.

A catalogue of PROMs in sports science: Quality assessment of PROM development and validation

Choosing the most adequate PROM for a study is a non-trivial process. The aim of this study was to provide a catalogue with analyses of content and construct validity of PROMs relevant to research in sports science, including all published local translations. The most commonly used PROMs in sports research were selected from a PubMed search "patient reported outcome measures sports", identifying 439 articles and 194 different PROMs. Articles describing development of the 61 selected PROMs were assessed for content validity, and all articles regarding construct validity of each PROM and all published translations (in total 622 articles) were analyzed. A catalogue with assessments of the 61 PROMs was produced. The majority were of inferior validity, with few exceptions. The most common reason for this was that the PROM had not been developed by methods that ensure high content validity. Another major reason for inferior validity was that construct validity had not been secured by adequate statistical methods. In conclusion, this catalogue provides a tool for researchers to facilitate choosing the most valid PROM for studies in sports research. Furthermore, it shows for popular PROMs where further validation is needed, and for fields in musculoskeletal medicine where valid PROMs are lacking. It is suggested that a targeted effort is made to develop valid PROMs for major conditions in musculoskeletal research. The current method is easier to practice compared with assessment after COSMIN guidelines.

Choosing the most appropriate PROM for clinical studies in sports medicine

Choosing the most appropriate patient-reported outcome measure (PROM) for a clinical study is essential in order to achieve trustworthy results. This choice will depend on (a) the objective of the study and hence the research question; (b) the choice of a theoretical framework, such as the World Health Organization's International Classification of Functioning, Disability, and Health (ICF); (c) whether there currently is a PROM that possesses high content validity and high construct validity for the specific patient group and objective, and if not; (d) the decision on whether to use a suboptimal PROM or develop and validate a new PROM. This paper presents the steps that should be followed in order to assess the relevance of PROMs and suggests ways to enhance the choice depending on the goal of the study.

Potential problems in the use of patient reported outcome measures (PROMs) and reporting of PROM data in sports science

To use an inadequate patient reported outcome measure (PROM) or use a PROM in an inappropriate way potentially influences the quality of measurement. The objectives of this study were to define potential inadequate uses of PROMs in sports research studies and estimate how often they occur. A consensus group consisting of medical researchers, statisticians, and psychometricians identified and defined potentially irregular applications of PROMs. Occurrence of these in 349 consecutive articles in sports medicine in which PROMs were used as primary outcomes was reviewed. In all, 14 different potential problems were defined, and one or several occurred in 172 of the articles (49%). These were as follows: using a PROM that was developed for a different patient group (100 cases), using two or more PROMs with identical questions (94), aggregation of domain sum scores (82), combinations of subjective and objective measures (27), using a PROM to diagnose or evaluate the individual patient (7), using a PROM for a single limb (3), recall bias (3), exclusion of domains or items (3), construction of a PROM for a specific occasion (2), categorization of the scale (2), and mixing different versions of a PROM (1). Adaption of scale scores (e. g., to percentage) when results are reported (144) carries a risk of miscalculation and distorted impression of results. Data related to uncertainty about completing the PROM and the handling of missing data were not provided in the manuscripts. In conclusion, potential problems in the use and reporting of PROMs are common in sports research, and this can influence the validity of reported results.