Computerized adaptive testing of symptom severity: a registry-based study of 924 patients with trapeziometacarpal arthritis

Patient and healthcare professional perspectives on the Practical Guide to Implementing PROMs in Gender-Affirming Care (PG-PROM-GAC): analysis of open-ended responses from patients and healthcare professionals

IMPORTANCE

Several international calls have been made for evidence-based patient-reported outcome measure (PROM) implementation for gender-affirming care. The Practical Guide to Implementing PROMs in Gender-Affirming Care (PG-PROM-GAC) is a resource which can help guide PROM implementation efforts, developed using a three-phase participatory research approach with transgender and gender-diverse (TGD) patients and gender-affirming healthcare professionals. However, thoughts and perspectives from TGD patients and gender-affirming healthcare professionals on the PG-PROM-GAC need to be investigated.

OBJECTIVE

Investigate patient and healthcare professional perspectives on the PG-PROM-GAC through analysis of open-ended survey results.

DESIGN

Qualitative study analysing open-ended responses from TGD patients and gender-affirming healthcare professionals.

SETTING

Participants were recruited from a UK National Health System (NHS) gender clinic.

PARTICIPANTS

Patients receiving care at an NHS gender clinic and healthcare professionals working at an NHS gender clinic were eligible for participation. Eligible participants were invited to participate in this study via email.

INTERVENTION

Participants were sent an open-ended survey to collect responses on the PG-PROM-GAC.

MAIN OUTCOMES AND MEASURES

Data were thematically analysed by two independent researchers and interpreted following guidance from established methods in implementation science.

RESULTS

A total of 64 TGD patients and 9 gender-affirming healthcare professionals responded to the open-ended survey (mean (SD) age: 35 (16) and 48 (8), respectively). Four main themes emerged from the data: overall opinions and support for the PG-PROM-GAC, presentation of the PG-PROM-GAC, impact of gender clinic resources on PROM implementation and impact of PROM selection on implementation. Data were used to iterate the PG-PROM-GAC in response to participant feedback.

CONCLUSIONS AND RELEVANCE

The PG-PROM-GAC is an acceptable and feasible resource that can be used by clinicians, researchers and policymakers to guide PROM implementation for gender-affirming care settings, helping to align gender-affirming care with patient needs.

Statistics for the hand surgeon. Part 2: avoiding common pitfalls

In this second of a two-part article, we describe some of the common statistical pitfalls encountered in hand surgery research. These include dichotomania, the 'Table 2 fallacy', p-hacking, regression to the mean, overfitting and unaccounted data clustering. We explain the impact of these pitfalls on hand surgery research and describe techniques to avoid them. The aim of this two-part article was to provide a starting point for hand surgeons to refer to when conducting or analysing research and provide resources and references for interested readers to explore.

The Hand and Wrist: AntImicrobials and Infection (HAWAII) trial

BACKGROUND

Hand trauma, comprising injuries to both the hand and wrist, affects over five million people per year in the NHS, resulting in 250 000 operations each year. Surgical site infection (SSI) following hand trauma surgery leads to significant morbidity. Triclosan-coated sutures may reduce SSI in major abdominal surgery but have never been tested in hand trauma. Feasibility needs to be ascertained before a definitive trial can be delivered in hand trauma.

METHODS

A multicentre feasibility RCT of antimicrobial sutures versus standard sutures involving adults undergoing surgery for hand trauma to evaluate feasibility for a definitive trial. Secondary objectives were incidence of SSI in both groups, hand function measured with patient-reported outcome measures, health-related quality of life and change in employment. Randomization was performed on a 1:1 basis, stratified by age of the patient and whether the injury was open or closed, using a secure, centralized, online randomization service. Participants were blinded to allocation.

RESULTS

116 participants were recruited and randomized (60 intervention, 56 control). Of 227 screened, most were eligible (89.5 per cent), and most who were approached agreed to be included in the study (84.7 per cent). Retention was low: 57.5 per cent at 30 days, 52 per cent at 90 days and 45.1 per cent at 6 months. Incidence of SSI was >20 per cent in both groups. Hand function deteriorated after injury but recovered to near pre-injury levels during the study period.

CONCLUSIONS

Risk of SSI after hand trauma is high. A definitive RCT of antimicrobial sutures in hand trauma surgery is feasible, if retention is improved.

TRIAL REGISTRATION

ISRCTN10771059.

Patient and healthcare professional perspectives on implementing patient-reported outcome measures in gender-affirming care: a qualitative study

OBJECTIVES

Patient and healthcare professional perspectives are needed to develop a gender-affirming care patient-reported outcome measure (PROM) implementation plan. We aimed to identify top considerations relevant to gender-affirming care PROM implementation from patient and healthcare professional perspectives.

DESIGN, SETTINGS AND PARTICIPANTS

This qualitative study conducted in the UK between January and April 2023 includes focus groups with a patient sample diverse in age and gender identity, and a healthcare professional sample diverse in age and role. Established methods in implementation science and the Consolidated Framework for Implementation Research were used to create interview guides, and analyse data. Focus groups were audio recorded, transcribed verbatim and analysed by two independent researchers. Patient and healthcare professional focus groups were conducted separately.

PRIMARY OUTCOME MEASURES

Patient and healthcare professional perspectives on PROM implementation were explored through focus groups and until data saturation.

RESULTS

A total of 7 virtual focus groups were conducted with 24 participants (14 patients, mean (SD) age, 43 (14.5); 10 healthcare professionals, mean (SD) age, 46 (11.3)). From patient perspectives, key barriers to PROM implementation were mistrust with PROMs, lack of accessibility, burden, and lack of communication on why PROMs are important and how they will help care. From healthcare professional perspectives, key barriers to PROM implementation were lack of accessibility, burden with PROM administration and scoring, costs of implementation (financial and time), and lack of communication on what PROMs are and how they benefit service provision.

CONCLUSION

Gender-affirming care PROM implementation must address: patient mistrust with PROMs, accessibility, communication on what PROMs are and how they can be used, reducing burden, and hybridised implementation. These factors may also be applicable to other clinical areas interested in implementing PROMs.

Computerized adaptive testing for the patient evaluation measure (PEM) in patients undergoing cubital tunnel syndrome surgery

In outcome measures, item response theory (IRT) validation can deliver interval-scaled high-quality measurement that can be harnessed using computerized adaptive tests (CATs) to pose fewer questions to patients. We aimed to develop a CAT by developing an IRT model for the Patient Evaluation Measure (PEM) for patients undergoing cubital tunnel syndrome (CuTS) surgery. Nine hundred and seventy-nine completed PEM responses of patients with CuTS in the United Kingdom Hand Registry were used to develop and calibrate the CAT. Its performance was then evaluated in a simulated cohort of 1000 patients. The CAT reduced the original PEM length from ten to a median of two questions (range two to four), while preserving a high level of precision (median standard error of measurement of 0.27). The mean error between the CAT score and full-length score was 0.08%. A Bland-Altman analysis showed good agreement with no signs of bias. The CAT version of the PEM can substantially reduce patient burden while enhancing construct validity by harnessing IRT for patients undergoing CuTS surgery.

Remote Symptom Monitoring With Ecological Momentary Computerized Adaptive Testing: Pilot Cohort Study of a Platform for Frequent, Low-Burden, and Personalized Patient-Reported Outcome Measures

BACKGROUND

Remote patient-reported outcome measure (PROM) data capture can provide useful insights into research and clinical practice and deeper insights can be gained by administering assessments more frequently, for example, in ecological momentary assessment. However, frequent data collection can be limited by the burden of multiple, lengthy questionnaires. This burden can be reduced with computerized adaptive testing (CAT) algorithms that select only the most relevant items from a PROM for an individual respondent. In this paper, we propose "ecological momentary computerized adaptive testing" (EMCAT): the use of CAT algorithms to reduce PROM response burden and facilitate high-frequency data capture via a smartphone app. We develop and pilot a smartphone app for performing EMCAT using a popular hand surgery PROM.

OBJECTIVE

The aim of this study is to determine the feasibility of EMCAT as a system for remote PROM administration.

METHODS

We built the EMCAT web app using Concerto, an open-source CAT platform maintained by the Psychometrics Centre, University of Cambridge, and hosted it on an Amazon Web Service cloud server. The platform is compatible with any questionnaire that has been parameterized with item response theory or Rasch measurement theory. For this study, the PROM we chose was the patient evaluation measure, which is commonly used in hand surgery. CAT algorithms were built using item response theory models derived from UK Hand Registry data. In the pilot study, we enrolled 40 patients with hand trauma or thumb-base arthritis, across 2 sites, between July 13, 2022, and September 14, 2022. We monitored their symptoms with the patient evaluation measure, via EMCAT, over a 12-week period. Patients were assessed thrice weekly, once daily, or thrice daily. We additionally administered full-length PROM assessments at 0, 6, and 12 weeks, and the User Engagement Scale at 12 weeks.

RESULTS

The use of EMCAT significantly reduced the length of the PROM (median 2 vs 11 items) and the time taken to complete it (median 8.8 seconds vs 1 minute 14 seconds). Very similar scores were obtained when EMCAT was administered concurrently with the full-length PROM, with a mean error of <0.01 on a logit (z score) scale. The median response rate in the daily assessment group was 93%. The median perceived usability score of the User Engagement Scale was 4.0 (maximum possible score 5.0).

CONCLUSIONS

EMCAT reduces the burden of PROM assessments, enabling acceptable high-frequency, remote PROM data capture. This has potential applications in both research and clinical practice. In research, EMCAT could be used to study temporal variations in symptom severity, for example, recovery trajectories after surgery. In clinical practice, EMCAT could be used to monitor patients remotely, prompting early intervention if a patient's symptom trajectory causes clinical concern.

TRIAL REGISTRATION

ISRCTN 19841416; https://www.isrctn.com/ISRCTN19841416.

Item response theory assumptions were adequately met by the Oxford hip and knee scores

OBJECTIVES

To develop item response theory (IRT) models for the Oxford hip and knee scores which convert patient responses into continuous scores with quantifiable precision and provide these as web applications for efficient score conversion.

STUDY DESIGN AND SETTING

Data from the National Health Service patient-reported outcome measures program were used to test the assumptions of IRT (unidimensionality, monotonicity, local independence, and measurement invariance) before fitting models to preoperative response patterns obtained from patients undergoing primary elective hip or knee arthroplasty. The hip and knee datasets contained 321,147 and 355,249 patients, respectively.

RESULTS

Scree plots, Kaiser criterion analyses, and confirmatory factor analyses confirmed unidimensionality and Mokken analysis confirmed monotonicity of both scales. In each scale, all item pairs shared a residual correlation of ≤ 0.20. At the test level, both scales showed measurement invariance by age and gender. Both scales provide precise measurement in preoperative settings but demonstrate poorer precision and ceiling effects in postoperative settings.

CONCLUSION

We provide IRT parameters and web applications that can convert Oxford Hip Score or Oxford Knee Score response sets into continuous measurements and quantify individual measurement error. These can be used in sensitivity analyses or to administer truncated and individualized computerized adaptive tests.