Validation of electronic data capture of the Irritable Bowel Syndrome--Quality of Life Measure, the Work Productivity and Activity Impairment Questionnaire for Irritable Bowel Syndrome and the EuroQol

A cross-sectional study of symptoms and health-related quality of life in menopausal-aged women in China

OBJECTIVE

To measure symptoms and health-related quality of life in a cross-sectional cohort of menopausal-aged women in China.

METHOD

A cross-sectional survey was conducted in a general population cohort of 2,000 Chinese females over the age of 45 years. Patients completed the Chinese version of the EuroQol-5D five level (EQ5D5L) health-related quality of life instrument via Personal Digital Assistant. Raw scores were converted to utility tariffs using value sets for China. Statistical analysis included Pearson's chi-square test, z test for multiple comparisons with adjustment by the Bonferroni method, independent-sample t-test, ANOVA, and adjustment by the Tukey method for multiple comparison. Results were considered statistically significant when p < 0.05 and the study was reported according to the STROBE recommendations.

RESULTS

In a cohort of 2000 women, 732 (37%) were premenopausal, 798 (40%) were perimenopausal and 470 (23%) were postmenopausal. Perimenopausal women reported significantly more symptoms (91%) compared to premenopausal (77%) and postmenopausal (81%) women. Health-related quality of life was significantly lower in symptomatic perimenopausal women compared to premenopausal (0.919, p < 0.05) and postmenopausal (0.877, p < 0.05) women. Within each group there was a statistically significant difference between the health-related quality of life of women with symptoms compared to without symptoms.

CONCLUSION

The perimenopausal phase of menopause is associated with significantly more symptoms and significantly lower HRQoL compared to premenopausal and postmenopausal phases.

Updated Recommendations on Evidence Needed to Support Measurement Comparability Among Modes of Data Collection for Patient-Reported Outcome Measures: A Good Practices Report of an ISPOR Task Force

The ISPOR Task Force on measurement comparability between modes of data collection for patient-reported outcome measures (PROMs) has updated the good practice recommendations from the 2009 ISPOR electronic patient-reported outcome and 2014 patient-reported outcome mixed modes Good Research Practices Task Force reports in light of accumulated evidence of measurement comparability among different modes of PROM data collection. Furthermore, with the increasing use of electronic formats of clinical outcome assessments in clinical trials and the US Food and Drug Administration's encouragement of electronic data collection, this new task force report provides stakeholders with best practice recommendations reflecting the current body of evidence and enables them to respond to future developments in research and technology. This task force recommends an evidence-based approach to determine whether new research is needed to evaluate measurement comparability for a given questionnaire or technology. The suitability of existing evidence depends upon whether it satisfactorily demonstrates that the change in data collection mode has not affected the PROM's measurement properties. In cases where sufficient evidence of measurement comparability exists and best practices for faithful migration are followed, this task force concludes that further testing of measurement comparability among the data collection modes is unnecessary, including cases of "mixing modes" within clinical trials such as bring your own device designs.

Validation and meaningful within-patient change in work productivity and activity impairment questionnaire (WPAI) for episodic or chronic migraine

BACKGROUND

No available studies demonstrate validity and meaningful change thresholds of Work Productivity and Activity Impairment (WPAI) questionnaire in patients with migraine. In this post-hoc analysis, we assessed reliability, validity, responsiveness, and meaningful within-patient change from baseline to Month 3 for Work Productivity and Activity Impairment (WPAI) domain scores in patients with episodic migraine (EM) or chronic migraine (CM).

METHOD

The Phase 3, multicenter, randomized, double-blind, placebo-controlled CONQUER study (NCT03559257, N = 462) enrolled patients with EM or CM who failed two to four categories of prior preventive medication in past ten years. The analyses were performed for WPAI domain scores (absenteeism, presenteeism, overall work productivity, and non-work-related activity impairment). Migraine Specific Quality of Life Questionnaire version 2.1 (MSQv2.1) domain scores (Role Function-Restrictive [RFR] and Role Function-Preventive [RFP]), and monthly migraine headache days were used as anchors. Responder criteria were changes from baseline to Month 3 for each of these anchors and were defined as: increase in MSQ-RFR by ≥ 25.71 points and MSQ-RFP by ≥ 20.00 points and a 50% reduction in monthly migraine headache days. Assessments were performed for overall population, and patients with EM or CM. The meaningful change threshold was determined based on Youden index, Phi coefficient and sensitivity.

RESULTS

Of 462 randomized patients, 444 who completed WPAI questionnaire were included in post-hoc analysis. Test-retest reliability over 3 months in a stable subgroup revealed moderate correlations for non-work-related Activity Impairment (ICC = 0.446) presenteeism (ICC = 0.438) and a fair correlation for overall work productivity loss (ICC = 0.360). At baseline, all correlations between WPAI domain scores and continuous anchor variables exceeded recommended threshold of ≥ 0.30, except for WPAI domain scores with number of monthly migraine headache days. Patients achieving pre-specified responsiveness thresholds for monthly migraine headache days, and MSQ-RFP, MSQ-RFR from baseline to Month 3 (responders) showed significant improvements in WPAI domain scores compared with non-responders (P < 0.001). The meaningful change thresholds of -20 (% unit) were identified for WPAI domain scores.

CONCLUSION

In conclusion, WPAI has sufficient validity, reliability, responsiveness, and appropriate interpretation standards to assess the impact of EM or CM on presenteeism and overall work productivity loss and non-work-related activity impairment.

TRIAL REGISTRATION

NCT number of CONQUER study, NCT03559257.

Factors associated with lower disease-specific and generic health-related quality of life in Rome IV irritable bowel syndrome

BACKGROUND

Little is known about associations with reduced quality of life in irritable bowel syndrome (IBS) or impact of IBS on quality of life compared with other chronic conditions.

METHODS

We collected demographic, gastrointestinal and psychological symptoms, healthcare usage, direct healthcare costs, impact on work and activities of daily living data from 752 individuals with Rome IV-defined IBS. We used the irritable bowel syndrome quality of life (IBS-QOL) and the EQ-5D-5L questionnaires to examine characteristics associated with lower quality of life.

RESULTS

The mean IBS-QOL among all 752 individuals with Rome IV IBS was 48.4 (SD 22.3) and the mean EQ-5D score was 0.570 (SD 0.283), the latter being comparable to people with stroke, leg ulcers or chronic obstructive pulmonary disease. Lower levels of both disease-specific and generic quality of life were associated with severe IBS symptom scores, abnormal anxiety or depression scores, and higher somatoform symptom-reporting and gastrointestinal symptom-specific anxiety scores (p < 0.001 for all analyses). Those with lower quality of life had significantly higher healthcare usage and direct healthcare costs and more impairment in work and activities of daily living (p < 0.01 for all analyses). Avoidance of alcohol, lower educational level, abnormal anxiety, depression or somatoform symptom-reporting scores, and impairment in social leisure activities, home management or maintaining close relationships were all independently associated with lower quality of life.

CONCLUSION

IBS has a substantial impact on the quality of life of those affected, and worse than observed in some severe chronic organic conditions.

Capturing patient-reported outcomes: paper versus electronic survey administration

Objective: To compare the capture rates and costs of paper patient-reported outcomes (pPRO) administered in-clinic and electronic PROs (ePRO) collected through emails and texts. Design: Retrospective review. Setting: Level 1 trauma center. Patients/Participants: The pPRO program enrolled 2164 patients for postsurgical follow-up in 4 fracture types: ankle, distal radius, proximal humerus, and implant removal from 2012 to 2017. The ePRO program enrolled 3096 patients in 13 fracture types from 2018 to 2020. Among the patients enrolled in the ePRO program, 1296 patients were matched to the 4 original fracture types and time points. Main Outcome Measures: PRO capture rates in 4 fracture types by matched time point and estimated cost of each program per enrolled patient. Results: At first follow-up, pPRO provided a higher capture rate than ePRO for 3 of 4 fracture types except for implant removal (P < 0.05). However, at 6-month and 1-year follow-ups, ePRO demonstrated statistically significant higher capture rates when compared with pPRO for all applicable modules (P < 0.05). The average cost for the pPRO program was $171 per patient versus $56 per patient in the ePRO program. Patients were 1.19 times more likely to complete ePRO compared with pPRO (P = 0.007) after controlling for age, sex, fracture type, and time point. Conclusion: The electronic PRO service has improved long-term capture rates compared with paper PROs, while minimizing cost. A combined program that includes both in-clinic and out of clinic effort may be the ideal model for collection of PROs. Level of Evidence: Level 3.

Return to Work and Work Productivity During the First Year After Cancer Treatment

Objectives

Working-age cancer patients face barriers to resuming work after treatment completion. Those resuming work contend with reduced productivity arising from persisting residual symptoms. Existing studies of return to work (RTW) after cancer diagnosis were done predominantly in Western countries. Given that employment and RTW in cancer survivors likely vary regionally due to healthcare provision and social security differences, we documented rates and correlates of RTW, work productivity, and activity impairment among Chinese cancer survivors in Hong Kong at one-year post-treatment.

Methods

Of 1,106 cancer patients assessed at six-months post-cancer treatment (baseline), 593 previously worked; detailed work status, psychological distress (HADS), physical symptom distress (MSAS-SF), supportive care needs (SCNS-SF34-C), health-related quality of life (SF12), and illness perception (B-IPQ) were assessed. Six months later (follow-up), work productivity and activity impairment were assessed (WPAI; n = 402). Descriptive analyses examined RTW rate. Fully adjusted regressions determined RTW, work productivity, and activity impairment predictors.

Results

At baseline, 39% (232/593) were working, 26% (153/593) on sick leave, and 35% (208/593) were unemployed. Compared to patients returning to work, unemployed participants were older, likely manual/service-oriented workers, and had lower family income, chemotherapy, fewer unmet health system and information needs, poorer physical functioning, and negative illness perceptions. Sick leave participants were likely service-oriented workers, who had head and neck cancer, chemotherapy, and poor physical functioning. At FU, baseline depressive symptoms, physical symptom distress, and negative illness perceptions predicted presenteeism and work productivity loss; gynecological cancer, fewer unmet health system and information needs, and greater unmet sexuality needs predicted absenteeism; physical symptom distress, negative illness perception, and poor physical functioning predicted activity impairment.

Conclusion

Cancer survivors who had more physically demanding jobs and poorer physical functioning delayed RTW. Unmanaged physical symptom and psychological distress hindered work productivity.

The estimation of a preference-based single index for the IBS-QoL by mapping to the EQ-5D-5L in patients with irritable bowel syndrome

Purpose

The Irritable Bowel Syndrome Quality of Life (IBS-QoL) questionnaire is a commonly used and validated IBS-specific QoL instrument. However, this questionnaire is in contrast to the EQ-5D-5L, not preference-based and as such does not allow calculation of QALYs. The objective of this study was to describe the convergent- and known-group validity of both questionnaires and to develop a mapping algorithm from EQ-5D-5L which enable IBS-QoL scores to be transformed into utility scores for use in economic evaluations.

Methods

We used data from two multicenter randomized clinical trials, which represented the estimation and external validation dataset. The convergent validity was investigated by examining correlations between the EQ-5D-5L and IBS-QoL and the known-group validity by calculating effect sizes. Ordinary least squares (OLS), censored least absolute deviations (CLAD), and mixture models were used in this mapping approach.

Results

283 IBS patients were included (n = 189 vs. n = 84). Mean IBS-QoL score was 71.13 (SD 15.66) and mean EQ-5D-5L utility score was 0.73 (SD 0.19). The overall sensitivity of the IBS-QoL and EQ-5D-5L to discriminate between patient and disease characteristics was similar. CLAD model 4, containing the total IBS-QoL score and squared IBS-SSS (IBS severity scoring system), was chosen as the most appropriate model to transform IBS-QoL scores into EQ-5D-5L utility scores.

Conclusion

This study reports the development of an algorithm where the condition-specific questionnaire IBS-QoL can be used to calculate utility values for use in economic evaluations. Including a clinical measure, IBS-SSS, in the model improved the performance of the algorithm.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11136-021-02995-y.

Predicting presenteeism using measures of health status

Objectives

To identify whether it is feasible to develop a mapping algorithm to predict presenteeism using multiattribute measures of health status.

Methods

Data were collected using a bespoke online survey in a purposive sample (n = 472) of working individuals with a self-reported diagnosis of Rheumatoid arthritis (RA). Survey respondents were recruited using an online panel company (ResearchNow). This study used data captured using two multiattribute measures of health status (EQ5D-5 level; SF6D) and a measure of presenteeism (WPAI, Work Productivity Activity Index). Statistical correlation between the WPAI and the two measures of health status (EQ5D-5 level; SF6D) was assessed using Spearman’s rank correlation. Five regression models were estimated to quantify the relationship between WPAI and predict presenteeism using health status. The models were specified based in index and domain scores and included covariates (age; gender). Estimated and observed presenteeism were compared using tenfold cross-validation and evaluated using Root mean square error (RMSE).

Results

A strong and negative correlation was found between WPAI and: EQ5D-5 level and WPAI (r = − 0.64); SF6D (r =− 0.60). Two models, using ordinary least squares regression were identified as the best performing models specifying health status using: SF6D domains with age interacted with gender (RMSE = 1.7858); EQ5D-5 Level domains and age interacted with gender (RMSE = 1.7859).

Conclusions

This study provides indicative evidence that two existing measures of health status (SF6D and EQ5D-5L) have a quantifiable relationship with a measure of presenteeism (WPAI) for an exemplar application of working individuals with RA. A future study should assess the external validity of the proposed mapping algorithms.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11136-021-02936-9.

Psychometric properties of Short Form-36 Health Survey, EuroQol 5-dimensions, and Hospital Anxiety and Depression Scale in patients with chronic pain

Supplemental Digital Content is Available in the Text.

This large-sample item response theory-based evaluation assessed the measurement properties of SF-36, EQ-5D, and hospital anxiety and depression scale for chronic pain patients in clinical settings.

Recent research has highlighted a need for the psychometric evaluation of instruments targeting core domains of the pain experience in chronic pain populations. In this study, the measurement properties of Short Form-36 Health Survey (SF-36),EuroQol 5-dimensions (EQ-5D) and Hospital Anxiety and Depression Scale (HADS) were analyzed within the item response-theory framework based on data from 35,908 patients. To assess the structural validity of these instruments, the empirical representations of several conceptually substantiated latent structures were compared in a cross-validation procedure. The most structurally sound representations were selected from each questionnaire and their internal consistency reliability computed as a summary of their precision. Finally, questionnaire scores were correlated with each other to evaluate their convergent and discriminant validity. Our results supported that SF-36 is an acceptable measure of 2 independent constructs of physical and mental health. By contrast, although the approach to summarize the health-related quality of life construct of EQ-5D as a unidimensional score was valid, its low reliability rendered practical model implementation of doubtful utility. Finally, rather than being separated into 2 subscales of anxiety and depression, HADS was a valid and reliable measure of overall emotional distress. In support of convergent and discriminant validity, correlations between questionnaires showed that theoretically similar traits were highly associated, whereas unrelated traits were not. Our models can be applied to score SF-36 and HADS in chronic pain patients, but we recommend against using the EQ-5D model due to its low reliability. These results are useful for researchers and clinicians involved in chronic pain populations because questionnaires' properties determine their discriminating ability in patient status assessment.

Validity of five foot and ankle specific electronic patient-reported outcome (ePRO) instruments in patients undergoing elective orthopedic foot or ankle surgery

BACKGROUND

Patient-reported outcomes (PROs) are widely accepted measures for evaluating outcomes of surgical interventions. As patient-reported information is stored in electronic health records, it is essential that there are valid electronic PRO (ePRO) instruments available for clinicians and researchers. The aim of this study was to evaluate the validity of electronic versions of five widely used foot and ankle specific PRO instruments.

METHODS

Altogether 111 consecutive elective foot/ankle surgery patients were invited face-to-face to participate in this study. Patients completed electronic versions of the Foot and Ankle Ability Measure (FAAM), the Foot and Ankle Outcome Score (FAOS), the modified Lower Extremity Function Scale (LEFS), the Manchester-Oxford Foot Questionnaire (MOXFQ), and the Visual Analogue Scale Foot and Ankle (VAS-FA) on the day of elective foot and/or ankle surgery. Construct validity, coverage, and targeting of the scales were assessed.

RESULTS

Based on general and predefined thresholds, construct validity, coverage, and targeting of the ePRO versions of the FAAM, the FAOS, the MOXFQ, and the VAS-FA were acceptable. Major issues arose with score distribution and convergent validity of the modified LEFS instrument.

CONCLUSIONS

The ePRO versions of the FAAM, the FAOS, the MOXFQ, and the VAS-FA provide valid scores for foot and ankle patients. However, our findings do not support the use of the modified LEFS as an electronic outcome measure for patients with orthopedic foot and/or ankle pathologies.

Preferences for Use and Design of Electronic Patient-Reported Outcomes in Patients with Chronic Obstructive Pulmonary Disease

OBJECTIVES

Collection of patient-reported outcome (PRO) measures is critical to fully understand chronic obstructive pulmonary disease (COPD) management and progression, as the impact on health-related quality of life is not well understood by objective measures alone. Electronic PROs (ePROs) are increasingly used because of their advantages over paper data collection, including elimination of transcription errors, increased accuracy and data quality, real-time data reporting, and increased compliance. The objective of this study was to characterize how patients with COPD prefer to use various types of technology to report disease symptoms, and their preferences for ePRO design and display.

METHODS

The sample consisted of subjects with COPD (N = 103) who completed in-person surveys on their ePRO preferences.

RESULTS

The majority of subjects prefer to use a form of electronic media over paper to report their disease symptoms. Of these electronic methods, subjects most often prefer to use a smartphone provided by their physician. Subjects were also interested in ePRO features, such as knowing estimated PRO completion time at the outset, tracking their progress in real time as they complete a questionnaire, seeing the data that they report in order to track their health status, being encouraged to complete their diary if they fall behind by positive messaging, and being thanked for their completion of a daily diary.

CONCLUSIONS

Investigators should consider including these preferences when designing ePRO assessments. Incorporating patient preferences for ePRO design can ultimately help reduce patient burden and increase engagement, compliance, and improve data quality.

Comparison between an electronic version of the foot and ankle outcome score and the standard paper version: A randomized multicenter study

To prove the equivalence of the Korean version of the Foot and Ankle Outcome Score (FAOS) in the printed (PFAOS) vs the electronic (EFAOS) form in a multicenter randomized study.Overall, 227 patients with ages ranging from 20 to 79 years from 16 dedicated foot and ankle centers were included. Patients were randomized into either a 'paper first' group (P-F group, n = 113) or an 'electronic device (tablet computer) first' group (E-F group, n = 114). The first evaluation either by paper (P-F group) or tablet (E-F group) was followed by a second evaluation the following day. The difference between the PFAOS and EFAOS results in each group was calculated and analyzed. To evaluate the benefit of each methodology, the time consumed per evaluation was compared and patients were asked which methodology they preferred and which was the easiest to use.There were no significant differences in age or sex between the groups. An intraclass correlation coefficient (ICC) value of 0.934 (95% confidence interval [CI]: 0.912-0.950, P < .001) was confirmed in PFAOS and EFAOS, showing a significant correlation between the 2 methodologies. EFAOS was completed in a shorter amount of time than PFAOS. The majority of patients agreed that EFAOS was easier to complete than PFAOS.The paper or electronic forms of the Korean adaptation of FAOS were considered equivalent. The shorter time of completion and the preference for the electronic version over paper by patients deems the electronic FAOS a promising option to consider in future.

Test-Retest Reliability, Agreement and Responsiveness of Productivity Loss (iPCQ-VR) and Healthcare Utilization (TiCP-VR) Questionnaires for Sick Workers with Chronic Musculoskeletal Pain

The purpose of this study was to assess test-retest reliability, agreement, and responsiveness of questionnaires on productivity loss (iPCQ-VR) and healthcare utilization (TiCP-VR) for sick-listed workers with chronic musculoskeletal pain who were referred to vocational rehabilitation. Methods Test-retest reliability and agreement was assessed with a 2-week interval. Responsiveness was assessed at discharge after a 15-week vocational rehabilitation (VR) program. Data was obtained from six Dutch VR centers. Test-retest reliability was determined with intraclass correlation coefficient (ICC) and Cohen's kappa. Agreement was determined by Standard Error of Measurement (SEM), smallest detectable changes (on group and individual level), and percentage observed, positive and negative agreement. Responsiveness was determined with area under the curve (AUC) obtained from receiver operation characteristic (ROC). Results A sample of 52 participants on test-retest reliability and agreement, and a sample of 223 on responsiveness were included in the analysis. Productivity loss (iPCQ-VR): ICCs ranged from 0.52 to 0.90, kappa ranged from 0.42 to 0.96, and AUC ranged from 0.55 to 0.86. Healthcare utilization (TiCP-VR): ICC was 0.81, and kappa values of the single healthcare utilization items ranged from 0.11 to 1.00. Conclusions The iPCQ-VR showed good measurement properties on working status, number of hours working per week and long-term sick leave, and low measurement properties on short-term sick leave and presenteeism. The TiCP-VR showed adequate reliability on all healthcare utilization items together and medication use, but showed low measurement properties on the single healthcare utilization items.

A retrospective and prospective 12-month observational study of the socioeconomic burden of moderate to severe irritable bowel syndrome with constipation in Spain

INTRODUCTION

The socioeconomic burden of irritable bowel syndrome with constipation (IBS-C) has never been formally assessed in Spain.

PATIENTS AND METHODS

This 12-month (6-month retrospective and prospective periods) observational, multicentre study assessed the burden of moderate-to-severe IBS-C in Spain. Patients were included if they had been diagnosed with IBS-C (Rome III criteria) within the last 5 years and had moderate-to-severe IBS-C (IBS Symptom Severity Scale score [IBS-SSS] ≥175) at inclusion. The primary objective was to assess the direct cost to the Spanish healthcare system (HS).

RESULTS

A total of 112 patients were included, 64 (57%) of which had severe IBS-C at inclusion. At baseline, 89 (80%) patients reported abdominal pain and distention. Patient quality of life (QoL), measured by the IBS-C QoL and EQ-5D instruments, was found to be impaired with a mean score of 59 and 57 (0-100, worst-best), respectively. Over the 6-month prospective period the mean IBS-C severity, measured using the IBS-SSS showed some improvement (315-234 [0-500, best-worst]). During the year, 89 (80%) patients used prescription drugs for IBS-C, with laxatives being the most frequently prescribed (n=70; 63%). The direct cost to the HS was €1067, and to the patient was €568 per year. The total direct cost for moderate-to-severe IBS-C was €1635.

DISCUSSION

The majority of patients reported continuous IBS-C symptoms despite that 80% were taking medication to treat their IBS-C. Overall healthcare resource use and direct costs were asymmetric, with a small group of patients consuming the majority of resources.

Psychometric validation of the work productivity and activity impairment questionnaire in ulcerative colitis: results from a systematic literature review

Patients with ulcerative colitis, a type of inflammatory bowel disease, report negative impacts of disease symptoms on work-related outcomes, including absenteeism and presenteeism. As a way to better understand the impact of this disease and its treatment on work-related outcomes, the current review examines the use of the Work Productivity and Activity Impairment Questionnaire (WPAI), a patient-reported outcomes measure of absenteeism, presenteeism, and impairment in other activities, in studies of patients with ulcerative colitis. This review assesses the measurement properties of the WPAI in this patient population: its reliability, construct validity, ability to detect change, and responsiveness to effective treatments. Relevant data were extracted from 13 sources (journal articles and conference posters) identified following a systematic review of the published and gray literature. The evidence supports the WPAI as having test-retest reliability (reproducibility) over time; convergent validity, as indicated by moderate correlations with measures of quality of life and moderate-to-strong correlations with measures of disease activity; known-groups validity, as indicated by differences in WPAI scores between patients with active and inactive disease; ability (sensitivity) to detect change, as indicated by substantial improvement in scores for patients who achieve remission, accompanied by substantial worsening of scores for patients who relapse; and, responsiveness to treatment, with improvements in scores following treatments that reduce disease activity. Limitations included a lack of available evidence from randomized-controlled trials that could speak more directly to the WPAI's responsiveness to treatment. In conclusion, we recommend the use of the WPAI for measuring work outcomes in both observational studies and interventional trials that include patients with ulcerative colitis.

Workability for persons with chronic diseases. A systematic review of validity and utility of assessments in German language / Valide und praktikable deutschsprachige Assessments zur Erfassung der Arbeitsfähigkeit bei Menschen mit chronischen Erkrankungen – eine systematische Review

Background

People with chronic diseases are often limited in their workability. Evaluating and enabling workability is central in rehabilitation. The aim of this study was to evaluate validity and utility of workability assessments in German for persons with chronic diseases.

Methods

The study is a systematic review. First, we systematically searched for literature in the databases Medline, CINAHL, PsycInfo, Cochrane HTA Database, DARE, CCMed, Sowiport, and BASE using following keywords: evaluation tool, chronic disease, workability, validity, and utility. Then, we evaluated the content and the quality of the studies based on criteria and decided if they were included.

Results

In total, validity and utility of eight workability assessments are described based on 74 studies. The assessments are: Productivity Costs Questionnaire (iPCQ), Work Instability Scale for Rheumatoid Arthritis (RA-WIS), Screening-Instrument Arbeit und Beruf (SIBAR), Screening-Instrument zur Feststellung des Bedarfs an medizinisch-beruflich orientierten Maßnahmen in der medizinischen Rehabilitation (SIMBO), Valuation of Lost Productivity Questionnaire (VOLP), Work Ability Index (WAI/ABI), Work Limitations Questionnaire (WLQ), and Work Productivity and Activity Impairment Questionnaire (WPAI).

Conclusion

The results revealed the availability of eight workability assessments for persons with chronic diseases in German language. They have strengths and weaknesses in relation to the construct, purpose, application, and evidence base. These could be the base for choice of an assessment. Overall, we suggest using workability assessment in order to meet the legal requirements for the use of standardized assessments and the increasing demand to establish evidence of the effectiveness of interventions.

Large-scale clinical implementation of PROMIS computer adaptive testing with direct incorporation into the electronic medical record

The objective of this research was to assess the implementation of collecting patient-reported outcomes data in the outpatient clinics of a large academic hospital and identify potential barriers and solutions to such an implementation. Three PROMIS computer adaptive test instruments, (1) physical function, (2) pain interference, and (3) depression, were administered at 23,813 patient encounters using a novel software platform on tablet computers. The average time to complete was 3.50 ± 3.12 min, with a median time of 2.60 min. Registration times for new patients did not change significantly, 6.87 ± 3.34 to 7.19 ± 2.69 min. Registration times increased for follow-up (p = .007) from 2.94 ± 1.57 (p < .01) min to 3.32 ± 1.78 min. This is an effective implementation strategy to collect patient-reported outcomes and directly import the results into the electronic medical record in real time for use during the clinical visit.

Development and Application of Direct Data Capture for Monitoring Medication Compliance in Clinical Trials

OBJECTIVES

The monitoring of medication compliance in clinical trials is important but labor intensive. To check medication compliance in clinical trials, a system was developed, and its technical feasibility evaluated.

METHODS

The system consisted of three parts: a management part (clinical trial center database and a developed program), clinical trial investigator part (monitoring), and clinical trial participant part (personal digital assistant [PDA] with a barcode scanner). The system was tested with 20 participants for 2 weeks, and compliance was evaluated.

RESULTS

This study developed a medication compliance monitoring system that used a PDA with a barcode scanner, which sent reminder/warning messages, logged medication barcode data, and provided compliance information to investigators. Registered participants received short message service (SMS) reminder/warning messages on their PDA and sent barcode data at the dosing time. The age range of the participants was 29 to 73 years. Five participants were <50 years old and 8 were ≥65 years old. The total mean compliance rate was 82.3%. The mean compliance rate was 83.1% in participants <65 years old and 81.1% in those ≥65 years old.

CONCLUSIONS

The system was feasible, usable, and effective, even with elderly participants, for monitoring medication compliance in clinical trials using a PDA with a barcode scanner, and may improve the quality of clinical trials.

Assessing the Comparability of Paper and Electronic Versions of the EORTC QOL Module for Head and Neck Cancer: A Qualitative Study

BACKGROUND

Patient-reported outcome (PRO) instruments are important tools for monitoring disease activity and response to treatment in clinical trials and clinical practice. In recent years, there have been movements away from traditional pen-and-paper PROs towards electronic administration. When using electronic PROs (ePROs), evidence that respondents complete ePROs in a similar way to their paper counterparts provides assurance that the two modes of administration are comparable or equivalent. The European Organisation for Research and Treatment of Cancer (EORTC) Quality of Life Questionnaire-Core 30 item (EORTC QLQ-C30) and associated disease-specific modules are among the most widely used PROs in oncology. Although studies have evaluated the comparability and equivalence of electronic and original paper versions of the EORTC QLQ-C30, no such studies have been conducted to date for the head and neck cancer specific module (EORTC QLQ-H&N35).

OBJECTIVE

This study aimed to qualitatively assess the comparability of paper and electronic versions of the EORTC QLQ-H&N35.

METHODS

Ten head and neck cancer patients in the United States underwent structured cognitive debriefing and usability interviews. An open randomized crossover design was used in which participants completed the two modes of administration allocated in a randomized order. Using a "think-aloud" process, participants were asked to speak their thoughts aloud while completing the EORTC QLQ-H&N35. They were thoroughly debriefed on their responses to determine consistency in interpretation and cognitive process when completing the instrument in both paper and electronic format.

RESULTS

Participants reported that the EORTC QLQ-H&N35 demonstrated excellent qualitative comparability between modes of administration. The proportion of noncomparable responses (ie, where the thought process used by participants for selecting responses appeared to be different) observed in the study was low (11/350 response pairs [35 items x 10 participants]; 3.1%). Evidence of noncomparability was observed for 9 of the 35 items of the EORTC QLQ-H&N35 and in no more than 2 participants per item. In addition, there were no apparent differences in level of comparability between individual participants or between modes of administration.

CONCLUSIONS

Mode of administration does not affect participants' response to, or interpretation of, items in the EORTC QLQ-H&N35. The findings from this study add to the existing evidence supporting the use of electronic versions of the EORTC instruments when migrated to electronic platforms according to best practice guidelines.

Evaluation of the Swedish Web-Version of Quality of Recovery (SwQoR): Secondary Step in the Development of a Mobile Phone App to Measure Postoperative Recovery

BACKGROUND

The majority of all surgeries are performed on an outpatient basis (day surgery). The Recovery Assessment by Phone Points (RAPP) app is an app for the Swedish Web-version of Quality of Recovery (SwQoR), developed to assess and follow-up on postoperative recovery after day surgery.

OBJECTIVES

The objectives of this study are (1) to estimate the extent to which the paper and app versions of the SwQoR provide equivalent values; (2) to contribute evidence as to the feasibility and acceptability of a mobile phone Web-based app for measuring postoperative recovery after day surgery and enabling contact with a nurse; and (3) to contribute evidence as to the content validity of the SwQoR.

METHODS

Equivalence between the paper and app versions of the SwQoR was measured using a randomized crossover design, in which participants used both the paper and app version. Feasibility and acceptability was evaluated by a questionnaire containing 16 questions regarding the value of the app for follow-up care after day surgery. Content validity evaluation was based on responses by day surgery patients and the staff of the day surgery department.

RESULTS

A total of 69 participants completed the evaluation of equivalence between the paper and app versions of the SwQoR. The intraclass correlation coefficient (ICC) for the SwQoR was .89 (95% CI 0.83-0.93) and .13 to .90 for the items. Of the participants, 63 continued testing the app after discharge and completed the follow-up questionnaire. The median score was 69 (inter-quartile range, IQR 66-73), indicating a positive attitude toward using an app for follow-up after day surgery. A total of 18 patients and 12 staff members participated in the content validity evaluation. The item-level content validity index (I-CVI) for the staff group was in the 0.64 to 1.0 range, with a scale-level content validity index (S-CVI) of 0.88. For the patient group, I-CVI was in the range 0.30 to 0.92 and S-CVI was 0.67. The content validity evaluation of the SwQoR, together with three new items, led to a reduction from 34 to 24 items.

CONCLUSIONS

Day surgery patients had positive attitudes toward using the app for follow-up after surgery, and stated a preference for using the app again if they were admitted for a future day surgery procedure. Equivalence between the app and paper version of the SwQoR was found, but at the item level, the ICC was less than .7 for 9 items. In the content validity evaluation of the SwQoR, staff found more items relevant than the patients, and no items found relevant by either staff or patients were excluded when revising the SwQoR.

Psychometric equivalence of electronic and telephone completion of the ICIQ modules

AIMS

To assess the equivalence of touch-screen (hand-held iPad) and telephone completion of patient-completed International Consultation on Incontinence Questionnaire (ICIQ) modules by comparison with corresponding data collected using conventional paper-and-pencil methods.

METHODS

Men and women, attending urology outpatients complaining of LUTS, were randomised to one of three groups which determined the order in which they completed three administrations of the same questionnaire: paper, iPad and telephone. Four ICIQ questionnaires were evaluated: ICIQ-MLUTS, ICIQ-LUTSqol, ICIQ-OABqol and ICIQ-UI SF.

RESULTS

From August 2012 to October 2014 a total of 448 out of 491 (91%) recruits completed the first two administrations and were included in the analysis. Three hundred forty-eight out of 491 (71%) completed the phone administration. The intra-class correlation coefficient (ICC) and Kappa statistic were calculated where appropriate between completed pairs of administrations. Mean ICC correlations were high (>0.8) between paper and iPad administrations. Paired paper and phone administrations were less well correlated, although still high (mean ICC>0.75). This may be partly due to the practical limitation that the phone interview was completed up to a week later than the initial two administrations. There was no evidence that potential moderator effects (gender, age and experience with computers or touch screen devices) significantly affected overall reliability of scores between administrations.

CONCLUSIONS

We can recommend the interchangeable use of ICIQ electronic or paper based questionnaires in a clinical or research setting. Self-report is preferable to telephone delivery where possible. Neurourol. Urodynam. 9999:XX-XX, 2016. © 2016 Wiley Periodicals, Inc.

High Level of Agreement between Electronic and Paper Mode of Administration of a Thyroid-Specific Patient-Reported Outcome, ThyPRO

INTRODUCTION AND PURPOSE

Use of electronic questionnaires to collect health-related quality-of-life data has evolved as an alternative to paper questionnaires. For the electronic questionnaire to be used interchangeably with the validated paper questionnaire, measurement properties similar to the original must be demonstrated. The aim of the present study was to assess the equivalence between the paper version and the electronic version of the thyroid-related quality-of-life questionnaire ThyPRO.

METHODS

Patients with Graves' hyperthyroidism or autoimmune hypothyroidism in a clinically stable phase were included. The patients were recruited from two endocrine outpatient centers. All patients completed both versions in a randomized test-retest set-up. Scores were compared using intraclass correlation coefficients (ICCs), paired t tests and Bland-Altman plots. Limits of agreement were compared with data from a previous paper-paper test-retest study.

RESULTS

104 patients were included. ICCs were generally high for the 13 scales, ranging from 0.76 to 0.95. There was a small but significant difference in the scale score between paper and electronic administration for the Cosmetic complaints scale, but no differences were found for any other scale. Bland-Altman plots showed similar limits of agreement compared to the earlier test-retest study of the paper version of ThyPRO.

CONCLUSION

Based on our analyses using ICCs, paired t tests and Bland-Altman plots, we found adequate agreement between the paper and electronic questionnaires. The statistically significant difference in score found in the Cosmetic complaints scale is small and probably clinically insignificant.

Test-retest Reliability and Correlations of 5 Global Measures Addressing At-work Productivity Loss in Patients with Rheumatic Diseases

OBJECTIVE

Several global measures to assess at-work productivity loss or presenteeism in patients with rheumatic diseases have been proposed, but the comparative validity is hampered by the lack of data on test-retest reliability and comparative concurrent and construct validity. Our objective was to test-retest 5 global measures of presenteeism and to compare the association between these scales and health-related well-being.

METHODS

Sixty-five participants with inflammatory arthritis or osteoarthritis in paid employment were recruited from 7 countries (UK, Canada, Netherlands, France, Sweden, Romania, and Italy). At baseline and 2 weeks later, 5 global measures of presenteeism were evaluated: the Work Productivity Scale-Rheumatoid Arthritis (WPS-RA), Work Productivity and Activity Impairment Questionnaire (WPAI), Work Ability Index (WAI), Quality and Quantity questionnaire (QQ), and the WHO Health and Performance Questionnaire (HPQ). Agreement between the 2 timepoints was assessed using single-measure intraclass correlations (ICC) and correlated between each other and with visual analog scale general well-being scores at followup by Spearman correlation.

RESULTS

ICC between measures ranged from fair (HPQ 0.59) to excellent (WPS-RA 0.78). Spearman correlations between measures were moderate (Qquality vs WAI, r = 0.51) to strong (WPS-RA vs WPAI, r = 0.88). Correlations between measures and general well-being were low to moderate, ranging from -0.44 ≤ r ≤ 0.66.

CONCLUSION

Test-retest results of 4 out of 5 global measures were good, and the correlations between these were moderate. The latter probably reflect differences in the concepts, recall periods, and references used in the measures, which implies that some measures are probably not interchangeable.

Comparing the measurement equivalence of EQ-5D-5L across different modes of administration

BACKGROUND

Interest in collecting Patient Reported Outcomes using electronic methods such as mobile phones has increased in recent years. However there is debate about the level of measurement equivalence between the traditional paper and newer electronic modes. Information about the acceptability of the electronic versions to respondents is also required. The aim of this study is to compare the equivalence of delivering a widely used generic measure of health status (EQ-5D-5L) across two administration modes (paper and mobile phone).

METHODS

Respondents from a research cohort of people in South Yorkshire were identified, and randomly allocated to one of two administration modes (paper vs. mobile phone) based on stratifications for age and gender (and across a range of self-reported health conditions). A parallel group design was used where each respondent only completed EQ-5D-5L using one of the modes. In total, 70 respondents completed the measure in the mobile phone arm, and 66 completed the standard paper version. Follow up usability questions were also included to assess the acceptability of the mobile version of EQ-5D-5L. Measurement equivalence was compared at the dimension, utility score and visual analogue scale level using chi square analysis and ANOVA, and by comparing mean differences to an estimated minimally important difference value.

RESULTS

Response rates were higher in the mobile arm. The mean EQ-5D-5L utility and VAS scores, and the frequency of respondents endorsing individual EQ-5D-5L dimension response levels did not significantly differ across the administration modes. The majority of the mobile arm agreed that the mobile version of EQ-5D-5L was easy to complete, and that the phone was easy to use, and that they would complete mobile health measures again.

CONCLUSIONS

Completing health status measures such as EQ-5D using mobile phones produces equivalent results to more traditional methods, but with added benefits (for example lessening the burden of data entry). Respondents are positive towards completing questionnaires using these methods. The results provide evidence that electronic measures are valid for use to collect data in a range of settings including clinical trials, routine care, and in health diary settings.

Change in Quality of Life for Patients with Irritable Bowel Syndrome following Referral to a Gastroenterologist: A Cohort Study

BACKGROUND

Irritable bowel syndrome (IBS), a chronic functional condition, considerably reduces quality of life (QoL) and referral to gastroenterology is common. Until now, however, the impact of seeing a gastroenterologist for IBS on patients' QoL and utility has not been assessed.

METHODS

Patients referred with "probable IBS" to the Nottingham Treatment Centre between October 2012 and March 2014 were invited to complete a QoL questionnaire (EuroQol-5 Dimension) before their first appointment. Patients with confirmed IBS who completed this baseline assessment were sent follow-up questionnaires three and twelve months later. Global QoL and utility were measured at each time point and change from baseline calculated. Paired t-tests analysed the significance of any change.

RESULTS

Of 205 invited patients, 69 were eligible and recruited. Response at three and twelve months was 45% and 17% respectively. Median global QoL at baseline was 67.5 (Interquartile range [IQR] 50.0 to 80.0), with a mean increase of 3.25 (95% confidence interval [CI] -5.38 to 11.88) three months later and a mean decrease of -1.82 (95% CI -16.01 to 12.38) after one year. The median utility at baseline was 0.76 (IQR 0.69 to 0.80), with a mean increase of 0.06 (95%CI -0.01 to 0.14) at three months and no change, 0.00 (-0.16 to 0.16), after one year.

CONCLUSION

Patients experienced a small but not statistically significant increase in QoL and utility three months after seeing a gastroenterologist for IBS, which was not maintained. Gastroenterology referral does not appear to appreciably improve Qol for most people with IBS.

Capturing Patient-Reported Outcome (PRO) Data Electronically: The Past, Present, and Promise of ePRO Measurement in Clinical Trials

Patient-reported outcomes (PROs) are an important means of evaluating the treatment benefit of new medical products. It is recognized that PRO measures should be used when assessing concepts best known by the patient or best measured from the patient's perspective. As a result, there is growing emphasis on well defined and reliable PRO measures. In addition, advances in technology have significantly increased electronic PRO (ePRO) data collection capabilities and options in clinical trials. The movement from paper-based to ePRO data capture has enhanced the integrity and accuracy of clinical trial data and is encouraged by regulators. A primary distinction in the types of ePRO platforms is between telephone-based interactive voice response systems and screen-based systems. Handheld touchscreen-based devices have become the mainstay for remote (i.e., off-site, unsupervised) PRO data collection in clinical trials. The conventional approach is to provide study subjects with a handheld device with a device-based proprietary software program. However, an emerging alternative for clinical trials is called bring your own device (BYOD). Leveraging study subjects' own Internet-enabled mobile devices for remote PRO data collection (via a downloadable app or a Web-based data collection portal) has become possible due to the widespread use of personal smartphones and tablets. However, there are a number of scientific and operational issues that must be addressed before BYOD can be routinely considered as a practical alternative to conventional ePRO data collection methods. Nevertheless, the future for ePRO data collection is bright and the promise of BYOD opens a new chapter in its evolution.

Estimating productivity costs in health economic evaluations: a review of instruments and psychometric evidence

Health economic evaluations (i.e. cost-effectiveness appraisal of an intervention) are useful aids for decision makers responsible for the allocation of scarce healthcare resources. The relevance of including health-related productivity costs (or benefits) in these evaluations is increasingly recognized and, as such, reliable and valid instruments to quantify productivity costs are needed. Over the years, a number of work productivity instruments have emerged in the literature, along with a growing body of psychometric evidence. The overall aim of this paper is to provide a review of available instruments with potential for estimating health-related productivity costs. This included the Health and Labor Questionnaire, Health and Work Performance Questionnaire, Health-Related Productivity Questionnaire Diary, Productivity and Disease Questionnaire, Quantity and Quality method, Stanford Presenteeism Scale 13, Valuation of Lost Productivity, Work and Health Interview, Work Limitations Questionnaire, Work Productivity and Activity Impairment Questionnaire, and Work Productivity Short Inventory. Critical discussions on the instruments' overall strengths and limitations, applicability for health economic evaluations, as well as the methodological quality of existing psychometric evidence were provided. Lastly, a set of reflective questions were proposed for users to consider when selecting an instrument for health economic evaluations.

Review article: the economic impact of the irritable bowel syndrome

BACKGROUND

Irritable bowel syndrome (IBS) is a chronic functional disorder of the gastrointestinal system affecting a large number of people worldwide. Whilst it has no attributable mortality, it has substantial impact on patients' quality of life (QoL) and is associated with considerable healthcare resource use.

AIM

To review the economic impact of IBS, firstly on the individual, secondly on healthcare systems internationally and thirdly to society.

METHODS

Appropriate databases were searched for relevant papers using the terms: Irritable Bowel Syndrome; IBS; irritable colon; functional bowel/colonic disease; economics; health care/service costs; health expenditure/resources; health care/service utilisation; productivity.

RESULTS

Irritable bowel syndrome impacts most substantially on patients' work and social life. Reduction in QoL is such that on average patients would sacrifice between 10 and 15 years of their remaining life expectancy for an immediate cure. Between 15% and 43% of patients pay for remedies. No studies quantify loss of earnings related to IBS. Direct care costs are substantial; 48% of patients incur some costs in any year with annual international estimates per patient of: USA $742-$7547, UK £90-£316, France €567-€862, Canada $259, Germany €791, Norway NOK 2098 (€262) and Iran $92. Minimising extensive diagnostic investigations could generate savings and has been shown as not detrimental to patients. Cost to industry internationally through absenteeism and presenteeism related to IBS is estimated between £400 and £900 per patient annually.

CONCLUSIONS

Irritable bowel syndrome is associated with substantial costs to patients, healthcare systems and society. Considerable benefit could be obtained from effective interventions.

PRO data collection in clinical trials using mixed modes: report of the ISPOR PRO mixed modes good research practices task force

The objective of this report was to address the use and mixing of data collection modes within and between trials in which patient-reported outcome (PRO) end points are intended to be used to support medical product labeling. The report first addresses the factors that should be considered when selecting a mode or modes of PRO data collection in a clinical trial, which is often when mixing is first considered. Next, a summary of how to "faithfully" migrate instruments is presented followed by a section on qualitative and quantitative study designs used to evaluate measurement equivalence of the new and original modes of data collection. Finally, the report discusses a number of issues that must be taken into account when mixing modes is deemed necessary or unavoidable within or between trials, including considerations of the risk of mixing at different levels within a clinical trial program and mixing between different types of platforms. In the absence of documented evidence of measurement equivalence, it is strongly recommended that a quantitative equivalence study be conducted before mixing modes in a trial to ensure that sufficient equivalence can be demonstrated to have confidence in pooling PRO data collected by the different modes. However, we also strongly discourage the mixing of paper and electronic field-based instruments and suggest that mixing of electronic modes be considered for clinical trials and only after equivalence has been established. If proceeding with mixing modes, it is important to implement data collection carefully in the trial itself in a planned manner at the country level or higher and minimize ad hoc mixing by sites or individual subjects. Finally, when mixing occurs, it must be addressed in the statistical analysis plan for the trial and the ability to pool the data must be evaluated to then evaluate treatment effects with mixed modes data. A successful mixed modes trial requires a "faithful migration," measurement equivalence established between modes, and carefully planned implementation to minimize the risk of increased measurement error impacting the power of the trial to detect a treatment effect.

Opioid-induced constipation in patients with chronic noncancer pain in the USA, Canada, Germany, and the UK: descriptive analysis of baseline patient-reported outcomes and retrospective chart review

BACKGROUND

The characteristics of patients who suffer from noncancer pain and opioid-induced constipation are not well understood.

METHODS

Cross-sectional patient survey and chart review data from the baseline assessment of an ongoing longitudinal study in the USA, Canada, Germany, and the UK were evaluated via descriptive statistics. Participants had confirmation of daily opioid therapy ≥30 mg for ≥4 weeks and self-reported opioid-induced constipation. Response to laxatives was defined by classifying participants into categories of laxative use and evaluating the prevalence of inadequate response to one laxative agent and two or more agents from at least two different laxative classes. Outcomes included the Patient Assessment of Constipation-Symptoms, Work Productivity and Activity Impairment Questionnaire-Specific Health Problem, EuroQOL 5 Dimensions, and Global Assessment of Treatment Benefit, Satisfaction, and Willingness to Continue.

RESULTS

Patients reported a mean of 1.4 bowel movements not preceded by laxatives and 3.7 bowel movements with laxative use per week; 83% wanted at least one bowel movement per day. Most commonly reported on Patient Assessment of Constipation-Symptoms were straining/squeezing to pass bowel movements (83%), bowel movements too hard (75%), flatulence (69%), and bloating (69%). Eighty-four percent were taking natural or behavioral therapies; 60% were taking at least one over-the-counter laxative; and 19% were taking at least one prescription laxative. Prevalence of inadequate response to one laxative agent was 94%; inadequate response to two or more agents from at least two different laxative classes was 27%. Mean Work Productivity and Activity Impairment Questionnaire-Specific Health Problem values for percent work time missed, percent impairment while working, and percent activity impairment were 9%, 32% (equivalent of 14 hours of lost productivity per week), and 38%. Mean EuroQOL 5 Dimensions index and visual analog scale scores were 0.49 and 50.6, respectively. Forty-four percent reported being satisfied with their treatment for constipation.

CONCLUSION

Patients treated with opioids for noncancer pain commonly endure constipation symptoms that limit their work productivity and overall health-related quality of life while adhering to treatments that provide little relief. Further research is needed to identify more efficacious constipation therapies for this patient population.

Comparação das formas de aplicação papel e caneta e eletrônica do índice de estresse parental versão reduzida (PSI-SF)

Objetivo avaliar se a aplicação eletrônica do Índice de Estresse Parental – versão reduzida (PSI-SF) é comparável à aplicação em formato papel e caneta. Verificar o estresse em pais de crianças com desenvolvimento normal. Métodos quarenta adultos, pais de crianças entre seis meses e 10 anos, foram divididos em quatro grupos, sendo pareados por idade, sexo, escolaridade e idade da criança. Cada participante completou o questionário em duas ocasiões, com intervalo de sete a dez dias, nas versões: papel-caneta/papel-caneta (PP), papel-caneta/eletrônico (PE), eletrônico/eletrônico (EE), eletrônico/papel-caneta (EP). O PSI-SF apresenta 36 afirmações, divididas em três subescalas: Sofrimento Parental (SP); Interações Disfuncionais entre Pai e Criança (IDPC) e Criança Difícil (CD). Para análise dos dados foram realizadas as correlações (Pearson) e comparação da pontuação do PSI-SF intra e inter-grupos. Resultados foram obtidas correlações positivas fortes e médias e significantes entre a pontuação total e das subescalas do PSI-SF na primeira e segunda aplicação, para todos os grupos. Diferenças significantes foram observadas entre as médias das pontuações para o grupo PP (subescala “Criança Difícil”;) e grupo EE (subescala “Criança Difícil”; e pontuação total). No entanto, tais diferenças de pontuação não alteraram a interpretação do resultado do questionário. Não houve diferença significante entre os grupos para as quatro subescalas analisadas, confirmando equivalência da variância entre os grupos. O estresse dos participantes, em todas as subescalas, recaiu dentro da normalidade. Conclusão a aplicação no formato eletrônico do questionário PSI-SF apresenta resultados semelhantes à aplicação papel e caneta. Os níveis de estresse observados foram considerados normais.

Equivalence and measurement properties of an electronic version of the Psoriasis Symptom Inventory

PURPOSE

To evaluate the equivalence of electronic and paper versions of the Psoriasis Symptom Inventory and to examine measurement properties of the electronic version.

METHODS

In a prospective, randomized, crossover, non-interventional study in adult subjects (age ≥18 years) with plaque psoriasis conducted over a period of 15 days, subjects were randomized to two groups, completing either the paper or electronic Psoriasis Symptom Inventory daily for 7 consecutive days followed by the alternate version. Equivalence was assessed by the intraclass correlation coefficient (ICC) between both administration modes. Differences in scores were also tested using paired Student's t test. Measurement properties included internal consistency reliability, test-retest reliability, and convergent and discriminant validity between the Psoriasis Symptom Inventory and (1) disease-specific (Dermatology Life Quality Index) and (2) general health (SF-36v2) status.

RESULTS

Eighty subjects [74 % (59/80) moderate-to-severe psoriasis; 26 % (21/80) mild psoriasis receiving systemic treatment] were enrolled from 8 sites in the USA. The two modes were highly concordant for both total (ICC = 0.97) and individual item scores (ICC range = 0.93-0.97). Response bias testing showed no differences based on completion order with all ICC values >0.91. All mean score differences, except for one item ("flaking"), were non-significant (P > 0.05). Minimum values for reliability (>0.70) and validity (convergent, r ≥ 0.40) were exceeded for the electronic Psoriasis Symptom Inventory.

CONCLUSIONS

Equivalence between paper and electronic versions of the Psoriasis Symptom Inventory and strong measurement properties of the electronic mode indicated a successful migration from paper to electronic format of the Psoriasis Symptom Inventory.

The clinical effectiveness of web-based cognitive behavioral therapy with face-to-face therapist support for depressed primary care patients: randomized controlled trial

Background

Most patients with mild to moderate depression receive treatment in primary care, but despite guideline recommendations, structured psychological interventions are infrequently delivered. Research supports the effectiveness of Internet-based treatment for depression; however, few trials have studied the effect of the MoodGYM program plus therapist support. The use of such interventions could improve the delivery of treatment in primary care.

Objective

To evaluate the effectiveness and acceptability of a guided Web-based intervention for mild to moderate depression, which could be suitable for implementation in general practice.

Methods

Participants (N=106) aged between 18 and 65 years were recruited from primary care and randomly allocated to a treatment condition comprising 6 weeks of therapist-assisted Web-based cognitive behavioral therapy (CBT), or to a 6-week delayed treatment condition. The intervention included the Norwegian version of the MoodGYM program, brief face-to-face support from a psychologist, and reminder emails. The primary outcome measure, depression symptoms, was measured by the Beck Depression Inventory-II (BDI-II). Secondary outcome measures included the Beck Anxiety Inventory (BAI), the Hospital Anxiety and Depression Scale (HADS), the Satisfaction with Life Scale (SWLS), and the EuroQol Group 5-Dimension Self-Report Questionnaire (EQ-5D). All outcomes were based on self-report and were assessed at baseline, postintervention, and at 6-month follow-up.

Results

Postintervention measures were completed by 37 (71%) and 47 (87%) of the 52 participants in the intervention and 54 participants in the delayed treatment group, respectively. Linear mixed-models analyses revealed a significant difference in time trends between the groups for the BDI-II, (P=.002), for HADS depression and anxiety subscales (P<.001 and P=.001, respectively), and for the SWLS (P<.001). No differential group effects were found for the BAI and the EQ-5D. In comparison to the control group, significantly more participants in the intervention group experienced recovery from depression as measured by the BDI-II. Of the 52 participants in the treatment program, 31 (60%) adhered to the program, and overall treatment satisfaction was high. The reduction of depression and anxiety symptoms was largely maintained at 6-month follow-up, and positive gains in life satisfaction were partly maintained.

Conclusions

The intervention combining MoodGYM and brief therapist support can be an effective treatment of depression in a sample of primary care patients. The intervention alleviates depressive symptoms and has a significant positive effect on anxiety symptoms and satisfaction with life. Moderate rates of nonadherence and predominately positive evaluations of the treatment also indicate the acceptability of the intervention. The intervention could potentially be used in a stepped-care approach, but remains to be tested in regular primary health care.

Trial Registration

Australian New Zealand Clinical Trials Registry: ACTRN12610000257066; http://apps.who.int/trialsearch/trial.aspx?trialid=ACTRN12610000257066 (Archived by WebCite at http://www.webcitation.org/6Ie3YhIZa).

Feasibility of using a handheld electronic device for the collection of patient reported outcomes data from children

The manner in which a communication disorder affects health-related quality of life (QOL) in children is not known. Unfortunately, collection of quality of life data via traditional paper measures is labor intensive and has several other limitations, which hinder the investigation of pediatric quality of life in children. Currently, there is not sufficient research regarding the use of electronic devices to collect pediatric patient reported outcomes in order to address such limitations. Thus, we used a cross-over design to compare responses to a pediatric health quality of life instrument (PedsQL 4.0) delivered using a handheld electronic device to those from a traditional paper form. Respondents were children with (n=9) and without (n=10) a speech or voice disorder. For paper versus the electronic format, we examined time to completion, number of incomplete or inaccurate question responses, intra-rater reliability, ease of use, and child and parent preference. There were no significant differences between children's scores, time to complete the measure, or ratings related to ease of answering questions. The percentage of children who made answering errors or omissions with paper and pencil was significantly greater than the percentage of children who made such errors using the device. This preliminary study demonstrated that use of an electronic device to collect QOL or patient-reported outcomes (PRO) data from children is more efficient than and just as feasible, reliable, and acceptable as using paper forms. The development of hardware and software applications for the collection of QOL and/or PRO data in children with speech disorders is likely warranted.

LEARNING OUTCOMES

The reader will be able to understand: (1) The potential benefits of using electronic data capture via handheld devices for collecting pediatric patient reported outcomes; (2) The Pediatric Quality of Life Inventory 4.0 is a measure of the perception of general health quality that has distinguished between healthy children and those with chronic health conditions; (3) Past research in communication disorders indicates that voice and speech disorders may impact quality of life in children; (4) Based on preliminary data, electronic collection of patient reported outcomes in children with and without speech/voice disorders is more efficient and equally feasible, reliable, and acceptable when compared to paper forms.

Measuring time input loss among patients with rheumatoid arthritis: validity and reliability of the Valuation of Lost Productivity questionnaire

OBJECTIVE

To examine the validity and test-retest reliability of the Valuation of Lost Productivity (VOLP) questionnaire among patients with rheumatoid arthritis (RA).

METHODS

Absenteeism, presenteeism, and unpaid work loss due to health were measured. Patients with RA who had paid work at their recent follow-up were recruited from the Early RA Network cohort. The VOLP was administered on two occasions.

RESULTS

A total of 152 patients were included in our analysis. The correlations between VOLP and function, pain, fatigue, and disease activity ranged 0.24 to 0.42. The correlations between VOLP and Work Productivity and Activity Impairment questionnaire were 0.57 for absenteeism, 0.42 for presenteeism, and 0.39 for unpaid work loss. The Kappa statistics were greater than 0.6 except for unpaid work loss.

CONCLUSIONS

This study provides evidence for the validity of the VOLP in measuring time input loss among people with RA.

Vaginal prolapse--perceptions and healthcare-seeking behavior among women prior to gynecological surgery

OBJECTIVE

To investigate perceptions of vaginal prolapse and healthcare-seeking behavior in women prior to gynecological surgery.

DESIGN

Prospective, cross-sectional study using a web-based questionnaire.

SETTING

Clinics including patients in the Swedish National Register for Gynecological Surgery (Gynop-register).

POPULATION

214 women with vaginal prolapse and 347 women without prolapse as reference patients.

METHODS

A questionnaire was developed for assessment of women's perception of prolapse and their healthcare-seeking behavior. Data were collected through the Gynop-register. For comparisons between the study groups, Student's t-test and the chi-squared test were used.

MAIN OUTCOME MEASURES

Perceptions of prolapse, healthcare-seeking behavior, and source of information.

RESULTS

The most common definition of prolapse reported by the women was presence of a vaginal bulge. Reasons for seeking healthcare were interference with physical activity and increasing symptoms. One in five women with prolapse could not relate the symptoms to prolapse. Participants in the prolapse group gained less information on their own condition from brochures and public media compared to participants in the reference group (p<0.001).

CONCLUSION

There appeared to be a lack of information on pelvic organ prolapse in the public domain. Healthcare professionals have a significant role to play in informing women about symptoms related to the condition and the available treatment options.

Online version of the food allergy quality of life questionnaire-adult form: validity, feasibility and cross-cultural comparison

BACKGROUND

Food-allergic reactions occur in 3-4% of the adult population in Western countries. It has been shown that food allergy may impair health-related quality of life (HRQL). Food allergy quality of life questionnaires (FAQLQs) have been developed and validated, including an adult form (FAQLQ-AF). These questionnaires may be particularly useful for cross-cultural comparisons.

OBJECTIVES

The aims of this study were to translate the FAQLQ-AF from Dutch into English and validate an online version in the United States. Additionally, HRQL of American and Dutch food-allergic adults was compared.

METHODS

The Dutch FAQLQ-AF was translated into English as set out by the World Health Organization and converted to an electronic online format. Participants (food allergic American adults) were recruited through the 'Food Allergy and Anaphylaxis Network' website and completed the questionnaire online. Construct validity, internal consistency, discriminative ability and feasibility were analysed. A cross-cultural comparison was made using the Dutch FAQLQ-AF scores.

RESULTS

Data from 180 American participants were analysed. The online FAQLQ-AF had a good construct validity (correlation with FAIM: ρ=0.72; P<0.001), internal consistency (Cronbach's α=0.95) and was discriminative for 'anaphylaxis' vs. 'no anaphylaxis' and 'number of food allergies'. The most striking finding was a significantly greater impairment in HRQL in the American participants, as compared with their Dutch counterparts (the total FAQLQ-AF scores were 4.3 vs. 3.5, respectively; P<0.001, where 1 signifies no impairment and 7 signifies extreme impairment in HRQL).

CONCLUSIONS AND CLINICAL RELEVANCE

The online American FAQLQ-AF is a valid instrument to measure HRQL in food-allergic patients in the United States. Additionally, HRQL of American food-allergic adults may be more impaired than Dutch food-allergic adults. The FAQLQ-AF can now be used to determine the HRQL in American food-allergic adults and can assist clinicians in optimizing management strategies for food-allergic patients.

Personal digital assistant data capture: the future of quality of life measurement in prostate cancer treatment

PURPOSE

This article examines the potential use of personal digital assistant (PDA) data capture systems for real-time linear monitoring of health-related quality of life (HRQOL) in prostate cancer research and clinical care.

METHODS

We discuss the benefits and potential issues of using PDA data capture in the clinical health care setting. In addition, we describe the development and potential use of a PDA data capture system specific to managing HRQOL in prostate cancer treatment.

CONCLUSION

Follow-up health care clinics require a practical and systematic process of HRQOL data capture and analysis. Traditional paper questionnaire data capture is problematic. Data manipulation required for clinical decision-making is impractical for patient feedback on same-day clinic visits. Furthermore, the process of transforming paper questionnaire data to analysis-quality data can compromise data integrity. In contrast, research findings confirm the acceptability, ease of use, and reliability of PDAs in capturing data across health care settings, including the collection of serial HRQOL data. The main concern for PDA capture systems is the ability to compare respondent's answers between the paper and PDA questionnaire. Other challenges included patients reporting a lack of computer literacy and/or poor eyesight, as well as initial start-up costs. If issues are successfully addressed, the use of a PDA data capture system, such as the PDA HRQOL system at Princess Margaret Hospital's Prostate Centre, allows for valid and economical data collection with the possibility of linear real-time measurement of changes in HRQOL. Accordingly, there appears to be significant potential for PDA data collection of serial HRQOL in prostate cancer clinic settings.

The incidence and risk factors of workplace violence towards female nurses reported via internet in an acute psychiatric hospital

The authors conducted a prospective follow-up study to explore incidence and risk factors related to workplace violence towards nurses. Seventy-seven volunteers were recruited to complete a baseline questionnaire. Participants then used a designated Web site to report violent incidents they encountered during a 6-month period. A generalized estimating equation was used for data analysis. A total of 74 members completed the study; 456 events were reported. The incidence rates of various types of violence are reported in this paper. Risk factors for violence included short duration of employment, marital status, and a high level of anxiety. Strategies to reduce future violence from psychiatric patients include preplacement education that targets this high-risk group of nurses and efforts to reduce the staff anxiety levels.

Validity of the work productivity and activity impairment questionnaire--general health version in patients with rheumatoid arthritis

Introduction

The Work Productivity and Activity Impairment (WPAI) questionnaire is a well validated instrument to measure impairments in work and activities. However, its validation among patients with rheumatoid arthritis (RA) has not been well established. The present study's purpose is to evaluate the construct validity of the WPAI-general health version among RA patients and its ability to differentiate between RA patients with varying health status.

Methods

Patients who were enrolled in the Early Rheumatoid Arthritis Network cohort and were employed at their most recent follow-up were recruited into this sub-study. A questionnaire battery incorporating the WPAI was administered along with a number of health outcomes including the Multidimensional Health Assessment Questionnaire, fatigue and patient assessment of disease activity. The construct validity of the WPAI was tested by the correlations between the WPAI and the health outcomes and other measures of productivity. Student's t tests were used to identify whether the WPAI outcomes differed between the two levels of heath status based on the median of health outcomes.

Results

A total of 150 patients completed the WPAI questionnaire. The average age was 52 years old and the disease duration was 37.5 months since the first rheumatology visit. Of the 137 patients who were working for pay, 26 reported missing work in the past week due to their health problem, accounting for 45.5% of their working time (absenteeism). While 123 patients were working, 24% of their work was impaired due to their health problem (presenteeism). In addition, 33% of the patients' regular daily activities (activity impairment) had been prevented due to their health problems. There were moderate correlations between the WPAI absenteeism and function, pain, fatigue, and disease severity (r = 0.34 to 0.39). The WPAI presenteeism and activity impairment were strongly correlated with the health outcomes (0.67 to 0.77). Patients with more severe disease status (for example, low/high functional disability by median) had significantly higher absenteeism (4%/15%), presenteeism (15%/39%), and activity impairment (19%/53%) than those with less severe disease status.

Conclusions

The WPAI is a valid questionnaire for assessing impairments in paid work and activities in RA patients and for measuring the relative differences between RA patients with different health status.

On-site electronic observational assessment tool for discomfort and pain

Over the recent years pen-paper observational assessment scales have proven to be useful to monitor behaviour and responses of humans and animals. Observational assessment tools are typically applied for subjects who are not able to communicate directly. For on-site observational assessment however it is hard to record and evaluate timing patterns of observed events using pen-paper scales. Although timing information is in many cases assumed highly valuable, only (videotaped) laboratory scales are able to benefit from this knowledge. In the work described in this paper we digitize pen-paper assessment scales resulting in new functionalities capable to improve assessment scores. A study of on-site pain and discomfort assessment of severely demented elderly is presented. The resulting system is a mobile electronic device with a graphical user interface (GUI) on a touch screen. Moreover digital information is stored in a database improving administration, providing immediate feedback and allowing applications like: visualisation, statistical analysis and scientific research like data mining. The device allows easily registering and automatically interpreting complex timing patterns of behaviours and responses, on-site. This feature could be employed in the development of new more accurate observational assessment instruments.

Applying an extended theoretical framework for data collection mode to health services research

Background

Over the last 30 years options for collecting self-reported data in health surveys and questionnaires have increased with technological advances. However, mode of data collection such as face-to-face interview or telephone interview can affect how individuals respond to questionnaires. This paper adapts a framework for understanding mode effects on response quality and applies it to a health research context.

Discussion

Data collection modes are distinguished by key features (whether the survey is self- or interviewer-administered, whether or not it is conducted by telephone, whether or not it is computerised, whether it is presented visually or aurally). Psychological appraisal of the survey request will initially entail factors such as the cognitive burden upon the respondent as well as more general considerations about participation. Subsequent psychological response processes will further determine how features of the data collection mode impact upon the quality of response provided. Additional antecedent factors which may further interact with the response generation process are also discussed. These include features of the construct being measured such as sensitivity, and of the respondent themselves (e.g. their socio-demographic characteristics). How features of this framework relate to health research is illustrated by example.

Summary

Mode features can affect response quality. Much existing evidence has a broad social sciences research base but is of importance to health research. Approaches to managing mode feature effects are discussed. Greater consideration must be given to how features of different data collection approaches affect response from participants in studies. Study reports should better clarify such features rather than rely upon global descriptions of data collection mode.

Construct validity of the Work Productivity and Activity Impairment questionnaire across informal caregivers of chronically ill older patients

OBJECTIVES

To assess the validity of the Work Productivity and Activity Impairment questionnaire as adapted for caregiving (WPAI:CG) to measure productivity loss (hours missed from work, impairment while at work, and impairment in regular activities) due to unpaid caregiving for medically complex older adults.

METHODS

The WPAI:CG was administered along with the Caregiver Strain Index (CSI) and Center for Epidemiologic Studies Depression Scale (CESD) to a caregiving population (N = 308) enrolled with their older, medically complex care-recipient in a cluster-randomized controlled study. Correlation coefficients were calculated between each productivity variable derived from the WPAI:CG and CSI/CESD scores. Nonparametric tests for trend across ordered groups were carried out to examine the relationship between each productivity variable and the intensity of the caregiving.

RESULTS

Significant positive correlations were found between work productivity loss and caregiving-related strain (r = 0.45) and depression (r = 0.30). Measures of productivity loss were also highly associated with caregiving intensity (P < 0.05) and care-recipient medical care use (P < 0.05). The average employed caregiver reported 1.5 hours absence from work in the previous week and 18.5% reduced productivity while at work due to caregiving. Employed and nonemployed caregivers reported 27.2% reduced productivity in regular activities in the previous week.

CONCLUSION

The results indicate high convergent validity of the WPAI:CG questionnaire. This measure could facilitate research on the cost-effectiveness of caregiver-workplace interventions and provide employers and policy experts with a more accurate and comprehensive estimate of caregiving-related costs incurred by employers and society.

The brief fatigue inventory: comparison of data collection using a novel audio device with conventional paper questionnaire

An Electronic Portable Information Collection audio device (EPIC-Vox) has been developed to deliver questionnaires in spoken word format via headphones. Patients respond by pressing buttons on the device. The aims of this study were to determine limits of agreement between, and test-retest reliability of audio (A) and paper (P) versions of the Brief Fatigue Inventory (BFI). Two hundred sixty outpatients (204 male, mean age 55.7 years) attending a sleep disorders clinic were allocated to four groups using block randomization. All completed the BFI twice, separated by a one-minute distracter task. Half the patients completed paper and audio versions, then an evaluation questionnaire. The remainder completed either paper or audio versions to compare test-retest reliability. BFI global scores were analyzed using Bland-Altman methodology. Agreement between categorical fatigue severity scores was determined using Cohen's kappa. The mean (SD) difference between paper and audio scores was -0.04 (0.48). The limits of agreement (mean difference+/-2SD) were -0.93 to +1.00. Test-retest reliability of the paper BFI showed a mean (SD) difference of 0.17 (0.32) between first and second presentations (limits -0.46 to +0.81). For audio, the mean (SD) difference was 0.17 (0.48) (limits -0.79 to +1.14). For agreement between categorical scores, Cohen's kappa=0.73 for P and A, 0.67 (P at test and retest) and 0.87 (A at test and retest). Evaluation preferences (n=128): 36.7% audio; 18.0% paper; and 45.3% no preference. A total of 99.2% found EPIC-Vox "easy to use." These data demonstrate that the English audio version of the BFI provides an acceptable alternative to the paper questionnaire.