The application of computer touch-screen technology in screening for psychosocial distress in an ambulatory oncology setting

Interactive mental health assessments for Chinese Canadians: A pilot randomized controlled trial in nurse practitioner-led primary care clinic

INTRODUCTION

Mental health conditions like depression and anxiety are on the rise, but access to care remains a challenge. Immigrants and racialized communities including Chinese Canadians experience high level of access barriers including communication with clinicians. With the aim to facilitate mental health communications, we tested an Interactive Computer-assisted Client Assessment Survey (iCCAS) in Cantonese/Mandarin and English at a nurse practitioner-led primary care clinic in Toronto. The iCCAS offers a touch-screen, pre-consultation survey with questions on depression, anxiety, post-traumatic stress, alcohol abuse, and social context. The program generates point-of-care reports for the clinician and patient.

METHODS

A pilot randomized controlled trial examined the intervention impact on mental health discussion and symptom detection, compared with the usual care, followed by clinicians' qualitative interviews.

RESULTS

Fifty self-identified Chinese adult patients participated (iCCAS = 26, Usual Care = 24), response rate 79.4%. Participant mean age was 44.8 years and 92% were immigrants. There was an increase of 19% and 15% in the mental health discussion and detection of symptoms in the iCCAS group compared with the usual care. More participants in the iCCAS group were referred to a social worker or psychiatrist. Patients found the use of iCCAS easy and clinicians identified its benefits for themselves (eg, early identification and comfort) and patients (eg, self-awareness and anonymity) and proposed practice-integration.

DISCUSSION

The studied tool holds promise for enhancing clinician-patient mental health communications in primary care settings for overseas Chinese. Implications are discussed for in-person and virtual healthcare which could also inform responses to mental health crisis related to COVID-19.

Computerized adaptive testing to screen children for emotional and behavioral problems by preventive child healthcare

Background

Questionnaires to detect emotional and behavioral problems (EBP) in Preventive Child Healthcare (PCH) should be short which potentially affects validity and reliability. Simulation studies have shown that Computerized Adaptive Testing (CAT) could overcome these weaknesses. We studied the applicability (using the measures participation rate, satisfaction, and efficiency) and the validity of CAT in routine PCH practice.

Methods

We analyzed data on 461 children aged 10–11 years (response 41%), who were assessed during routine well-child examinations by PCH professionals. Before the visit, parents completed the CAT and the Child Behavior Checklist (CBCL). Satisfaction was measured by parent- and PCH professional-report. Efficiency of the CAT procedure was measured as number of items needed to assess whether a child has serious problems or not. Its validity was assessed using the CBCL as the criterion.

Results

Parents and PCH professionals rated the CAT on average as good. The procedure required at average 16 items to assess whether a child has serious problems or not. Agreement of scores on the CAT scales with corresponding CBCL scales was high (range of Spearman correlations 0.59–0.72). Area Under Curves (AUC) were high (range: 0.95–0.97) for the Psycat total, externalizing, and hyperactivity scales using corresponding CBCL scale scores as criterion. For the Psycat internalizing scale the AUC was somewhat lower but still high (0.86).

Conclusions

CAT is a valid procedure for the identification of emotional and behavioral problems in children aged 10–11 years. It may support the efficient and accurate identification of children with overall, and potentially also specific, emotional and behavioral problems in routine PCH.

Acceptability of a Touch Screen Tablet Psychosocial Survey Administered to Radiation Therapy Patients in Japan

BACKGROUND

Studies in western clinical settings suggest that touch screen computer surveys are an acceptable mode of collecting information about cancer patients' wellbeing

PURPOSE

We examined the acceptability of a touch screen tablet survey among cancer patients in Japan.

METHODS

Eligible patients (n = 262) attending a university hospital radiation therapy (RT) department were invited to complete a touch screen tablet survey about psychosocial communication and care. Survey consent and completion rates, the proportion and characteristics of patients who completed the touch screen survey unassisted, and patient-reported acceptability were assessed.

RESULTS

Of 158 consenting patients (consent rate 60 % [95 % CI 54, 66 %] of eligible patients), 152 completed the touch screen computer survey (completion rate 58 % [95 % CI 52, 64 %] of eligible patients). The survey was completed without assistance by 74 % (n = 113; 95 % CI 67, 81 %) of respondents. Older age was associated with higher odds of having assistance with survey completion (OR 1.09; 95 % CI 1.04, 1.14 %). Ninety-two percent of patients (95 % CI 86, 96 %) felt that the touch screen survey was easy to use and 95 % (95 % CI 90, 98 %) agreed or strongly agreed that they were comfortable answering the questions. Overall, 65 % (95 % CI 57, 73 %) of respondents would be willing to complete such a survey more than once while waiting for RT treatment.

CONCLUSIONS

Although patient self-reported acceptability of the touch screen survey was high, self-administered touch screen tablet surveys may not be entirely appropriate for older cancer patients or possibly for patients with lower educational attainment.

Preconsult interactive computer-assisted client assessment survey for common mental disorders in a community health centre: a randomized controlled trial

BACKGROUND

Access disparities for mental health care exist for vulnerable ethnocultural and immigrant groups. Community health centres that serve these groups could be supported further by interactive, computer-based, self-assessments.

METHODS

An interactive computer-assisted client assessment survey (iCCAS) tool was developed for preconsult assessment of common mental disorders (using the Patient Health Questionnaire [PHQ-9], Generalized Anxiety Disorder 7-item [GAD-7] scale, Primary Care Post-traumatic Stress Disorder [PTSD-PC] screen and CAGE [concern/cut-down, anger, guilt and eye-opener] questionnaire), with point-of-care reports. The pilot randomized controlled trial recruited adult patients, fluent in English or Spanish, who were seeing a physician or nurse practitioner at the partnering community health centre in Toronto. Randomization into iCCAS or usual care was computer generated, and allocation was concealed in sequentially numbered, opaque envelopes that were opened after consent. The objectives were to examine the interventions' efficacy in improving mental health discussion (primary) and symptom detection (secondary). Data were collected by exit survey and chart review.

RESULTS

Of the 1248 patients assessed, 190 were eligible for participation. Of these, 148 were randomly assigned (response rate 78%). The iCCAS (n = 75) and usual care (n = 72) groups were similar in sociodemographics; 98% were immigrants, and 68% were women. Mental health discussion occurred for 58.7% of patients in the iCCAS group and 40.3% in the usual care group (p ≤ 0.05). The effect remained significant while controlling for potential covariates (language, sex, education, employment) in generalized linear mixed model (GLMM; adjusted odds ratio [OR] 2.2; 95% confidence interval [CI] 1.1-4.5). Mental health symptom detection occurred for 38.7% of patients in the iCCAS group and 27.8% in the usual care group (p > 0.05). The effect was not significant beyond potential covariates in GLMM (adjusted OR 1.9; 95% CI 0.9-4.1).

INTERPRETATION

The studied intervention holds potential for community health centres to improve mental health discussion. Further research with larger samples should examine the impact on detection and enhance generalizability. Trial registration: ClinicalTrials.gov, no: NCT02023957, registered on Dec. 12, 2013.

Web-based symptom screening in cystic fibrosis patients: A feasibility study

BACKGROUND

Cystic fibrosis (CF) causes high illness burden. Screening may identify patients who could potentially benefit from interventions for symptoms or other sources of distress. We evaluated the feasibility of a web-based system for routine monitoring.

METHODS

Adult CF patients enrolled in a study of palliative care service delivery completed web-based assessments every 30 days on global distress, physical and psychological symptom distress, and the perceived benefits of discussing advance care planning (ACP) with CF clinicians. Feasibility was assessed by the rate of survey completion, survey reminders, and missed surveys during a 9-month rolling enrollment period.

RESULTS

Of 74 participants (47.3% women, 94.4% white), 36.7% had comorbid diabetes, and 56.9% had an FEV1% predicted score of 40-69. In total, patients completed 456 (80.6%) of 566 surveys every 30 days over the assessment period. Sixty-five (87.8%) completed 405 (79.7%) of 508 surveys online and 9 (12.2%) completed 51 (88.0%) of 58 surveys using a combination of online, telephone, and mail-based methods. Many surveys were completed without reminders (online: 261 [64.4%] of 405; combined methods: 29 [56.9%] of 51), with 166 (36.4%) surveys requiring 1 or more reminders. Further, 23.0% (17) of patients noted elevated global distress; 20.3% (15) endorsed physical symptom distress, 12.2% (9) had psychological distress, and 58.1% (43) reported that discussing ACP would be beneficial.

CONCLUSIONS

Repeated web-based screening for symptom distress and ACP preferences is feasible in adult CF patients. Future studies should assess the system's generalizability and staff resources when implementing reminders and non-web methods of completion.

Patient-Reported Outcome Measurement in Clinical Dermatological Practice: Relevance and Feasibility of a Web-Based Portal

BACKGROUND/AIMS

Patient-reported outcomes (PROs) are increasingly considered important. We developed a web-based application to electronically assess PROs in routine dermatological practice. We assessed (1) the relevance of PRO measurement according to health care providers and patients, (2) the feasibility of our application in routine practice according to health care providers, supporting staff and patients, and (3) barriers/facilitators for implementation according to health care providers and supporting staff.

METHODS

Health care providers, supporting staff and patients completed study-specific questionnaires. Also, website statistics were analysed.

RESULTS

3/6 clinics participated, including 9 professionals and 80 patients. Both health care providers and patients rated PRO measurement as relevant. However, implementation was only moderately feasible. Time constraints and logistical problems were mentioned as barriers, and motivated patients and supportive staff as facilitators.

CONCLUSION

Electronic PRO assessment in routine practice is not self-evident. Adjustments in logistics are recommended to optimize implementation, using a plan-do-study-act approach.

Correlates of oncologist-issued referrals for psycho-oncology services: what we learned from the electronic voluntary screening and referral system for depression (eVSRS-D)

OBJECTIVE

Depression in cancer patients is under-recognized and under-treated. To better identify depression, we designed a voluntary depression screening system. Based on its data, we examined trends in oncologist-issued referrals for the psycho-oncology service (POS).

METHODS

The Electronic Voluntary Screening and Referral System for Depression (eVSRS-D) comprises self-screening, automated reporting, and referral guidance. Using touch-screen kiosks at a tertiary hospital in Korea, participants with cancer completed the Patient Health Questionnaire-9 at their convenience, received the results, and reported their willingness to participate in POS. At oncology appointments, oncologists received the screening reports and issued referrals following pre-recommended guidelines. The correlates of actual referrals were examined across all participants and within the willing and non-willing groups.

RESULTS

Among the 838 participants, 56.3% reported severe depression symptoms, 30.5% wanted a referral, and 14.8% were actually referred. The correlates of participants' desire for referral were more severe depression symptoms, being unmarried, and being metastasis and recurrence free. Among all participants, the correlates of actual referrals were unemployment, less severe depression symptoms, poorer performance, treatment status, and wanting a referral. The sole correlate of actual referrals within the non-willing group was poorer performance, and no significant correlates existed within the willing group. The non-referrals were mostly (87.1%) because of postponed decisions.

CONCLUSIONS

The eVSRS-D cannot definitively diagnose major depression but may efficiently self-select a population with significant depression symptoms. The patients' willingness to engage the POS most strongly predicted the actual referrals. Oncologist reviews of screening reports may not result in further depression severity-specific referrals.

Measuring executive function in control subjects and TBI patients with question completion time (QCT)

Questionnaire completion is a complex task that places demands on cognitive functions subserving reading, introspective memory, decision-making, and motor control. Although computerized questionnaires and surveys are used with increasing frequency in clinical practice, few studies have examined question completion time (QCT), the time required to complete each question. Here, we analyzed QCTs in 172 control subjects and 31 patients with traumatic brain injury (TBI) who completed two computerized questionnaires, the 17-question Post-Traumatic Stress Disorder (PTSD) Checklist (PCL) and the 25-question Cognitive Failures Questionnaire (CFQ). In control subjects, robust correlations were found between self-paced QCTs on the PCL and CFQ (r = 0.82). QCTs on individual questions correlated strongly with the number of words in the question, indicating the critical role of reading speed. QCTs increased significantly with age, and were reduced in females and in subjects with increased education and computer experience. QCT z-scores, corrected for age, education, computer use, and sex, correlated more strongly with each other than with the results of other cognitive tests. Patients with a history of severe TBI showed significantly delayed QCTs, but QCTs fell within the normal range in patients with a history of mild TBI. When questionnaires are used to gather relevant patient information, simultaneous QCT measures provide reliable and clinically sensitive measures of processing speed and executive function.

Consumer participation in quality improvements for chronic disease care: development and evaluation of an interactive patient-centered survey to identify preferred service initiatives

Background

With increasing attention given to the quality of chronic disease care, a measurement approach that empowers consumers to participate in improving quality of care and enables health services to systematically introduce patient-centered initiatives is needed. A Web-based survey with complex adaptive questioning and interactive survey items would allow consumers to easily identify and prioritize detailed service initiatives.

Objective

The aim was to develop and test a Web-based survey capable of identifying and prioritizing patient-centered initiatives in chronic disease outpatient services. Testing included (1) test-retest reliability, (2) patient-perceived acceptability of the survey content and delivery mode, and (3) average completion time, completion rates, and Flesch-Kincaid reading score.

Methods

In Phase I, the Web-based Consumer Preferences Survey was developed based on a structured literature review and iterative feedback from expert groups of service providers and consumers. The touchscreen survey contained 23 general initiatives, 110 specific initiatives available through adaptive questioning, and a relative prioritization exercise. In Phase II, a pilot study was conducted within 4 outpatient clinics to evaluate the reliability properties, patient-perceived acceptability, and feasibility of the survey. Eligible participants were approached to complete the survey while waiting for an appointment or receiving intravenous therapy. The age and gender of nonconsenters was estimated to ascertain consent bias. Participants with a subsequent appointment within 14 days were asked to complete the survey for a second time.

Results

A total of 741 of 1042 individuals consented to participate (71.11% consent), 529 of 741 completed all survey content (78.9% completion), and 39 of 68 completed the test-retest component. Substantial or moderate reliability (Cohen’s kappa>0.4) was reported for 16 of 20 general initiatives with observed percentage agreement ranging from 82.1%-100.0%. The majority of participants indicated the Web-based survey was easy to complete (97.9%, 531/543) and comprehensive (93.1%, 505/543). Participants also reported the interactive relative prioritization exercise was easy to complete (97.0%, 189/195) and helped them to decide which initiatives were of most importance (84.6%, 165/195). Average completion time was 8.54 minutes (SD 3.91) and the Flesch-Kincaid reading level was 6.8. Overall, 84.6% (447/529) of participants indicated a willingness to complete a similar survey again.

Conclusions

The Web-based Consumer Preferences Survey is sufficiently reliable and highly acceptable to patients. Based on completion times and reading level, this tool could be integrated in routine clinical practice and allows consumers to easily participate in quality evaluation. Results provide a comprehensive list of patient-prioritized initiatives for patients with major chronic conditions and delivers practice-ready evidence to guide improvements in patient-centered care.

Reliability, validity and sensitivity of a computerized visual analog scale measuring state anxiety

BACKGROUND AND OBJECTIVES

Assessment of state anxiety is frequently required in clinical and research settings, but its measurement using standard multi-item inventories entails practical challenges. Such inventories are increasingly complemented by paper-and-pencil, single-item visual analog scales measuring state anxiety (VAS-A), which allow rapid assessment of current anxiety states. Computerized versions of VAS-A offer additional advantages, including facilitated and accurate data collection and analysis, and applicability to computer-based protocols. Here, we establish the psychometric properties of a computerized VAS-A.

METHODS

Experiment 1 assessed the reliability, convergent validity, and discriminant validity of the computerized VAS-A in a non-selected sample. Experiment 2 assessed its sensitivity to increase in state anxiety following social stress induction, in participants with high levels of social anxiety.

RESULTS

Experiment 1 demonstrated the computerized VAS-A's test-retest reliability (r = .44, p < .001); convergent validity with the State-Trait Anxiety Inventory's state subscale (STAI-State; r = .60, p < .001); and discriminant validity as indicated by significantly lower correlations between VAS-A and different psychological measures relative to the correlation between VAS-A and STAI-State. Experiment 2 demonstrated the VAS-A's sensitivity to changes in state anxiety via a significant pre- to during-stressor rise in VAS-A scores (F(1,48) = 25.13, p < .001).

LIMITATIONS

Set-order administration of measures, absence of clinically-anxious population, and gender-unbalanced samples.

CONCLUSIONS

The adequate psychometric characteristics, combined with simple and rapid administration, make the computerized VAS-A a valuable self-rating tool for state anxiety. It may prove particularly useful for clinical and research settings where multi-item inventories are less applicable, including computer-based treatment and assessment protocols. The VAS-A is freely available: http://people.socsci.tau.ac.il/mu/anxietytrauma/visual-analog-scale/.

Development of a culturally appropriate computer-delivered tailored Internet-based health literacy intervention for Spanish-dominant Hispanics living with HIV

BACKGROUND

Low health literacy is associated with poor medication adherence in persons with human immunodeficiency virus (HIV), which can lead to poor health outcomes. As linguistic minorities, Spanish-dominant Hispanics (SDH) face challenges such as difficulties in obtaining and understanding accurate information about HIV and its treatment. Traditional health educational methods (e.g., pamphlets, talking) may not be as effective as delivering through alternate venues. Technology-based health information interventions have the potential for being readily available on desktop computers or over the Internet. The purpose of this research was to adapt a theoretically-based computer application (initially developed for English-speaking HIV-positive persons) that will provide linguistically and culturally appropriate tailored health education to Spanish-dominant Hispanics with HIV (HIV + SDH).

METHODS

A mixed methods approach using quantitative and qualitative interviews with 25 HIV + SDH and 5 key informants guided by the Information-Motivation-Behavioral (IMB) Skills model was used to investigate cultural factors influencing medication adherence in HIV + SDH. We used a triangulation approach to identify major themes within cultural contexts relevant to understanding factors related to motivation to adhere to treatment. From this data we adapted an automated computer-based health literacy intervention to be delivered in Spanish.

RESULTS

Culture-specific motivational factors for treatment adherence in HIV + SDH persons that emerged from the data were stigma, familismo (family), mood, and social support. Using this data, we developed a culturally and linguistically adapted a tailored intervention that provides information about HIV infection, treatment, and medication related problem solving skills (proven effective in English-speaking populations) that can be delivered using touch-screen computers, tablets, and smartphones to be tested in a future study.

CONCLUSION

Using a theoretically-grounded Internet-based eHealth education intervention that builds on knowledge and also targets core cultural determinants of adherence may prove a highly effective approach to improve health literacy and medication decision-making in this group.

Touch-Screen Computerized Quality-of-Life Assessment for Patients with Cancer

PURPOSE

To evaluate a computerized self-reported, touch-screen version of the cancer-specific quality-of- life (cC-QOL) questionnaire against the traditional paper-and-pencil version (the pC-QOL) for equivalence, time for completion, user preference and ease of use.

METHODS

One hundred and five patients were recruited from a cancer center of a university hospital in South Korea. A randomized crossover design was used, with patients randomly assigned into two groups. Group A patients completed the cC-QOL first while waiting to see a physician, and completed the pC-QOL version of the questionnaire after seeing the physician. Group B patients completed these questionnaires in the reverse order. Subjects were asked about user preference and ease of use. Time taken to complete both versions was measured.

RESULTS

Weighted kappa coefficients of items showed very good to moderate agreement. The time required to complete the cC-QOL did not differ statistically from the pC-QOL. The same proportion of patients preferred both versions. Most patients (94.8%) reported that the cC-QOL was "easy" or "very easy" to complete.

CONCLUSION

The cC-QOL is the computerized equivalent of the pC-QOL, which is used to assess the health-related quality of life (HRQOL) of cancer patients. The cC-QOL can be helpful to oncology nurses and physicians for assessing, collecting, and evaluating their patients' HRQOL scores in busy clinical practices. [Asian Nursing Research 2009;3(1):41-48].

Medical utilization of kiosks in the delivery of patient education: a systematic review

BACKGROUND

The utilization of kiosks has previously been shown to be effective for collecting information, delivering educational modules, and providing access to health information. We discuss a review of current literature for the utilization of kiosks for the delivery of patient education.

METHODS

The criteria for inclusion in this literature review were: (1) study discusses the utilization of kiosks for patient health education; (2) study discusses the use of touch screens for patient health information; (3) published in English. Our review includes searches via MEDLINE databases and Google Scholar for the years 1996-2014.

RESULTS

Overall, 167 articles were screened for final eligibility, and after discarding duplicates and non-eligible studies with abstract. Full-text review of 28 articles was included in the final analysis.

CONCLUSION

The review of available literature demonstrates the effectiveness of touch screen kiosks to educate patients and to improve healthcare, both at a performance and cost advantage over other modes of patient education.

Embedding integrated mental health assessment and management in general hospital settings: feasibility, acceptability and the prevalence of common mental disorder

OBJECTIVE

To assess the feasibility and acceptability of routine web-based screening in general hospital settings, and describe the level of common mental disorder.

METHOD

A service development platform to integrate mental and physical healthcare was implemented in six specialties (rheumatology, limb reconstruction, hepatitis C, psoriasis, adult congenital heart disease (ACHD), chronic pain) across three general hospitals in London, UK. Under service conditions, patients completed a web-based questionnaire comprising mental and physical patient-reported outcome measures, whilst waiting for their appointment. Feasibility was quantified as the proportion of patients who completed the questionnaire. Acceptability was quantified as the proportion of patients declining screening, and the proportion requiring assistance completing the questionnaire. The prevalence of probable depression and anxiety was expressed as the percentage of cases determined by the Patient Health Questionnaire-9 and Generalised Anxiety Disorder Questionnaire-7.

RESULTS

The proportion of patients screened varied widely across specialties (40.1-98.2%). The decline rate was low (0.6-9.7%) and the minority required assistance (11.7-40.4%). The prevalence of probable depression ranged from 60.9% in chronic pain to 6.6% in ACHD. The prevalence of probable anxiety ranged from 25.1% in rheumatology to 11.4% in ACHD.

CONCLUSION

Web-based screening is acceptable to patients and can be effectively embedded in routine practice. General hospital patients are at increased risk of common mental disorder, and routine screening may help identify need, inform care and monitor outcomes.

A structured review of patient-reported outcome measures for patients with skin cancer, 2013

BACKGROUND

The collection of patient-reported outcome measures (PROMs) within the national PROMs programme for elective procedures is now established mandatory practice in the NHS with high response rates and completion.

OBJECTIVES

This review examines the evidence of PROMs for people with skin cancer.

METHODS

Comprehensive searches were conducted using several sources and databases, using a detailed search strategy developed by the University of Oxford's PROM Group. Articles were assessed for eligibility. Data were extracted per PROM for each measurement property and appraised using an appraisal framework.

RESULTS

A total of 3517 articles were identified in the searches, and 28 were included in the final review after assessment by two independent reviewers. Two generic instruments (SF-36 and Sickness Impact Profile) and nine condition-specific PROMs were identified.

CONCLUSIONS

Overall, there is a limited volume of published evidence for the application of generic PROMs for people with skin cancer. Evaluation of the EQ-5D may be particularly important given its widespread use in many other healthcare contexts in the U.K. The Skin Cancer Index could be considered for piloting in the NHS. For patients with nonmelanoma skin cancers, the Skindex measures may also be considered. The SCQOLIT has some evidence of applicability across both skin cancer types but more evaluations are needed. The FACT-M does have more promising characteristics for patients with malignant melanomas although no evidence of testing in the U.K. was found. The forthcoming EORTC-M may prove a useful measure given the expertise and track record of this European collaboration in cancer and quality of life.

Review of electronic patient-reported outcomes systems used in cancer clinical care

PURPOSE

The use of electronic patient-reported outcomes (PRO) systems is increasing in cancer clinical care settings. This review comprehensively identifies existing PRO systems and explores how systems differ in the administration of PRO assessments, the integration of information into the clinic workflow and electronic health record (EHR) systems, and the reporting of PRO information.

METHODS

Electronic PRO (e-PRO) systems were identified through a semistructured review of published studies, gray literature, and expert identification. System developers were contacted to provide detailed e-PRO system characteristics and clinical implementation information using a structured review form.

RESULTS

A total of 33 unique systems implemented in cancer clinical practice were identified. Of these, 81% provided detailed information about system characteristics. Two system classifications were established: treatment-centered systems designed for patient monitoring during active cancer treatment (n = 8) and patient-centered systems following patients across treatment and survivorship periods (n = 19). There was little consensus on administration, integration, or result reporting between these system types. Patient-centered systems were more likely to provide user-friendly features such as at-home assessments, integration into larger electronic system networks (eg, EHRs), and more robust score reporting options. Well-established systems were more likely to have features that increased assessment flexibility (eg, location, automated reminders) and better clinical integration.

CONCLUSION

The number of e-PRO systems has increased. Systems can be programmed to have numerous features that facilitate integration of PRO assessment and routine monitoring into clinical care. Important barriers to system usability and widespread adoption include assessment flexibility, clinical integration, and high-quality data collection and reporting.

Randomized controlled trial to test a computerized psychosocial cancer assessment and referral program: methods and research design

The National Cancer Coalition Network, National Cancer Institute, and American College of Surgeons all emphasize the need for oncology providers to identify, address, and monitor psychosocial needs of their patients. The Mental Health Assessment and Dynamic Referral for Oncology (MHADRO) is a patient-driven, computerized, psychosocial assessment that identifies, addresses, and monitors physical, psychological, and social issues faced by oncology patients. This paper presents the methodology of a randomized controlled trial (RCT) that tested the impact of the MHADRO on patient outcomes at 2, 6, and 12 months. Patient outcomes including overall psychological distress, depression, anxiety, functional disability, and use of psychosocial resources will be presented in future publications after all follow-up data is gathered. Eight hundred and thirty six cancer patients with heterogeneous diagnoses, across three comprehensive cancer centers in different parts of the United States, were randomized to the MHADRO (intervention) or an assessment-only control group. Patients in the intervention group were provided detailed, personalized reports and, when needed, referrals to mental health services; their oncology provider received detailed reports designed to foster clinical decision making. Those patients who demonstrated high levels of psychosocial problems were given the option to authorize that a copy of their report be sent electronically to a "best match" mental health professional. Demographic and patient cancer-related data as well as comparisons between patients who were enrolled and those who declined enrollment are presented. Challenges encountered during the RCT and strategies used to address them are discussed.

Psychological distress in cancer patients undergoing radiation therapy treatment

PURPOSE

The objective of this study was to examine the likely presence of, and factors associated with, anxiety, depression and overall psychological distress in cancer outpatients undergoing radiation therapy treatment in Sydney, Australia.

METHODS

A touchscreen computer survey was conducted in four radiation therapy treatment centre waiting rooms. Patients waiting to receive treatment completed the survey which included questions about demographic and disease characteristics, survey acceptability and the Hospital Anxiety and Depression Scale (HADS).

RESULTS

A total of 454 patients (70 %) completed the touchscreen computer survey. The likely presence of anxiety (HADS-A ≥11), depression (HADS-D ≥11) and overall psychological distress (HADS-T ≥15) was 15, 5.7 and 22 %, respectively. Cancer type was found to be associated with each HADS screening category. The majority of patients reported high survey acceptability and willingness to complete similar touchscreen computer surveys in the treatment centre waiting room on additional occasions.

CONCLUSIONS

As radiotherapy patients frequently attend the radiation oncology department, routine screening and intervention for elevated levels of psychological distress in this setting appears to be feasible. High survey completion rates and high patient-rated acceptability support this approach to screening. The likely presence of psychological distress is reported for this sample; however, the selection of HADS threshold scores is likely to have influenced the reported rates. Further research is needed to identify how cancer type impacts on likely caseness across the different HADS classifications examined.

Improvements in measuring the health-related quality of life of cancer patients

There have been considerable improvements in the collection of health-related quality of life (HRQOL) data in oncology over the past 20 years. The facility with which HRQOL information can now be collected from patients has also been associated with an improved understanding of the meaning of HRQOL and the association between HRQOL and patients' treatment and care plans. Therefore the role that HRQOL data can play in routine clinical practice is increasingly being recognized. The appearance of computer-adaptive tests will herald a new era in HRQOL where questionnaires will be individually tailored to each patient utilizing details unique to that person and linked to clinical management systems to allow a comprehensive assessment of HRQOL status.

A cross-sectional study assessing the self-reported weight loss strategies used by adult Australian general practice patients

Background

Obesity is a significant public health concern. General practitioners (GPs) see a large percentage of the population and are well placed to provide weight management advice. There has been little examination of the types of weight loss strategies used in Australian general practice patients. This cross-sectional study aimed to describe the proportion of normal weight, overweight and obese general practice patients who report trying to lose weight in the past 12 months, the types of weight loss strategies and diets used as well as the proportion consulting their GP prior to trying to lose weight.

Methods

Adult patients completed a touchscreen computer survey while waiting for their appointment. Responses from 1335 patients in twelve Australian practices are reported.

Results

A larger proportion of obese patients had tried to lose weight in the past 12 months (73%) compared to those who were overweight (55%) and normal weight (33%). The most commonly used strategy used was changing diet and increasing exercise in all BMI categories. Less than 10% used strategies such as prescription medication, over the counter supplements and consulted a weight loss specialist. Low calorie and low fat diets were the most frequently reported diets used to lose weight in those who were normal weight, overweight and obese. Overall, the proportion seeking GP advice was low, with 12% of normal weight, 15% of overweight and 43% of obese patients consulting their GP prior to trying to lose weight.

Conclusions

A large proportion of overweight or obese patients have tried to lose weight and utilized strategies such as changing diet and increasing exercise. Most attempts however were unassisted, with low rates of consultation with GPs and weight loss specialists. Ways to assist overweight and obese general practice patients with their weight loss attempts need to be identified.

The use of real-time patient-reported outcomes and quality-of-life data in oncology clinical practice

The collection of patient-reported outcome (PRO) data such as quality of life (QoL) has provided important information in clinical trials. Increasingly, researchers are evaluating the use of this type of data in the clinical setting. The benefits of PRO/QoL data collection, methods for collecting data and the use of the data by clinicians are increasingly being studied. This article will address the issues and benefits of QoL and other PRO data collection within oncology clinical practice.

Pain in patients attending a specialist cancer service: prevalence and association with emotional distress

CONTEXT

We know little about how many outpatients of a modern cancer center suffer from clinically significant unrelieved pain and the characteristics of these patients to guide better care.

OBJECTIVES

To determine the prevalence of clinically significant pain (CSP) in the outpatients of a regional cancer center and the association with distress and other variables.

METHODS

A secondary analysis of cross-sectional, self-reported and clinical data from 2768 patients reattending selected clinics of a regional National Health Service cancer center in the U.K. Pain was measured using the pain severity scale of the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire, emotional distress was measured by the Hospital Anxiety and Depression Scale, and demographic and clinical data were taken from medical records.

RESULTS

Fifty-four percent (95% confidence interval [CI] 52-56) of patients reported pain at least "a little" in the previous week and 18% (95% CI 17-20) at least "quite a bit" (CSP). The strongest independent associations of CSP were active disease (odds ratio [OR] 1.95, 95% CI 1.5-2.5) and emotional distress (OR 4.8, 95% CI 4-6).

CONCLUSION

CSP is surprisingly common in outpatients of specialist cancer services, and it is strongly and independently associated with emotional distress. Better symptom management should consider pain and distress together.

Touch screen computer health assessment in Australian general practice patients: a cross-sectional study protocol

INTRODUCTION

Cardiovascular disease (CVD) and cancer are leading causes of death globally. Early detection of cancer and risk factors for CVD may improve health outcomes and reduce mortality. General practitioners (GPs) are accessed by the majority of the population and play a key role in the prevention and early detection of chronic disease risk factors. This cross-sectional study aims to assess the acceptability of an electronic method of data collection in general practice patients. The study will describe the proportion screened in line with guidelines for CVD risk factors and cancer as well as report the prevalence of depression, lifestyle risk factors, level of provision of preconception care, cervical cancer vaccination and bone density testing. Lastly, the study will assess the level of agreement between GPs and patients perception regarding presence of risk factors and screening.

METHODS AND ANALYSIS

The study has been designed to maximise recruitment of GPs by including practitioners in the research team, minimising participation burden on GPs and offering remuneration for participation. Patient recruitment will be carried out by a research assistant located in general practice waiting rooms. Participants will be asked regarding the acceptability of the touch screen computer and to report on a range of health risk and preventive behaviours using the touch screen computer. GPs will complete a one-page survey indicating their perception of the presence of risk behaviours in their patients. Descriptive statistics will be generated to describe the acceptability of the touch screen and prevalence of health risk behaviours. Cohen's κ will be used to assess agreement between GP and patient perception of presence of health risk behaviours.

ETHICS AND DISSEMINATION

This study has been approved by the human research committees in participating universities. Findings will be disseminated via peer-reviewed publications, conference presentations as well as practice summaries provided to participating practices.

Chemotherapy line-associated differences in quality of life in patients with advanced cancer

PURPOSE

The aim of this study was to investigate quality of life (QOL) differences between patients receiving first, second, or third-line palliative chemotherapy (CT).Furthermore, QOL was also compared to a sex- and age-matched sample of healthy controls.

METHODS

Patients with different metastatic cancers receiving palliative CT were approached to complete the EORTC QLQ-C30 questionnaire by means of touch-screen computers before the start of CT, after 3 cycles and at the end of cytostatic treatment.

RESULTS

One hundred four patients were recruited for QOL assessment (56.9% of patients in first, 22.5% second and 20.6% third- or above-line palliative CT). Compared to healthy controls, they suffered from substantial QOL impairments in all EORTC QLQ-C30 sub-domains. In regard to CT lines, patients with first-line CT reached better scores in emotional and social functioning than second-line patients and less financial difficulties than third-line patients. Despite the high level of impairment in the patient sample, electronic data collection proved to be feasible and well accepted.

CONCLUSIONS

The results indicate that patients receiving third- or above-line palliative CT are confronted with stronger QOL impairments than first- and second-line patients. Supported by its feasibility and acceptance of by patients, electronic QOL data capture is an attractive method to screen for symptoms and track their course within clinical routine.

The use of mouse and one- and two-finger input methods for searching a large, horizontal display

A horizontal, table-sized computer display was used to examine one- and two-finger search performances. 31 college students participated in a basic computer operation and target landmark search task. The mean completion times of the target landmark search task were analyzed by a repeated-measures analysis of variance with the following factors: input device, environmental familiarity, and cue. Compared to the mouse, directly touching the computer display with one finger was inefficient when the task required more precise human-computer interactions, such as selecting small objects, or complicated tasks such as searching for targets in a computerized geographic application. However, directly touching the computer display with two fingers, one finger of each hand, appears efficient in complicated tasks. Additionally, familiar and cued environments can aid in the target landmark search task especially when searching within the cued conditions. However, the unfavorable effect of using a one-finger touch technique in searching may eliminate such cue effects.

The role of informatics in promoting patient-centered care

Patient-centered care is an important aspect of high-quality care. Health informatics, particularly advances in technology, has the potential to facilitate, or detract from, patient-centered cancer care. Informatics can provide a mechanism for patients to provide their clinician(s) with critical information and to share information with family, friends, and other patients. This information may enable patients to exert greater control over their own care. Clinicians may use information systems (e.g., electronic medical records) to coordinate care and share information with other clinicians. Patients and clinicians may use communication tools and information resources to interact with one another in new ways. Caution in using new information resources is warranted to avoid reliance on biased or inappropriate data, and clinicians may need to direct patients to appropriate information resources. Perhaps the greatest challenge for both patients and providers is identifying information that is high quality and that enhances (and does not impede) their interactions.

Routine psychosocial distress screening in radiotherapy: implementation and evaluation of a computerised procedure

BACKGROUND

To implement distress screening in routine radiotherapy practice and to compare computerised and paper-and-pencil screening in terms of acceptability and utility.

METHODS

We used the Stress Index RadioOncology (SIRO) for screening. In phase 1, 177 patients answered both a computerised and a paper version, and in phase 2, 273 patients filled out either the computerised or the paper assessment. Physicians received immediate feedback of the psycho-oncological results. Patients, nurses/radiographers (n=27) and physicians (n=15) evaluated the screening procedure.

RESULTS

The agreement between the computerised and the paper assessment was high (intra-class correlation=0.92). Patients' satisfaction did not differ between the two administration modes. Nurses/radiographers rated the computerised assessment less time consuming (3.7 vs 18.5%), although the objective data did not reveal a difference in time demand. Physicians valued the psycho-oncological results as interesting and informative (46.7%). Patients and staff agreed that the distress screening did not lead to an increase in the discussion of psychosocial issues in clinician-patient encounters.

CONCLUSION

The implementation of a distress screening was feasible and highly accepted, regardless of the administration mode. Communication trainings should be offered in order to increase the discussion of psychosocial topics in clinician-patient encounters.

Use of electronic quality of life applications in cancer research and clinical practice

Outcome measures of cancer treatment should include measures of quality of life, in addition to survival and objective response. Electronic administration of quality of life measures has made regular monitoring of the quality of life of individual cancer patients possible and feasible. Electronic questionnaires were well accepted by patients, had good test-retest reliability and were comparable with traditional paper-and-pen methods. Several randomized studies have shown that using quality of life screening in clinical practice can facilitate patient-doctor communication, without increasing consultation time. In one study, the regular assessment of quality of life resulted in benefits for some patients, who had better well-being and emotional functioning. Research is ongoing in developing computer-adaptive questionnaires to reduce patient burden and provide a more precise measurement. Further research using randomized controlled studies is necessary before the monitoring of individual patients' quality of life is recommended for routine practice. Special attention should be paid to training physicians in using the quality of life scores.

Applying an extended theoretical framework for data collection mode to health services research

Background

Over the last 30 years options for collecting self-reported data in health surveys and questionnaires have increased with technological advances. However, mode of data collection such as face-to-face interview or telephone interview can affect how individuals respond to questionnaires. This paper adapts a framework for understanding mode effects on response quality and applies it to a health research context.

Discussion

Data collection modes are distinguished by key features (whether the survey is self- or interviewer-administered, whether or not it is conducted by telephone, whether or not it is computerised, whether it is presented visually or aurally). Psychological appraisal of the survey request will initially entail factors such as the cognitive burden upon the respondent as well as more general considerations about participation. Subsequent psychological response processes will further determine how features of the data collection mode impact upon the quality of response provided. Additional antecedent factors which may further interact with the response generation process are also discussed. These include features of the construct being measured such as sensitivity, and of the respondent themselves (e.g. their socio-demographic characteristics). How features of this framework relate to health research is illustrated by example.

Summary

Mode features can affect response quality. Much existing evidence has a broad social sciences research base but is of importance to health research. Approaches to managing mode feature effects are discussed. Greater consideration must be given to how features of different data collection approaches affect response from participants in studies. Study reports should better clarify such features rather than rely upon global descriptions of data collection mode.

Routine, self-administered, touch-screen, computer-based suicidal ideation assessment linked to automated response team notification in an HIV primary care setting

BACKGROUND

Human immunodeficiency virus (HIV) and AIDS continue to be associated with an underrecognized risk for suicidal ideation, attempted suicide, and completed suicide. Suicidal ideation represents an important predictor for subsequent attempted and completed suicide. We sought to implement routine screening of suicidal ideation and associated conditions using computerized patient-reported outcome (PRO) assessments.

METHODS

Two geographically distinct academic HIV primary care clinics enrolled patients who attended scheduled visits from December 2005 through February 2009. Touch-screen, computer-based PRO assessments were implemented into routine clinical care. Substance abuse, alcohol consumption, depression, and anxiety were assessed. The 9-item Patient Health Questionnaire assesses the frequency of suicidal ideation in the preceding 2 weeks. A response of "nearly every day" triggered an automated page to predetermined clinic personnel, who completed more detailed self-harm assessments.

RESULTS

Overall, 1216 patients (740 from the University of Alabama at Birmingham and 476 from the University of Washington) completed the initial PRO assessment during the study period. Patients were predominantly white (646 [53%]) and male (959 [79%]), with a mean age (+/- standard deviation) of 44 +/- 10 years. Among surveyed patients, 170 (14%) endorsed some level of suicidal ideation, whereas 33 (3%) admitted suicidal ideation nearly every day. In multivariable analysis, suicidal ideation risk was lower with advancing age (odds ratio [OR], 0.74 per 10 years; 95% confidence interval [CI], 0.58-0.96) and was increased with current substance abuse (OR, 1.88; 95% CI, 1.03-3.44) and more-severe depression (OR, 3.91 for moderate depression [95% CI, 2.12-7.22] and 25.55 for severe depression [95% CI, 12.73-51.30]).

DISCUSSION

Suicidal ideation was associated with current substance abuse and depression. The use of novel technologies to incorporate routine self-reported screening for suicidal ideation and other health domains allows for timely detection and intervention for this life-threatening condition.

[Computerized measurement for asthma-specific quality of life: comparison with a conventional paper-and-pencil questionnaire]

PURPOSE

The purpose of this study was to evaluate a computerized touch-screen version of the asthma-specific quality-of-life (cA-QOL) questionnaire against the conventional paper-and-pencil version (pA-QOL) for equivalence, time for completion, user preference, and ease of use.

METHODS

A total of 261 patients were recruited. A randomized cross-over design was used. Patients in group A completed the cA-QOL first while waiting to see a physician, and completed the pA-QOL version after seeing the physician. Patients allocated in group B completed these questionnaires in the reverse order. The patients were asked questions about user preference and ease of use of the cA-QOL. The time taken to complete both versions of the questionnaire was measured.

RESULTS

Weighted kappa coefficients of all items showed almost perfect agreement. The time required to complete the pA-QOL is faster than the time for cA-QOL. The patients who preferred the cA-QOL were 37.5%, while those who preferred the pA-QOL were 29.9%. Most patients reported that the cA-QOL was "easy" or "very easy" to complete.

CONCLUSION

The cA-QOL is the computerized equivalent of the pA-QOL. The findings herein demonstrate that the cA-QOL can be helpful to nurses in busy practices for assessing, collecting, and evaluating their patients' health related quality of life.

Assessment of palliative care cancer patients' most important concerns

AIMS

Patients in the palliative care setting have a number of concerns not necessarily connected to their medical problems, such as spiritual and relationship issues. When these problems are not properly assessed and addressed, they may become a significant source of distress for patients and families. The aims of the present study were to assess the concerns of patients attending a palliative care clinic, to examine physicians' ratings of patient concerns, to access the concordance between patients' and physicians' ratings, and to assess the association between patients' concerns and their level of distress.

METHODS

We evaluated 137 patients attending a symptom control and palliative care clinic. Patients completed the Concerns Checklist, Hospital Anxiety and Depression Scale, and Cancer Behavior Inventory at the beginning of their visit. The Concerns Checklist was completed by the patient's clinic physician immediately after the visit and was used to estimate how accurate the physician was in identifying patients' concerns. We examined the correlation between the total number of patient concerns and their levels of anxiety, mood disturbance, and self-efficacy.

RESULTS

Patients were most concerned about loss of function, the future, and caring for themselves. Concordance between physician and patient rating of concerns was poor (all kappas, 0.26 or lower). Higher levels of patient concerns were associated with greater anxiety (r = 0.52) and depressive symptoms (r = 0.40) and lower self-efficacy (r = -0.37).

CONCLUSIONS

There was generally poor concordance between patients reporting of their concerns and physicians reporting of the patients' concerns. In addition, patients' with more concerns also had higher levels of anxiety and depressive symptoms. Thus, it is important to find strategies to more accurately identify patients' concerns, so that they can be adequately addressed.

Technology and quality of life outcomes

OBJECTIVES

To discuss recent technological advances in quality of life (QOL) data collection and guidance for use in research and clinical practice. The use of telephone-, computer-, and web/internet-based technologies to collect QOL data, reliability and validity issues, and cost will be discussed, along with the potential pitfalls associated with these technologies.

DATA SOURCES

Health care literature and web resources.

CONCLUSION

Technology has provided researchers and clinicians with an opportunity to collect QOL data from patients that were previously not accessible. Most technologies offer a variety of options, such as language choice, formatting options for the delivery of questions, and data management services. Choosing the appropriate technology for use in research and/or clinical practice primarily depends on the purpose for QOL data collection.

IMPLICATIONS FOR NURSING PRACTICE

Technology is changing the way nurses assess QOL in patients with cancer and provide care. As stakeholders in the health care delivery system and patient advocates, nurses must be intimately involved in the evaluation and use of new technologies that impact QOL and/or the delivery of care.

Extending computer technology to hospice research: interactive pentablet measurement of symptoms by hospice cancer patients in their homes

We aimed to determine the acceptability and feasibility of a pentablet-based software program, PAINReportIt-Plus, as a means for patients with cancer in home hospice to report their symptoms and differences in acceptability by demographic variables. Of the 131 participants (mean age = 59 +/- 13, 58% women, 48.1% African American), 44% had never used a computer, but all participants easily used the computerized tool and reported an average computer acceptability score of 10.3 +/- 1.8, indicating high acceptability. Participants required an average of 19.1 +/- 9.5 minutes to complete the pain section, 9.8 +/- 6.5 minutes for the medication section, and 4.8 +/- 2.3 minutes for the symptom section. The acceptability scores were not statistically different by demographic variables but time to complete the tool differed by racial/ethnic groups. Our findings demonstrate that terminally ill patients with cancer are willing and able to utilize computer pentablet technology to record and describe their pain and other symptoms. Visibility of pain and distress is the first step necessary for the hospice team to develop a care plan for improving control of noxious symptoms.

Screening for emotional distress in cancer patients: a systematic review of assessment instruments

Screening for emotional distress is becoming increasingly common in cancer care. This systematic review examines the psychometric properties of the existing tools used to screen patients for emotional distress, with the goal of encouraging screening programs to use standardized tools that have strong psychometrics. Systematic searches of MEDLINE and PsycINFO databases for English-language studies in cancer patients were performed using a uniform set of key words (eg, depression, anxiety, screening, validation, and scale), and the retrieved studies were independently evaluated by two reviewers. Evaluation criteria included the number of validation studies, the number of participants, generalizability, reliability, the quality of the criterion measure, sensitivity, and specificity. The literature search yielded 106 validation studies that described a total of 33 screening measures. Many generic and cancer-specific scales satisfied a fairly high threshold of quality in terms of their psychometric properties and generalizability. Among the ultrashort measures (ie, those containing one to four items), the Combined Depression Questions performed best in patients receiving palliative care. Among the short measures (ie, those containing five to 20 items), the Center for Epidemiologic Studies–Depression Scale and the Hospital Anxiety and Depression Scale demonstrated adequate psychometric properties. Among the long measures (ie, those containing 21–50 items), the Beck Depression Inventory and the General Health Questionaire–28 met all evaluation criteria. The PsychoSocial Screen for Cancer, the Questionnaire on Stress in Cancer Patients–Revised, and the Rotterdam Symptom Checklist are long measures that can also be recommended for routine screening. In addition, other measures may be considered for specific indications or disease types. Some measures, particularly newly developed cancer-specific scales, require further validation against structured clinical interviews (the criterion standard for validation measures) before they can be recommended.

Differential symptom reporting by mode of administration of the assessment: automated voice response system versus a live telephone interview

BACKGROUND

Automated voice response (AVR) systems have been used to collect patient-reported outcome data. Mode of administration of the assessment may affect patient reporting.

OBJECTIVE

To evaluate if there is a differential reporting of symptoms by the mode of assessment: AVR versus a live telephone interview among cancer patients with solid tumors undergoing chemotherapy.

RESEARCH DESIGN

Randomized clinical trial comparing a nurse-assisted symptom management with an automated telephone symptom management. After completing intake telephone interview administered by a person, patients were randomized to either nurse arm or AVR arm to receive a 6-contact 8-week symptom management intervention. Patients in the nurse arm were called by specially trained nurses, and patients in the AVR arm were contacted via automated system to assess their symptoms and deliver symptom management strategies.

SUBJECTS

Two hundred patients in nurse arm, and 186 patients in the AVR arm completed the first intervention contact.

MEASURES

Severities of 14 cancer-related symptoms were rated by patients at intake interview and at first intervention contact before the receipt of any interventions.

RESULTS

When compared with patients contacted by a nurse, patients contacted by the AVR reported higher severity of nausea and vomiting, diarrhea, poor appetite, constipation, diarrhea, pain, and alopecia controlling for prior intake symptom assessment that was free of mode effect. Symptom reporting varied by age, with the oldest group of patients reporting higher severity to the nurse.

CONCLUSION

Mode effect needs to be considered in designing trials for symptom management and in symptom monitoring in clinical practice.

Recommendations on evidence needed to support measurement equivalence between electronic and paper-based patient-reported outcome (PRO) measures: ISPOR ePRO Good Research Practices Task Force report

BACKGROUND

Patient-reported outcomes (PROs) are the consequences of disease and/or its treatment as reported by the patient. The importance of PRO measures in clinical trials for new drugs, biological agents, and devices was underscored by the release of the US Food and Drug Administration's draft guidance for industry titled "Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims." The intent of the guidance was to describe how the FDA will evaluate the appropriateness and adequacy of PRO measures used as effectiveness end points in clinical trials. In response to the expressed need of ISPOR members for further clarification of several aspects of the draft guidance, ISPOR's Health Science Policy Council created three task forces, one of which was charged with addressing the implications of the draft guidance for the collection of PRO data using electronic data capture modes of administration (ePRO). The objective of this report is to present recommendations from ISPOR's ePRO Good Research Practices Task Force regarding the evidence necessary to support the comparability, or measurement equivalence, of ePROs to the paper-based PRO measures from which they were adapted.

METHODS

The task force was composed of the leadership team of ISPOR's ePRO Working Group and members of another group (i.e., ePRO Consensus Development Working Group) that had already begun to develop recommendations regarding ePRO good research practices. The resulting task force membership reflected a broad array of backgrounds, perspectives, and expertise that enriched the development of this report. The prior work became the starting point for the Task Force report. A subset of the task force members became the writing team that prepared subsequent iterations of the report that were distributed to the full task force for review and feedback. In addition, review beyond the task force was sought and obtained. Along with a presentation and discussion period at an ISPOR meeting, a draft version of the full report was distributed to roughly 220 members of a reviewer group. The reviewer group comprised individuals who had responded to an emailed invitation to the full membership of ISPOR. This Task Force report reflects the extensive internal and external input received during the 16-month good research practices development process. RESULTS/RECOMMENDATIONS: An ePRO questionnaire that has been adapted from a paper-based questionnaire ought to produce data that are equivalent or superior (e.g., higher reliability) to the data produced from the original paper version. Measurement equivalence is a function of the comparability of the psychometric properties of the data obtained via the original and adapted administration mode. This comparability is driven by the amount of modification to the content and format of the original paper PRO questionnaire required during the migration process. The magnitude of a particular modification is defined with reference to its potential effect on the content, meaning, or interpretation of the measure's items and/or scales. Based on the magnitude of the modification, evidence for measurement equivalence can be generated through combinations of the following: cognitive debriefing/testing, usability testing, equivalence testing, or, if substantial modifications have been made, full psychometric testing. As long as only minor modifications were made to the measure during the migration process, a substantial body of existing evidence suggests that the psychometric properties of the original measure will still hold for the ePRO version. Hence, an evaluation limited to cognitive debriefing and usability testing only may be sufficient. However, where more substantive changes in the migration process has occurred, confirming that the adaptation to the ePRO format did not introduce significant response bias and that the two modes of administration produce essentially equivalent results is necessary. Recommendations regarding the study designs and statistical approaches for assessing measurement equivalence are provided.

CONCLUSIONS

The electronic administration of PRO measures offers many advantages over paper administration. We provide a general framework for decisions regarding the level of evidence needed to support modifications that are made to PRO measures when they are migrated from paper to ePRO devices. The key issues include: 1) the determination of the extent of modification required to administer the PRO on the ePRO device and 2) the selection and implementation of an effective strategy for testing the measurement equivalence of the two modes of administration. We hope that these good research practice recommendations provide a path forward for researchers interested in migrating PRO measures to electronic data collection platforms.

Depression screening using the Patient Health Questionnaire-9 administered on a touch screen computer

OBJECTIVE

To (1) evaluate the feasibility of touch screen depression screening in cancer patients using the Patient Health Questionnaire-9 (PHQ-9), (2) evaluate the construct validity of the PHQ-9 using the touch screen modality, and (3) examine the prevalence and severity of depression using this screening modality.

METHODS

The PHQ-9 was placed in a web-based survey within a study of the clinical impact of computerized symptom and quality of life screening. Patients in medical oncology, radiation oncology, and hematopoietic stem cell transplantation (HSCT) clinics used the program on a touch screen computer in waiting rooms prior to therapy (T1) and during therapy (T2). Responses of depressed mood or anhedonia (PHQ-2 cardinal depression symptoms) triggered additional items. PHQ-9 scores were provided to the oncology team in real time.

RESULTS

Among 342 patients enrolled, 33 (9.6%) at T1 and 69 (20.2%) at T2 triggered the full PHQ-9 by endorsing at least one cardinal symptom. Feasibility was high, with at least 97% completing the PHQ-2 and at least 96% completing the PHQ-9 when triggered and a mean completion time of about 2 min. The PHQ-9 had good construct validity. Medical oncology patients had the highest percent of positive screens (12.9%) at T1, while HSCT patients had the highest percent (30.5%) at T2. Using this method, 21 (6.1%) at T1 and 54 (15.8%) at T2 of the total sample had moderate to severe depression.

CONCLUSIONS

The PHQ-9 administered on a touch screen computer is feasible and provides valid depression data in a diverse cancer population.

Functioning and validity of a Computerized Adaptive Test to measure anxiety (A-CAT)

BACKGROUND

The aim of this study was to evaluate the Computerized Adaptive Test to measure anxiety (A-CAT), a patient-reported outcome questionnaire that uses computerized adaptive testing to measure anxiety.

METHODS

The A-CAT builds on an item bank of 50 items that has been built using conventional item analyses and item response theory analyses. The A-CAT was administered on Personal Digital Assistants to n=357 patients diagnosed and treated at the department of Psychosomatic Medicine and Psychotherapy, Charité Berlin, Germany. For validation purposes, two subgroups of patients (n=110 and 125) answered the A-CAT along with established anxiety and depression questionnaires.

RESULTS

The A-CAT was fast to complete (on average in 2 min, 38 s) and a precise item response theory based CAT score (reliability>.9) could be estimated after 4-41 items. On average, the CAT displayed 6 items (SD=4.2). Convergent validity of the A-CAT was supported by correlations to existing tools (Hospital Anxiety and Depression Scale-A, Beck Anxiety Inventory, Berliner Stimmungs-Fragebogen A/D, and State Trait Anxiety Inventory: r=.56-.66); discriminant validity between diagnostic groups was higher for the A-CAT than for other anxiety measures.

CONCLUSIONS

The German A-CAT is an efficient, reliable, and valid tool for assessing anxiety in patients suffering from anxiety disorders and other conditions with significant potential for initial assessment and long-term treatment monitoring. Future research directions are to explore content balancing of the item selection algorithm of the CAT, to norm the tool to a healthy sample, and to develop practical cutoff scores.

Evaluation of a computer-adaptive test for the assessment of depression (D-CAT) in clinical application

In the past, a German Computerized Adaptive Test, based on Item Response Theory (IRT), was developed for purposes of assessing the construct depression [Computer-adaptive test for depression (D-CAT)]. This study aims at testing the feasibility and validity of the real computer-adaptive application.The D-CAT, supplied by a bank of 64 items, was administered on personal digital assistants (PDAs) to 423 consecutive patients suffering from psychosomatic and other medical conditions (78 with depression). Items were adaptively administered until a predetermined reliability (r > or = 0.90) was attained. For validation purposes, the Hospital Anxiety and Depression Scale (HADS), the Centre for Epidemiological Studies Depression (CES-D) scale, and the Beck Depression Inventory (BDI) were administered. Another sample of 114 patients was evaluated using standardized diagnostic interviews [Composite International Diagnostic Interview (CIDI)].The D-CAT was quickly completed (mean 74 seconds), well accepted by the patients and reliable after an average administration of only six items. In 95% of the cases, 10 items or less were needed for a reliable score estimate. Correlations between the D-CAT and the HADS, CES-D, and BDI ranged between r = 0.68 and r = 0.77. The D-CAT distinguished between diagnostic groups as well as established questionnaires do.The D-CAT proved an efficient, well accepted and reliable tool. Discriminative power was comparable to other depression measures, whereby the CAT is shorter and more precise. Item usage raises questions of balancing the item selection for content in the future.

Does a Patient-Held Quality-of-Life Diary Benefit Patients With Inoperable Lung Cancer?

Purpose

To examine the effect of weekly completion of a patient-held quality-of-life (QOL) diary in routine oncology practice for palliative care patients.

Patients and Methods

In a pragmatic randomized controlled trial, 115 patients with inoperable lung cancer were randomly assigned to receive either standard care or a structured QOL diary (European Organisation for Research and Treatment of Cancer Quality of Life Questionnaire C30 and the related lung cancer module LC13) that they completed at home each week for 16 weeks. Patients were encouraged to share the QOL information with health professionals involved in their care. Changes in QOL over time (measured by the Functional Assessment of Cancer Therapy–Lung questionnaire and the Palliative Care Quality of Life Index), discussion of patient problems, and satisfaction with communication and general care were assessed at baseline and at 2 and 4 months after baseline.

Results

Analysis of QOL indicated a small but consistent difference between patients in the diary group and the standard care group. The diary group had a poorer QOL in many domains. Two different QOL summary scores (total and overall QOL) indicated a statistically significant between-group difference. No effects were found in relation to satisfaction with care, communication, or the discussion of patient problems.

Conclusion

The regular completion of a QOL questionnaire without appropriate feedback to health care professionals and without the provision of appropriate support may have a negative impact on inoperable lung cancer patients. Further research should focus on identifying features such as feedback loops that are required for the successful and meaningful use of QOL questionnaires in routine patient care.

Lung cancer: challenges and solutions for supportive care intervention research

Lung cancer is the leading cause of cancer death. It is associated with a high level of morbidity, particularly fatigue, pain, breathlessness, and coughing. These symptoms can have a substantial impact on psychosocial functioning. It is critical to have effective interventions demonstrated to improve quality of life particularly for those with advanced disease. However there is a paucity of high quality intervention research to guide practice in this area. This article discusses the challenges in conducting supportive care research in this group, including the patient's level of literacy in English, poor performance status, rapidly fluctuating health status, and familial or professional "gate-keeping." Many of these challenges can be overcome by broadening eligibility criteria, permitting some flexibility in relation to recruitment and data collection procedures, working closely with the treatment team, involving the patient's family, minimizing practical difficulties associated with intervention delivery, and reducing study burden in other ways, such as limiting the amount of data collected from the patient and shortening follow-up time intervals. We explore these potential solutions drawing on the experience of conducting a randomized controlled trial of a support intervention for people with lung cancer and their family.

Validation of the electronic Visual Analogue Scale of Anxiety

Currently, the use of electronic scales is increasing rapidly, which is not surprising considering its accuracy, the ease of use and the increased compliance. The value of Visual Analogue Scales as a mean to objectify subjective variables has long been recognised. The current study aimed to validate the electronic Visual Analogue Scale of Anxiety (eVAAS). Seventy-one subjects, control subjects (n=46) and Panic Disorder patients (n=25), filled out the paper VAAS and the eVAAS in a randomised order. Panic was provoked using 35% CO(2) inhalation allowing us to include maximal scores in our analyses. The correlation between eVAAS and pVAAS was very strong and highly significant (r=0.98, p<0.001). pVAAS scores were slightly higher than eVAAS scores (p<0.001), but this difference is clinically unimportant. The VAAS established on a tablet PC is a useful and valid measure of anxiety and holds intrinsic benefits for anxiety assessment.

Measuring side effects after radiotherapy for pharynx cancer

Data on side effects after radiotherapy is needed to establish the benefits and drawbacks of new treatments, but side effects are not quantified as easily as survival or local control. Side effects may be quantified using physical measures. Unfortunately, only few endpoints exist where a physical measure is obtainable, and the case of a patient-relevant measure is even rarer. Radiotherapy is often followed by complex symptoms not easily quantifiable by the observer. Quantitative patient reported side effects can be retrieved using validated questionnaires, but this kind of data is often difficult to interpret and the correlation with clinically observable or measurable changes not straightforward. The exploitation of the possibilities of highly conformal radiotherapy and multimodality treatment depends on a better understanding of the correlation between dose, volume, modifying factors, and side effects. Using pharynx cancer as an example, the purpose of this article is to summarize the possibilities and limitations of different methods for measurement of radiotherapy-induced side effects.