Handheld computer-assisted self-interviews: user comfort level and preferences

Correlates of antiretroviral adherence and viral load among transgender women living with HIV

Transgender women are 49 times more likely to become HIV infected than other groups, yet they are drastically underserved by current treatment efforts and report lower rates of treatment adherence then other groups. The objective of this study was to explore correlates of antiretroviral (ART) adherence and viral load among HIV-positive transgender women on ART utilizing a cross-sectional survey of a convenience sample of 59 transgender women. In multivariate models of ART adherence, correlates were age, stress appraisal of transphobic experiences, importance of gender affirmation, and adherence to hormone therapy. In multivariate models of self-reported viral load, correlates were stress appraisal of transphobic experiences and being in a relationship. This study provides preliminary evidence of transgender-relevant correlates of ART adherence and viral load.

Personal digital assistant data capture: the future of quality of life measurement in prostate cancer treatment

PURPOSE

This article examines the potential use of personal digital assistant (PDA) data capture systems for real-time linear monitoring of health-related quality of life (HRQOL) in prostate cancer research and clinical care.

METHODS

We discuss the benefits and potential issues of using PDA data capture in the clinical health care setting. In addition, we describe the development and potential use of a PDA data capture system specific to managing HRQOL in prostate cancer treatment.

CONCLUSION

Follow-up health care clinics require a practical and systematic process of HRQOL data capture and analysis. Traditional paper questionnaire data capture is problematic. Data manipulation required for clinical decision-making is impractical for patient feedback on same-day clinic visits. Furthermore, the process of transforming paper questionnaire data to analysis-quality data can compromise data integrity. In contrast, research findings confirm the acceptability, ease of use, and reliability of PDAs in capturing data across health care settings, including the collection of serial HRQOL data. The main concern for PDA capture systems is the ability to compare respondent's answers between the paper and PDA questionnaire. Other challenges included patients reporting a lack of computer literacy and/or poor eyesight, as well as initial start-up costs. If issues are successfully addressed, the use of a PDA data capture system, such as the PDA HRQOL system at Princess Margaret Hospital's Prostate Centre, allows for valid and economical data collection with the possibility of linear real-time measurement of changes in HRQOL. Accordingly, there appears to be significant potential for PDA data collection of serial HRQOL in prostate cancer clinic settings.

Electronic versus paper diaries: a pilot study of concordance and adherence in head and neck cancer patients receiving radiation therapy

Background

Interactive Voice Response Systems (IVRS) and other electronic data collection methods have begun to replace conventional paper diaries as a way to capture daily patient reports. However, these methods have not been compared in head and neck (H&N) cancer patients receiving radiation therapy.

Methods

15 subjects with H&N cancer were asked to complete daily IVRS calls and daily paper diaries during radiation therapy. We compared response consistency and comparative adherence across the two methods.

Results

86.1% (1920/2231) of participants' responses were consistent between IVRS and paper diaries. 79.5% of the expected number of paper diaries were completed, compared to 66.2% of IVRS phone calls.

Conclusions

In this pilot study of H&N cancer patients undergoing radiation therapy, concordance was high between responses recorded by paper diaries and IVRS. Although adherence appeared to be higher for the paper diaries, it is possible that they may not have been completed at the proper time.

Alcohol assessment among college students using wireless mobile technology

OBJECTIVE

This study used a two-group randomized design to assess the validity of measuring self-reported alcohol consumption among college students using the Handheld Assisted Network Diary (HAND), a daily diary assessment administered using wireless mobile devices.

METHOD

A convenience sample of college students was recruited at a large, public university in the southeastern United States and randomized into two groups. A randomly assigned group of 86 students completed the daily HAND assessment during the 30-day study and a Timeline Followback (TLFB) at 30-day follow-up. A randomly assigned group of 82 students completed the paper-and-pencil Daily Social Diary (DSD) over the same study period. Data from the daily HAND assessment were compared with the TLFB completed at follow-up by participants who completed the HAND using 95% limits of agreement analysis. Furthermore, individual growth models were used to examine differences between the HAND and DSD by comparing the total drinks, drinking days, and drinks per drinking day captured by the two assessments over the study period.

RESULTS

Results suggest that the HAND captured similar levels of alcohol use compared with the TLFB completed at follow-up by the same participants. In addition, comparisons of the two study groups suggest that, controlling for baseline alcohol use and demographics, the HAND assessment captured similar levels of total drinks, drinking days, and drinks per drinking day as the paper-and-pencil DSD.

CONCLUSIONS

The study findings support the validity of wireless mobile devices as a daily assessment of alcohol use among college students.

The validity and reliability of an interactive computer tobacco and alcohol use survey in general practice

BACKGROUND

Uncertainty regarding the accuracy of the computer as a data collection or patient screening tool persists. Previous research evaluating the validity of computer health surveys have tended to compare those responses to that of paper survey or clinical interview (as the gold standard). This approach is limited as it assumes that the paper version of the self-report survey is valid and an appropriate gold standard.

OBJECTIVES

First, to compare the accuracy of computer and paper methods of assessing self-reported smoking and alcohol use in general practice with biochemical measures as gold standard. Second, to compare the test re-test reliability of computer administration, paper administration and mixed methods of assessing self-reported smoking status and alcohol use in general practice.

METHODS

A randomised cross-over design was used. Consenting patients were randomly assigned to one of four groups; Group 1. C-C : completing a computer survey at the time of that consultation (Time 1) and a computer survey 4-7 days later (Time 2); Group 2. C-P: completing a computer survey at Time 1 and a paper survey at Time 2; Group 3. P-C: completing a paper survey at Time 1 and a computer survey at Time 2; and Group 4. P-P: completing a paper survey at Time 1 and 2. At Time 1 all participants also completed biochemical measures to validate self-reported smoking status (expired air carbon monoxide breath test) and alcohol consumption (ethyl alcohol urine assay).

RESULTS

Of the 618 who were eligible, 575 (93%) consented to completing the Time 1 surveys. Of these, 71% (N=411) completed Time 2 surveys. Compared to CO, the computer smoking self-report survey demonstrated 91% sensitivity, 94% specificity, 75% positive predictive value (PPV) and 98% negative predictive value (NPV). The equivalent paper survey demonstrated 86% sensitivity, 95% specificity, 80% PPV, and 96% NPV. Compared to urine assay, the computer alcohol use self-report survey demonstrated 92% sensitivity, 50% specificity, 10% PPV and 99% NPV. The equivalent paper survey demonstrated 75% sensitivity, 57% specificity, 6% PPV, and 98% NPV. Level of agreement of smoking self-reports at Time 1 and Time 2 revealed kappa coefficients ranging from 0.95 to 0.98 in each group and hazardous alcohol use self-reports at Time 1 and Time 2 revealed kappa coefficients ranging from 0.90 to 0.96 in each group.

CONCLUSION

The collection of self-reported health risk information is equally accurate and reliable using computer interface in the general practice setting as traditional paper survey. Computer survey appears highly reliable and accurate for the measurement of smoking status. Further research is needed to confirm the adequacy of the quantity/frequency measure in detecting those who drink alcohol. Interactive computer administered health surveys offer a number of advantages to researchers and clinicians and further research is warranted.

The development and evaluation of a PDA-based method for public health surveillance data collection in developing countries

BACKGROUND AND PURPOSE

EpiData and Epi Info are often used together by public health agencies around the world, particularly in developing countries, to meet their needs of low-cost public health data management; however, the current open source data management technology lacks a mobile component to meet the needs of mobile public health data collectors. The goal of this project is to explore the opportunity of filling this gap through developing and trial of a personal digital assistant (PDA) based data collection/entry system. It evaluated whether such a system could increase efficiency and reduce data transcription errors for public surveillance data collection in developing countries represented by Fiji.

METHODS

A generic PDA-based data collection software eSTEPS was developed. The software and the data collected using it directly interfaces with EpiData. A field trial was conducted to test the viability of public health surveillance data collection using eSTEPS. The design was a randomised, controlled trial with cross-over design. 120 participants recruited from the Fiji School of Medicine were randomly assigned to be interviewed by one of six interviewers in one of the two ways: (1) paper-based survey followed by PDA survey and (2) PDA survey followed by paper-based survey. Data quality was measured by error rates (logical range errors/inconsistencies, skip errors, missing values, date or time field errors and incorrect data type). Work flow and cost were evaluated in three stages of the survey process: (1) preparation of data collection instrument, (2) data collection and (3) data entry, validation and cleaning. User acceptance was also evaluated in the two groups of participants: (1) data collectors and (2) survey participants.

RESULTS

None of the errors presented in 20.8% of the paper questionnaires was found in the data set collected using PDA. Sixty-two percent of the participants perceived that the PDA-based questionnaire took less time to complete. Data entry, validation and cleaning for the PDA-based data collection from 120 participants took a total of 1.5h, a 93.26% reduction of time from 20.5h required using paper and pen. The cost is also significantly reduced with PDA-based protocol. Both data collectors and participants prefer to use PDA instead of paper for data collection. The trial results prove that eSTEPS is a feasible solution for public health surveillance data collection in the field. Several deficiencies of the software were also identified and would be addressed in the next version.

CONCLUSION

eSTEPS offers the potential to meet the need for an effective mobile public health data collection tool for use in the field. The eSTEPS field trial proves that PDA was more efficient than paper for public health survey data collection. It also significantly reduced errors in data entry. The later benefit was derived from the software providing its users with the flexibility of building their own constraints to control the data type, range and logic of data entry.

Alcohol assessment using wireless handheld computers: a pilot study

The present study sought to test the feasibility of measuring quantity and frequency of self-reported alcohol consumption among college students using the Handheld Assisted Network Diary (HAND) by comparing results to a retrospective Timeline Followback (TLFB). A total of 40 undergraduate college students completed a HAND assessment during the two-week study period and completed a TLFB at follow-up. The HAND recorded similar levels of alcohol consumption compared to the TLFB. There were no significant differences in overall alcohol consumption, drinks per drinking day, or heavy drinking days between the two methods of assessment. Handheld computers may represent a useful tool for assessing daily alcohol use among college students.

Internet methods for delivering behavioral and health-related interventions (eHealth)

Emerging communications technologies allow us to potentially reach more individuals with effective health-related advice and information at a very low cost. As we begin a new era of "personalized medicine," advances in consumer health informatics will parallel and eventually merge with those being made in bioinformatics (e.g., genomic information), medical informatics (e.g., electronic medical records), and public health informatics (e.g., disease surveillance). This article discusses access, use, quality, and types of eHealth programming with a focus on the Internet as the initial instantiation of this programming. Also discussed are criteria relevant to the dissemination of eHealth programming in real-world settings. Finally, possible directions for future eHealth research are presented.

One day at a time: The impact of daily satisfaction with spouse responses on pain, negative affect and catastrophizing among individuals with rheumatoid arthritis

The majority of research on pain catastrophizing has focused on its negative consequences for adjustment to chronic pain, with few investigations of factors that influence catastrophizing or its detrimental effects. Using a daily process methodology, the current study examined, first, the extent to which a supportive social environment plays a role in reduced catastrophizing, and second, the extent to which support might protect against the detrimental effects of catastrophizing on well-being. Sixty-nine married individuals with rheumatoid arthritis took part in an initial background interview, followed by twice daily telephone interviews (regarding pain intensity, negative affect, catastrophizing and satisfaction with spouse responses) for 1 week. Multi-level modeling indicated several pathways through which satisfaction with spouse responses disrupts the vicious cycle of pain, negative affect and catastrophizing. Consistent with past research, catastrophizing was associated with increases in pain and negative affect. However, when individuals reported increases in satisfaction with spouse responses they were less likely to experience increases in negative affect due to catastrophizing. Satisfaction with spouse responses also reduced the likelihood of feeling overwhelmed and helpless in dealing with daily pain. The relationship between pain and catastrophizing was attenuated in the context of increases in satisfaction with spouse responses. Negative affect was associated with increases in catastrophizing, but only when individuals reported decreases in satisfaction with spouse responses. Overall, findings were consistent with a model in which satisfaction with spouse responses serves as a coping resource, and suggests the importance of involving close others in treatments to reduce pain and catastrophizing.

Serial personal digital assistant data capture of health-related quality of life: a randomized controlled trial in a prostate cancer clinic

Background

In clinical and research practice linked to prostate cancer treatment, frequent monitoring of patient health-related quality of life (HRQOL) is essential. Practical and analytic limitations of paper questionnaire data capture may be overcome with the use of self-administered personal digital assistant (PDA) data collection. The objective of this study was to assess the reliability, validity, and feasibility of using PDA in place of paper versions of the International Prostate Symptom Score (IPSS), the Patient Oriented Prostate Cancer Utility Survey (PORPUS), and the International Index of Erectile Function-5 (IIEF-5) in a prostate cancer clinic setting.

Methods

152 participants were randomly assigned to one of three conditions: 1) paper followed by PDA survey; 2) PDA followed by paper survey; or 3) PDA followed by PDA survey. Evaluation included an assessment of data quality (internal consistency, test-retest reliability, response correlation, completeness of data), and feasibility (participation rates, time to completion, preference and difficultly/ease of using PDA).

Results

Internal consistency was similar for both PDA and paper applications. Test-retest reliability was confirmed for PDA repeated administration. Data from paper and PDA questionnaires were strongly correlated. Lower missed item rates were found in PDA administration. 82.8% of participants preferred using the PDA or had no preference. Mean difficulty/ease ratings indicated that participants found the PDA easy to use. Age did not significantly correlate with preference or difficulty.

Conclusion

The results confirm the adaptability of the IPSS, IIEF-5, and the PORPUS to PDA administration. Similarly, the findings of this study support the feasibility of using PDA technology for HRQOL serial data capture in the prostate cancer patient population.

Patient‐driven computers in primary care: their use and feasibility

Purpose

The purpose of this research is to explore the feasibility of using patient‐driven, hand‐held computers in primary care settings, in order to address the apparent failure to implement prevention initiatives into the routine delivery of health care services.

Design/methodology/approach

During an eight‐day period, patients of an English primary care practice who were at least 16 years of age were asked to complete a health‐related survey using a hand‐held computer. They received tailored, on‐screen feedback.

Findings

A total of 143 patients (approximately 55 per cent of all patients) began using a hand‐held computer, of whom 115 (80 per cent) answered all questions. Of these, 24 per cent reported being smokers, 7 per cent and 19 per cent were at‐risk of alcohol harm in the long and short term respectively and 14 per cent rated their overall health as poor or very poor. Most patients rated their level of satisfaction with the hand‐helds as excellent (36 per cent), very good (29 per cent) or good (24 per cent), while 89 per cent agreed to their primary care physician seeing a summary of their feedback.

Originality/value

This is the first study to evaluate the feasibility of using hand‐held computers to conduct patient screening and feedback in primary care settings.

Paper and plastic in daily diary research: Comment on Green, Rafaeli, Bolger, Shrout, and Reis (2006)

The authors applaud A. S. Green, E. Rafaeli, N. Bolger, P. E. Shrout, and H. T. Reis's (2006) response to one-sided comparisons of paper versus electronic (plastic) diary methods and hope that it will stimulate more balanced considerations of the issues involved. The authors begin by highlighting areas of agreement and disagreement with Green et al. The authors review briefly the broader literature that has compared paper and plastic diaries, noting how recent comparisons have relied on study designs and methods that favor investigators' allegiances. The authors note some sorely needed data for the evaluation of the implications of paper versus plastic for the internal and external validity of research. To facilitate evaluation of the existing literature and assist in the design of future studies, the authors offer a balanced comparison of paper and electronic diary methods across a range of applications. Finally, the authors propose 2 study designs that offer fair comparisons of paper and plastic diary methods.

Palmtop-assisted self-interviewing for the collection of sensitive behavioral data: randomized trial with drug use urine testing

Palmtop-assisted self-interviewing (PASI) may provide a cheaper and more mobile alternative to audio-computer-assisted self-interviewing (ACASI) for collecting sensitive behavioral data. To evaluate PASI, in late 2002 the authors enrolled 1,283 Thai students aged 15-21 years in a randomized trial. Data collection used PASI, ACASI, self-administered questionnaire, and face-to-face interview in combination with drug-use urine testing. By use of reported levels of behaviors and agreement between self-reports of smoking and urine test results, PASI and ACASI (alpha = 0.05) were compared for noninferiority, and PASI and interview were compared for superiority (alpha = 0.05). Noninferiority of PASI was demonstrated by use of self-reports of the most sensitive areas of sexual behavior (e.g., oral sex, sexual intercourse, commercial sex, history of genital ulcers, pregnancy), as well as self-reports of less sensitive behaviors (e.g., alcohol use, dietary behaviors, symptoms of depression). Data generally showed noninferiority of PASI, ACASI, and self-administered questionnaires when compared with each other and superiority of PASI, ACASI, and self-administered questionnaires when compared with interviews. PASI agreements between self-reports of tobacco smoking and presence of nicotine metabolites in urine were noninferior to ACASI and superior to interviews. The establishment of PASI noninferiority and superiority using behavioral and biologic measures suggests that PASI is a scientifically acceptable alternative for collecting sensitive behavioral data.