Implementation of an audio computer-assisted self-interview (ACASI) system in a general medicine clinic: patient response burden

Recommendations to address respondent burden associated with patient-reported outcome assessment

Patient-reported outcomes (PROs) are increasingly used in healthcare research to provide evidence of the benefits and risks of interventions from the patient perspective and to inform regulatory decisions and health policy. The use of PROs in clinical practice can facilitate symptom monitoring, tailor care to individual needs, aid clinical decision-making and inform value-based healthcare initiatives. Despite their benefits, there are concerns that the potential burden on respondents may reduce their willingness to complete PROs, with potential impact on the completeness and quality of the data for decision-making. We therefore conducted an initial literature review to generate a list of candidate recommendations aimed at reducing respondent burden. This was followed by a two-stage Delphi survey by an international multi-stakeholder group. A consensus meeting was held to finalize the recommendations. The final consensus statement includes 19 recommendations to address PRO respondent burden in healthcare research and clinical practice. If implemented, these recommendations may reduce PRO respondent burden.

Key considerations to reduce or address respondent burden in patient-reported outcome (PRO) data collection

Patient-reported outcomes (PROs) are used in clinical trials to provide evidence of the benefits and risks of interventions from a patient perspective and to inform regulatory decisions and health policy. The collection of PROs in routine practice can facilitate monitoring of patient symptoms; identification of unmet needs; prioritisation and/or tailoring of treatment to the needs of individual patients and inform value-based healthcare initiatives. However, respondent burden needs to be carefully considered and addressed to avoid high rates of missing data and poor reporting of PRO results, which may lead to poor quality data for regulatory decision making and/or clinical care.

The collection of patient-reported outcomes (PROs) may capture patients’ assessments of their health status. Here authors highlight PRO-specific issues that should be considered to minimise respondent burden in clinical trials and routine care.

Health System Implementation of a Tobacco Quitline eReferral

BACKGROUND

Proactive referrals through electronic orders (eReferrals) can increase patient connection with tobacco quitlines. More information is needed on "real-world" implementation of electronic health record tools to promote tobacco cessation while minimizing provider burden.

OBJECTIVES

This paper examines the health system implementation of an eReferral to a tobacco quitline without best practice alerts in primary care, specialty, and hospital settings in an academic health system.

METHODS

This is a prospective implementation study of a health system tobacco eReferral to a state quitline that was completed with an approach to minimize provider cognitive burden. Data are drawn from electronic health record data at University of California, Davis Health Systems (March 2013-February 2016).

RESULTS

Over 3 years, 16,083 encounters with smokers resulted in 1,137 eReferral orders (7.1%). Treatment reach was 1.6% for quitline services and 2.3% for outpatient group classes. While the group classes were offered to outpatient smokers, the eReferral order was included in an outpatient order set and eventually an automated inpatient discharge order set; no provider alerts were implemented. Referrals were sustained and doubled after inpatient order set implementation. Among all first time eReferral patients, 12.2% had a 6 to 12 month follow-up visit at which they were documented as nonsmoking.

CONCLUSION

This study demonstrates a quitline eReferral order can be successfully implemented and sustained with minimal promotion, without provider alerts and in conjunction with group classes. Reach and effectiveness were similar to previously described literature.

Methods, system errors, and demographic differences in participant errors using daily text message-based short message service computer-assisted self-interview (SMS-CASI) to measure sexual risk behavior in a RCT of HIV self-test use

BACKGROUND

Assessment of sexual risk behavior is crucial to HIV prevention trials. Currently, there are no biomarkers or objective measures to detect and characterize sexual risk behavior; therefore, we must rely on self-reports. Self-report accuracy may be improved by collecting data in real-time. Our objective was to demonstrate how a text message-based short message service computer-assisted self-interview (SMS-CASI) system can collect daily sexual risk behavior data.

METHODS

During the course of a 2-arm randomized controlled trial, confidential daily SMS-CASI was used to assess sexual risk behavior over three months for participants using only condoms in the control condition and using condoms and HIV self-tests to test themselves and their non-monogamous sexual partner over six months for participants in the intervention condition (total N=272). Active monitoring of participants responses and data cleaning took place concurrently with trial execution. Descriptive statistics were used to examine frequencies related to system functionality, participant reporting, system errors, communication patterns, and overall feasibility of using the SMS-CASI system for reporting sexual risk behavior.

RESULTS

The SMS-CASI system processed 272,565 messages. In addition, 87 classifications of metadata were collected, for a total of 22,895,460 different data points. Types of messages included these sent (N=171,749; 63.01%) to participants, received (N=100,646; 36.93%) from participants, and failed (N=168; 0.06%) to be sent. Most errors (N=1,858) were due to system malfunctions (N=535; 28.79%) or participants' mistakes (N=1,289; 69.38%). Participant errors included: wrong password, incomplete surveys, and invalid response. The highest error rates by demographic characteristics were by age among older participants [ages 30-39; 383 errors (29.71%), and 40-69; 545 errors (42.28%)] and by race among Hispanic/Latino participants [487 errors (37.78%)].

CONCLUSIONS

The SMS-CASI system was effective at confidentially collecting sexual risk behavior data on a daily basis, potentially contributing to reduced recall and social desirability bias. This study provides methodological examples and data demonstrating how SMS-CASI can be used for sexual health data collection.

Computer-Facilitated 5A's for Smoking Cessation: A Randomized Trial of Technology to Promote Provider Adherence

INTRODUCTION

Although evidence-based, the 5A's (Ask, Advise, Assess, Assist, and Arrange) for smoking cessation are often incompletely delivered by primary care providers. This study examines whether a computer tablet 5A's intervention improves primary care provider adherence to the 5A's.

STUDY DESIGN

Cluster RCT.

SETTING/PARTICIPANTS

All primary care providers in three urban, adult primary care clinics were randomized for participation. Any English- or Spanish-speaking patient with a primary care appointment who had smoked >100 lifetime cigarettes and at least one cigarette in the past week was eligible.

INTERVENTION

A cluster RCT comparing computer-facilitated 5A's with usual care assessed effects on provider adherence to each of the 5A's as determined by patient report. Intervention subjects used a computer tablet to complete the 5A's immediately before a primary care appointment. A tailored, patient handout and a structured, clinician guide were generated. Data were collected in 2014-2015 and analyzed in 2016-2017.

MAIN OUTCOME MEASURES

Provider adherence to the 5A's.

RESULTS

Providers (N=221) saw 961 patients (n=412 intervention, n=549 control) for a total of n=1,340 encounters with n=1,011 completed post-visit interviews (75.4% completion). Intervention providers had significantly higher odds of completing Assess (AOR=1.32, 95% CI=1.02, 1.73) and Assist (AOR=1.45, 95% CI=1.08, 1.94). When looking at first study visits only, intervention providers had higher odds for Arrange (AOR=1.72, 95% CI=1.23, 2.40) and all 5A's (AOR=2.04, 95% CI=1.35, 3.07) but study visit did not influence receipt of the other 5A's.

CONCLUSIONS

A computer-facilitated 5A's delivery model was effective in improving the fidelity of provider-delivered 5A's to diverse primary care patients. This relatively low-cost, time-saving intervention has great potential for smoking cessation and other health behaviors. Future studies should identify ways to promote and sustain technology implementation.

TRIAL REGISTRATION

This study is registered at www.clinicaltrials.gov NCT02046408.

Mental health assessments in refugees and asylum seekers: evaluation of a tablet-assisted screening software

Background

Mental health problems resulting from persecution and forced migration are very common among refugees and asylum seekers and evolve into a major public health challenge in hosting societies. Language barriers often prevent timely access to appropriate health care, leading to chronic trajectories and abortive social integration. Tools for multilingual screening and assessment could be of great benefit for this particularly vulnerable population as well as for policy makers. This study aimed at testing the reliability, feasibility and usability of the Multi-Adaptive Psychological Screening Software (MAPSS), a newly developed Audio Computer-Assisted Self-Interview Software (ACASI) for touchscreen devices, for screening purposes in a clinical setting.

Methods

In a randomized cross-over design including both MAPSS and paper-pencil clinician-administered interviews, 30 treatment-seeking refugees completed clinical measures and a feasibility questionnaire to rate the user interface of MAPSS. Five professionals performed given tasks in MAPSS and completed usability questionnaires for the administration interface.

Results

Results showed no differences between the two assessment modalities with regard to symptom scores. The findings suggest good feasibility and usability of MAPSS in traumatized refugees. The administration via MAPSS was significantly shorter than the paper-pencil interview.

Conclusion

MAPSS may be a cost-effective, flexible and valid alternative to interpreter-based psychometric screening and assessment.

HIV-positive blood donors unaware of their sexual at-risk behaviours before donation in Italy

BACKGROUND AND OBJECTIVES

Despite the procedures adopted for the selection of blood donors, in Italy the HIV prevalence per 100 000 repeat tested donors (RTD) and first-time tested donors (FTD) is high compared to most other Council of Europe member states. To evaluate the effectiveness of predonation procedures, we studied both the characteristics and the undisclosed risk behaviours of HIV-positive donors.

MATERIALS AND METHODS

We analysed the data from the Italian blood donor surveillance system in 2009, 2010 and 2011. Based on the postdonation interview, HIV-positive donors were classified by risk behaviour (heterosexual, MSM, 'non-sexual' and 'not determined') and by time elapsed from risk behaviour to donation. In Italy, the temporary deferral for exposure to behaviour at risk is 4 months.

RESULTS

In the postdonation interview, 113 HIV-positive donors (32·4%), who denied at-risk behaviours in the predonation selection, reported sexual risk behaviours <4 months prior to donation; they were predominantly males (84·1%) and RTD (63·7%). The main reason for not having reported the risk behaviour in the predonation selection was 'not realizing having engaged in at-risk behaviour' (66·4%).

CONCLUSION

These findings underline the need for more comprehensible educational material, a clearer predonation questionnaire, and effective information campaigns to improve the awareness of HIV sexual risk behaviours among blood donors.