Patient difficulty using tablet computers to screen in primary care

Computer-assisted medical history taking prior to patient consultation in the outpatient care setting: a prospective pilot project

BACKGROUND

Feeding patients' self-reported medical history into the diagnostic care process may accelerate workflows in clinical routine.

METHODS

We prospectively piloted a novel medical history documentation system in a German cardiological outpatient practice and evaluated its feasibility and perceived usefulness. Based on a generic software that allows to record structured information, a customized solution for the cooperating practice was developed and implemented. Prior to the consultation of the physician, the patient used a tablet that guided the user through a structured comprehensive workflow to document the medical history. The retrieved information was arranged by the software into a ready-to-use text format, presented to the physician in an editable form and added to her report. Three user-centered endpoints were explored: i) Appropriateness-measured by the duration of a patient interview; ii) Patient acceptance-assessed by three questions to patients; iii) Usefulness-operationalized by multiple ratings of the physician.

RESULTS

A total of 2,513 patients were approached of which 2,415 provided complete histories. The system was assessed as appropriate for the practical workflow in terms of time and workflows. The patient-system interaction was rated favourably by patients including elderly ones. The system was regarded useful by the physician, reducing her daily workload by about one hour.

CONCLUSIONS

Automated history-taking tools deployed before consultation could support physicians in obtaining patients' medical histories, thereby reducing professionals' perceived workload. The technical and methodological limitations of our study should be respected, calling for additional future evaluations.

Night-time hot spring bathing is associated with improved blood pressure control: A mobile application and paper questionnaire study

Hot spring bathing practice helps to manage hypertension. However, the details of the relationship between hot spring bathing and hypertension remain unknown. Older people are thought to be less adept than younger people at using digital devices such as mobile applications. Whether mobile application questionnaires, which have been increasing in recent years, can be used by older people is unclear. To address the knowledge gap regarding the management of older patients with hypertension, we prospectively evaluated mobile application and paper questionnaires regarding night-time hot spring bathing in respondents who had a choice of which to use. Changes in blood pressure because of hot spring bathing were evaluated. To investigate the effects of night-time hot spring bathing on blood pressure in adults, 1116 volunteers at 14 institutions in Beppu completed the study, including 562 in the mobile application questionnaire group and 556 in the paper questionnaire group. A total of 474 of 477 (99.3%) respondents aged ≥65 years used paper questionnaires. There was a significantly lower drop in both systolic and diastolic blood pressure after using hot springs in respondents aged ≥65 years than in respondents aged <65 years (p<0.001). An age ≥65 years, hypertension with medication, arrhythmia, depression, and using a chloride hot spring were independently and significantly associated with a lower drop in both systolic and diastolic blood pressure after night-time hot spring bathing (p<0.001). Night-time hot spring bathing was significantly associated with reduced blood pressure in older adults (p<0.001). Extending this research by examining how psychosocial factors in respondents aged ≥65 years influence preferences for mobile and paper questionnaires may be beneficial, and further investigation is warranted.

Evaluation of electronic patient-reported outcome assessment in inpatient cancer care: a feasibility study

PURPOSE

Patient-reported outcome (PRO) measures are increasingly important in evaluating medical care. The increased integration of technology within the healthcare systems allows for collection of PROs electronically. The objectives of this study were to Ashley et al. J Med Internet Res (2013) implement an electronic assessment of PROs in inpatient cancer care and test its feasibility for patients and Dawson et al. BMJ (2010) determine the equivalence of the paper and electronic assessment.

METHODS

We analyzed two arms from a study that was originally designed to be an interventional, three-arm, and multicenter inpatient trial. A self-administered questionnaire based on validated PRO-measures was applied and completed at admission, 1 week after, and at discharge. For this analysis - focusing on feasibility of the electronic assessment - the following groups will be considered: Group A (intervention arm) received a tablet version, while group B (control arm) completed the questionnaire on paper. A feasibility questionnaire, that was adapted from Ashley et al. J Med Internet Res (2013), was administered to group A.

RESULTS

We analyzed 103 patients that were recruited in oncology wards. ePRO was feasible to most patients, with 84% preferring the electronic over paper-based assessment. The feasibility questionnaire contained questions that were answered on a scale ranging from "1" (illustrating non achievement) to "5" (illustrating achieving goal). The majority (mean 4.24, SD .99) reported no difficulties handling the electronic tool and found it relatively easy finding time for filling out the questionnaire (mean 4.15, SD 1.05). There were no significant differences between the paper and the electronic assessment regarding the PROs.

CONCLUSION

Results indicate that electronic PRO assessment in inpatient cancer care is feasible.

Optimizing Recruitment and Retention in Substance Use Disorder Research in Emergency Departments

INTRODUCTION

Clinical trial recruitment and retention of individuals who use substances are challenging in any setting and can be particularly difficult in emergency department (ED) settings. This article discusses strategies for optimizing recruitment and retention in substance use research conducted in EDs.

METHODS

Screening, Motivational Assessment, Referral, and Treatment in Emergency Departments (SMART-ED) was a National Drug Abuse Treatment Clinical Trials Network (CTN) protocol designed to assess the impact of a brief intervention with individuals screening positive for moderate to severe problems related to use of non-alcohol, non-nicotine drugs. We implemented a multisite, randomized clinical trial at six academic EDs in the United States and leveraged a variety of methods to successfully recruit and retain study participants throughout the 12-month study course. Recruitment and retention success is attributed to appropriate site selection, leveraging technology, and gathering adequate contact information from participants at their initial study visit.

RESULTS

The SMART-ED recruited 1,285 adult ED patients and attained follow-up rates of 88%, 86%, and 81% at the 3-, 6-, and 12-month follow-up periods, respectively. Participant retention protocols and practices were key tools in this longitudinal study that required continuous monitoring, innovation, and adaptation to ensure strategies remained culturally sensitive and context appropriate through the duration of the study.

CONCLUSION

Tailored strategies that consider the demographic characteristics and region of recruitment and retention are necessary for ED-based longitudinal studies involving patients with substance use disorders.

Digitized and structured informed patient consent before contrast-enhanced computed tomography: feasibility and benefits in clinical routine

Background

To evaluate the feasibility and benefits of digitized informed patient consent (D-IPC) for contrast-enhanced CT and compare digitized documentation with paper-based, conventional patient records (C-PR).

Methods

We offered D-IPC to 2016 patients scheduled for a CT. We assessed patient history (e.g., CT examinations, malignant or cardiovascular diseases) and contraindications (red flags) for a CT (e.g., thyroid hyperfunction, allergies) using a tablet device. We evaluated the success rate of D-IPC and compared patient age between the subgroups of patients who were able or unable to complete D-IPC. We analyzed the prevalence of marked questions and red flags (RF). RF were compared with the documentation from C-PR. We estimated greenhouse gas (GHG) emissions for paperless workflow and provide a cost–benefit analysis.

Results

Overall, 84.4% of patients completed D-IPC. They were younger (median 61 years) than unsuccessful patients (65 years; p < 0.001). Patients who marked questions (21.7%) were older than patients without inquiries (median 63.9 vs 59.5 years; p < 0.001). The most prevalent RF was thyroid disease (23.8%). RF were considered critical for contrast-agent injection in 13.7%, requiring personalized preparation. The detection rate for RF documented with D-IPC was higher than for C-PR (n = 385 vs. 43). GHG emissions for tablet production are 80–90 times higher than for paper production. The estimated costs were slightly higher for D-IPC (+ 8.7%).

Conclusion

D-IPC is feasible, but patient age is a relevant factor. Marked questions and RF help personalize IPC. The availability of patient history by D-IPC was superior compared to C-PR.

Health Within Reach-a Patient-Centered Intervention to Increase Hepatitis B Screening Among Asian Americans: a Randomized Clinical Trial

BACKGROUND

There are few studies to date of interventions to increase viral hepatitis screening among Asian Americans, who have high rates of chronic hepatitis B (HBV) infection.

OBJECTIVE

To develop, implement, and test the efficacy of a mobile application (Hepatitis App) delivered in four languages to increase HBV screening among Asian Americans.

DESIGN

Cluster-randomized clinical trial.

PARTICIPANTS

Four hundred fifty-two Asian American patients ≥ 18 years of age, who had no prior HBV testing, and received primary care within two healthcare systems in San Francisco, CA.

INTERVENTIONS

The intervention group received the Hepatitis App, delivering interactive video education on viral hepatitis in English, Cantonese, Mandarin, or Vietnamese and a provider printout (Provider Alert) and Provider Panel Notification. The comparison group received a mobile application delivering nutrition and physical activity education and Provider Panel Notification.

MAIN MEASURES

Primary outcomes were patient-provider discussion about HBV and documentation of a HBV screening test within 3 months post-intervention. Secondary outcome was documentation of an order for a HBV screening test.

KEY RESULTS

Participants had a mean age of 57 years and were 64% female, 80% foreign-born, and 44% with limited English fluency. At post-visit, over 80% of intervention participants reported they liked using the Hepatitis App. At 3-month follow-up, the intervention group was more likely than the comparison group (all P < 0.001) to have discussed HBV with their provider (70% vs.16%), have a HBV test ordered (44% vs.10%), and receive a HBV test (38% vs.8%). In multivariable analyses, the intervention odds ratio for HBV test ordering was 7.6 (95% CI: 3.9, 14.8) and test receipt was 7.5 (95% CI: 3.6, 15.5).

CONCLUSIONS

A multi-lingual educational intervention using a mobile application in primary care clinics was well received by Asian American patients, enhanced patient-provider communication about HBV, and increased HBV screening. Technology can improve healthcare quality among Asian Americans.

TRIAL REGISTRATION

ClinicalTrials.gov NCT02139722 ( https://clinicaltrials.gov/ct2/show/NCT02139722 ).

Assessments of a novel digital follow-up tool Rehabkompassen® to identify rehabilitation needs among stroke patients in an outpatient setting

Introduction

It remains a huge challenge to identify individual rehabilitation needs in a time-efficient manner for providing patient-tailored rehabilitation during the continuum of stroke care. We have recently demonstrated the usefulness of a paper-version Rehab-Compass as a follow-up tool. The aim of the current study was to develop a digital version of the Rehab-Compass and evaluate its usability and feasibility.

Methods

The novel digital tool Rehabkompassen® was developed by an iterative and participatory design process. Patients' rehabilitation needs were visualized by the tool and used before, during, and after the consultation. The usability and feasibility of the tool was assessed by task completion rate, the System Usability Scale, and satisfaction questionnaires among 2 physicians and 24 adult stroke patients in an outpatient clinical setting.

Results

Rehabkompassen® identified and graphically visualized a panoramic view of the stroke patients' multidimensional needs in individual- and group levels. The instrument appeared to be feasible and time efficient in clinical use with a 100% overall task completion rate for both patients and physicians. A majority of the patients reported that it was very easy or fairly easy to answer the digital questionnaires and to understand their own digital Rehab-Compass graph. Two physicians reported a high mean score on the System Usability Scale (95/100) and were positive about using the tool in the future.

Conclusions

The current results indicated that Rehabkompassen® was a feasible, useful, and time-saving follow-up tool for the identification of rehabilitation needs among stroke survivors in the post-acute continuum of care after stroke. Further research is needed to evaluate the efficacy of the digital instrument among stroke patients.

A pilot study of patient satisfaction with a self-completed tablet-based digital questionnaire for collecting the patient's medical history in an emergency department

Background

The increasing popularity and availability of tablet computers raises questions regarding clinical scenarios. This pilot study examined the patient’s satisfaction when using a tablet-based digital questionnaire as a tool for obtaining medical history in an emergency department and to what extent gender, age, technical competence and mother tongue influence the user satisfaction. Patients were asked to complete three consecutive questionnaires: The first questionnaire collected basic epidemiological data to measure past digital usage behaviour, the second questionnaire collected the patient’s medical history, and the third questionnaire assessed the overall perceived user satisfaction when using the tablet-based survey application for medical anamnesis.

Results

Of 111 consenting patients, 86 completed all three questionnaires. In summary, the user evaluation was positive with 97.7% (n = 84) of the patients stating that they had no major difficulties using the digital questionnaire. Only 8.1% (n = 7) of patients reported a preference to fill out a paper-and-pen version on the next visit instead, while 98.8% (n = 85) stated that they would feel confident filling out a digital questionnaire on the next visit. The variables gender, age, mother tongue and/or technical competence did not exert a statistically significant influence towards the defined scales usability, content and overall impression.

Conclusion

In conclusion, self-administered tablet-based questionnaires are widely accepted tools for collecting medical information in the emergency room across all ages and genders, regardless of technical competence.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-06748-y.

Use of Self-Reported Computerized Medical History Taking for Acute Chest Pain in the Emergency Department - the Clinical Expert Operating System Chest Pain Danderyd Study (CLEOS-CPDS): Prospective Cohort Study

Background

Chest pain is one of the most common chief complaints in emergency departments (EDs). Collecting an adequate medical history is challenging but essential in order to use recommended risk scores such as the HEART score (based on history, electrocardiogram, age, risk factors, and troponin). Self-reported computerized history taking (CHT) is a novel method to collect structured medical history data directly from the patient through a digital device. CHT is rarely used in clinical practice, and there is a lack of evidence for utility in an acute setting.

Objective

This substudy of the Clinical Expert Operating System Chest Pain Danderyd Study (CLEOS-CPDS) aimed to evaluate whether patients with acute chest pain can interact effectively with CHT in the ED.

Methods

Prospective cohort study on self-reported medical histories collected from acute chest pain patients using a CHT program on a tablet. Clinically stable patients aged 18 years and older with a chief complaint of chest pain, fluency in Swedish, and a nondiagnostic electrocardiogram or serum markers for acute coronary syndrome were eligible for inclusion. Patients unable to carry out an interview with CHT (eg, inadequate eyesight, confusion or agitation) were excluded. Effectiveness was assessed as the proportion of patients completing the interview and the time required in order to collect a medical history sufficient for cardiovascular risk stratification according to HEART score.

Results

During 2017-2018, 500 participants were consecutively enrolled. The age and sex distribution (mean 54.3, SD 17.0 years; 213/500, 42.6% women) was similar to that of the general chest pain population (mean 57.5, SD 19.2 years; 49.6% women). Common reasons for noninclusion were language issues (182/1000, 18.2%), fatigue (158/1000, 15.8%), and inability to use a tablet (152/1000, 15.2%). Sufficient data to calculate HEART score were collected in 70.4% (352/500) of the patients. Key modules for chief complaint, cardiovascular history, and respiratory history were completed by 408 (81.6%), 339 (67.8%), and 291 (58.2%) of the 500 participants, respectively, while 148 (29.6%) completed the entire interview (in all 14 modules). Factors associated with completeness were age 18-69 years (all key modules: Ps<.001), male sex (cardiovascular: P=.04), active workers (all key modules: Ps<.005), not arriving by ambulance (chief complaint: P=.03; cardiovascular: P=.045), and ongoing chest pain (complete interview: P=.002). The median time to collect HEART score data was 23 (IQR 18-31) minutes and to complete an interview was 64 (IQR 53-77) minutes. The main reasons for discontinuing the interview prior to completion (n=352) were discharge from the ED (101, 28.7%) and tiredness (95, 27.0%).

Conclusions

A majority of patients with acute chest pain can interact effectively with CHT on a tablet in the ED to provide sufficient data for risk stratification with a well-established risk score. The utility was somewhat lower in patients 70 years and older, in patients arriving by ambulance, and in patients without ongoing chest pain. Further studies are warranted to assess whether CHT can contribute to improved management and prognosis in this large patient group.

Trial Registration

ClinicalTrials.gov NCT03439449; https://clinicaltrials.gov/ct2/show/NCT03439449

International Registered Report Identifier (IRRID)

RR2-10.1136/bmjopen-2019-031871

Structured Digital Self-Assessment of Patient Anamnesis Prior to Computed Tomography: Performance Evaluation and Added Value

The aim of this study was to evaluate the performance of a tablet-based, digitized structured self-assessment (DSSA) of patient anamnesis (PA) prior to computed tomography (CT). Of the 317 patients consecutively referred for CT, the majority (n = 294) was able to complete the tablet-based questionnaire, which consisted of 67 items covering social anamnesis, lifestyle factors (e.g., tobacco abuse), medical history (e.g., kidney diseases), current symptoms, and the usability of the system. Patients were able to mark unclear questions for a subsequent discussion with the radiologist. Critical issues for the CT examination were structured and automatically highlighted as “red flags” (RFs) in order to improve patient interaction. RFs and marked questions were highly prevalent (69.5% and 26%). Missing creatinine values (33.3%), kidney diseases (14.4%), thyroid diseases (10.6%), metformin (5.5%), claustrophobia (4.1%), allergic reactions to contrast agents (2.4%), and pathological TSH values (2.0%) were highlighted most frequently as RFs. Patient feedback regarding the comprehensibility of the questionnaire and the tablet usability was mainly positive (90.9%; 86.2%). With advanced age, however, patients provided more negative feedback for both (p = 0.007; p = 0.039). The time effort was less than 20 min for 85.1% of patients, and faster patients were significantly younger (p = 0.046). Overall, the DSSA of PA prior to CT shows a high success rate and is well accepted by most patients. RFs and marked questions were common and helped to focus patients’ interactions and reporting towards decisive aspects.

The Implementation of an Interpersonal Violence Screening Program in Primary Care Settings: Lessons Learned

BACKGROUND

Interpersonal violence (IPV) is a public health issue that disproportionately affects women. IPV screening improves likelihood of survivor disclosure and access to additional support. To enhance primary care IPV screening, Technology Enhanced Screening and Supportive Assistance (TESSA) uses integrated technological systems to deliver bidirectional, evidence-informed health navigation, health management, and safety interventions. This study evaluates TESSA implementation in primary care clinics using the Consolidated Framework for Implementation Research (CFIR).

METHOD

CFIR is a metatheoretical framework used for evaluating clinical intervention implementation. Salient constructs within CFIR's five domains (intervention characteristics, outer setting, inner setting, characteristics of individuals, and process) were identified (23 constructs), and pertinent implementation details were examined.

RESULTS

Key lessons learned included intervention characteristic constructs like intervention source (e.g., selecting tablets that can screen for items integral to the program's aims) and adaptability (e.g., ensuring tablets worked with electronic medical records for each clinic), process constructs like engaging champions (e.g., garnering buy-in from key clinic stakeholders and staff), outer setting constructs like patient needs and resources (e.g., addressing pertinent patient resource needs) and external policies and incentives (e.g., incentivizing clinics by addressing clinic needs), and inner setting constructs like leadership engagement (e.g., ensuring buy-in from organizational leaders as leadership changed frequently).

CONCLUSIONS

CFIR identifies important implementation factors for programs like TESSA that screen for high-risk populations and implement in primary care settings. The TESSA program implementation permits increased IPV screening among primary health care populations, thus promoting access to resources for otherwise hard-to-reach populations.

Primary Care Pre-Visit Electronic Patient Questionnaire for Asthma: Uptake Analysis and Predictor Modeling

Background

mHealth tablet-based interventions are increasingly being studied and deployed in various health care settings, yet little knowledge exists regarding patient uptake and acceptance or how patient demographics influence these important implementation metrics.

Objective

To determine which factors influence the uptake and successful completion of an mHealth tablet questionnaire by analyzing its implementation in a primary care setting.

Methods

We prospectively studied a patient-facing electronic touch-tablet asthma questionnaire deployed as part of the Electronic Asthma Management System. We describe tablet uptake and completion rates and corresponding predictor models for these behaviors.

Results

The tablet was offered to and accepted by patients in 891/1715 (52.0%) visits. Patients refused the tablet in 33.0% (439/1330) visits in which it was successfully offered. Patients aged older than 65 years of age (odds ratio [OR] 2.30, 95% CI 1.33-3.95) and with concurrent chronic obstructive pulmonary disease (OR 2.22, 95% CI 1.05-4.67) were more likely to refuse the tablet, and those on an asthma medication (OR 0.55, 95% CI 0.30-0.99) were less likely to refuse it. Once accepted, the questionnaire was completed in 784/891 (88.0%) instances, with those on an asthma medication (OR 0.53, 95% CI 0.32-0.88) being less likely to leave it incomplete.

Conclusions

Older age predicted initial tablet refusal but not tablet questionnaire completion, suggesting that perceptions of mHealth among older adults may negatively impact uptake, independent of usability. The influence of being on an asthma medication suggests that disease severity may also mediate mHealth acceptance. Although use of mHealth questionnaires is growing rapidly across health care settings and diseases, few studies describe their real-world acceptance and its predictors. Our results should be complemented by qualitative methods to identify barriers and enablers to uptake and may inform technological and implementation strategies to drive successful usage.

Feasibility of Mobile Technology to Identify and Address Patients' Unmet Social Needs in a Primary Care Clinic

Mobile health tools may overcome barriers to social needs screening; however, there are limited data on the feasibility of using these tools in clinical settings. The objective was to determine the feasibility of using a mobile health system to screen for patients' social needs. In one large primary care clinic, the authors tested a tablet-based system that screens patients for social needs, transmits results to the electronic health record, and alerts providers. All adult patients presenting for a nonurgent visit were eligible. The authors evaluated the feasibility of the system and conducted follow-up surveys to determine acceptability and if patients accessed resources through the process. All providers were surveyed. Of the 252 patients approached, 219 (86.9%) completed the screen. Forty-three (19.6%) required assistance with the tablet, and 150 (68.5%) screened positive for at least 1 unmet need (food, housing, or transportation). Of the 150, 103 (68.7%) completed a follow-up survey. The majority agreed that people would learn to use the tablet quickly. Forty-eight patients (46.6%) reported contacting at least 1 community organization through the process. Of the 27 providers, 23 (85.2%) completed a survey and >70% agreed the system would result in patients having better access to resources. It was feasible to use a tablet-based system to screen for social needs. Clinics considering using mobile tools will need to determine how to screen patients who may need assistance with the tool and how to connect patients to resources through the system based on the burden of unmet needs.

Embodied Conversational Agent Appearance for Health Assessment of Older Adults: Explorative Study

BACKGROUND

Embodied conversational agents (ECAs) have great potential for health apps but are rarely investigated as part of such apps. To promote the uptake of health apps, we need to understand how the design of ECAs can influence the preferences, motivation, and behavior of users.

OBJECTIVE

This is one of the first studies that investigates how the appearance of an ECA implemented within a health app affects users' likeliness of following agent advice, their perception of agent characteristics, and their feeling of rapport. In addition, we assessed usability and intention to use.

METHODS

The ECA was implemented within a frailty assessment app in which three health questionnaires were translated into agent dialogues. In a within-subject experiment, questionnaire dialogues were randomly offered by a young female agent or an older male agent. Participants were asked to think aloud during interaction. Afterward, they rated the likeliness of following the agent's advice, agent characteristics, rapport, usability, and intention to use and participated in a semistructured interview.

RESULTS

A total of 20 older adults (72.2 [SD 3.5] years) participated. The older male agent was perceived as more authoritative than the young female agent (P=.03), but no other differences were found. The app scored high on usability (median 6.1) and intention to use (median 6.0). Participants indicated they did not see an added value of the agent to the health app.

CONCLUSIONS

Agent age and gender little influence users' impressions after short interaction but remain important at first glance to lower the threshold to interact with the agent. Thus, it is important to take the design of ECAs into account when implementing them into health apps.

Feasibility of an Electronic Health Tool to Promote Physical Activity in Primary Care: Pilot Cluster Randomized Controlled Trial

Background

Physical inactivity is associated with increased health risks. Primary care providers (PCPs) are well positioned to support increased physical activity (PA) levels through screening and provision of PA prescriptions. However, PCP counseling on PA is not common.

Objective

This study aimed to assess the feasibility of implementing an electronic health (eHealth) tool to support PA counseling by PCPs and estimate intervention effectiveness on patients’ PA levels.

Methods

A pragmatic pilot study was conducted using a stepped wedge cluster randomized trial design. The study was conducted at a single primary care clinic, with 4 pre-existing PCP teams. Adult patients who had a periodic health review (PHR) scheduled during the study period were invited to participate. The eHealth tool involved an electronic survey sent to participants before their PHR via an email or a tablet; data were used to automatically produce tailored resources and a PA prescription in the electronic medical record of participants in the intervention arm. Participants assigned to the control arm received usual care from their PCP. Feasibility was assessed by the proportion of completed surveys and patient-reported acceptability and fidelity measures. The primary effectiveness outcome was patient-reported PA at 4 months post-PHR, measured as metabolic equivalent of task (MET) minutes per week. Secondary outcomes assessed determinants of PA, including self-efficacy and intention to change based on the Health Action Process Approach behavior change theory.

Results

A total of 1028 patients receiving care from 34 PCPs were invited to participate and 530 (51.55%) consented (intervention [n=296] and control [n=234]). Of the participants who completed a process evaluation, almost half (88/178, 49.4%) stated they received a PA prescription, with only 42 receiving the full intervention including tailored resources from their PCP. A cluster-level linear regression analysis yielded a non–statistically significant positive difference in MET-minutes reported per week at follow-up between intervention and control conditions (mean difference 1027; 95% CI −155 to 2209; P=.09). No statistically significant differences were observed for secondary outcomes.

Conclusions

Our results suggest that it is feasible to build an eHealth tool that screens and provides tailored resources for PA in a primary care setting but suboptimal intervention fidelity suggests greater work must be done to address PCP barriers to resource distribution. Participant responses to the primary effectiveness outcome (MET-minutes) were highly variable, reflecting a need for more robust measures of PA in future trials to address limitations in patient-reported data.

Trial Registration

ClinicalTrials.gov NCT03181295; https://clinicaltrials.gov/ct2/show/NCT03181295

Electronic self-administered screening for substance use in adult primary care patients: feasibility and acceptability of the tobacco, alcohol, prescription medication, and other substance use (myTAPS) screening tool

BACKGROUND

The TAPS Tool is a substance use screening and brief assessment instrument that was developed for use in primary care medical settings. It is one of the first screening instruments to provide rapid assessment of all commonly used substance classes, including illicit and prescription opioids, and is one of the only available screeners designed and validated in an electronic self-administered format (myTAPS). This secondary analysis of data from the TAPS Tool validation study describes the feasibility and acceptability of the myTAPS among primary care patients.

METHODS

Adult patients (N = 2000) from five primary care clinics completed the TAPS Tool on a tablet computer (myTAPS), and in an interviewer-administered format. Requests for assistance and time required were tracked, and participants completed a survey on ease of use, utilization of audio guidance, and format preference. Logistic regression was used to examine outcomes in defined subpopulations, including groups that may have greater difficulty completing an electronic screener, and those that may prefer an electronic self-administered approach.

RESULTS

Almost all participants (98.3%) reported that the myTAPS was easy to use. The median time to complete myTAPS screening was 4.0 min (mean 4.48, standard deviation 2.57). More time was required by participants who were older, Hispanic, Black, or reported non-medical prescription drug use, while less time was required by women. Assistance was requested by 25% of participants, and was more frequently requested by those who with lower education (OR = 2.08, 95% CI 1.62-2.67) or age > 65 years (OR = 2.79, 95% CI 1.98-3.93). Audio guidance was utilized by 18.3%, and was more frequently utilized by participants with lower education (OR = 2.01, 95% CI 1.54-2.63), age > 65 years (OR = 1.79, 95% CI 1.22-2.61), or Black race (OR = 1.30, 95% 1.01-1.68). The myTAPS format was preferred by women (OR = 1.29, 95% CI 1.00-1.66) and individuals with drug use (OR = 1.43, 95% CI 1.09-1.88), while participants with lower education preferred the interviewer-administered format (OR = 2.75, 95% CI 2.00-3.78).

CONCLUSIONS

Overall, myTAPS screening was feasible and well accepted by adult primary care patients. Clinics adopting electronic screening should be prepared to offer assistance to some patients, particularly those who are older or less educated, and should have the capacity to use an interviewer-administered approach when required.

Implementing electronic substance use disorder and depression and anxiety screening and behavioral interventions in primary care clinics serving people with HIV: Protocol for the Promoting Access to Care Engagement (PACE) trial

BACKGROUND

Substance use disorders (SUDs) and psychiatric disorders are common among people with HIV (PWH) and lead to poor outcomes. Yet these conditions often go unrecognized and untreated in primary care.

METHODS

The Promoting Access to Care Engagement (PACE) trial currently in process examines the impact of self-administered electronic screening for SUD risk, depression and anxiety in three large Kaiser Permanente Northern California primary care clinics serving over 5000 PWH. Screening uses validated measures (Tobacco, Alcohol, Prescription medication, and other Substance use [TAPS]; and the Adult Outcomes Questionnaire [AOQ], which includes the Patient Health Questionnaire [PHQ-9] and Generalized Anxiety Disorder [GAD-2]) delivered via three modalities (secure messaging, tablets in waiting rooms, and desktop computers in exam rooms). Results are integrated automatically into the electronic health record. Based on screening results and physician referrals, behavioral health specialists embedded in primary care initiate motivational interviewing- and cognitive behavioral therapy-based brief treatment and link patients to addiction and psychiatry clinics as needed. Analyses examine implementation (screening and treatment rates) and effectiveness (SUD, depression and anxiety symptoms; HIV viral control) outcomes using a stepped-wedge design, with a 12-month intervention phase implemented sequentially in the clinics, and a 24-month usual care period prior to implementation in each clinic functioning as sequential observational phases for comparison. We also evaluate screening and treatment costs and implementation barriers and facilitators.

DISCUSSION

The study examines innovative, technology-facilitated strategies for improving assessment and treatment in primary care. Results may help to inform substance use, mental health, and HIV services.

TRIAL REGISTRATION

NCT03217058.

Routine patient surveys: Patients' preferences and information gained by healthcare providers

BACKGROUND

Patient feedback after contact with a hospital is regarded as an important source of information for the improvement of local healthcare services. Routine patient surveys are in widespread use to obtain such feedback. While general principles for the composition of this kind of surveys have been described in the literature, it is unknown which method of contact and topics of feedback are important to patients in postcontact healthcare surveys.

MATERIAL AND METHODS

We invited 2931 consecutive patients who had in- or outpatient contact with the Department of Orthopaedics and Traumatology at the University Hospital Basel to an anonymous survey. They were asked whether they were generally in favor of feedback surveys. They also had the opportunity to state their preferred form of contact (text message, app, email, online or letter) and provide up to three topics that they regarded as specifically important in patient surveys.

RESULTS

A total of 745 patients participated in the survey (25.4%), of these 61.9% expressed the preference to be surveyed, and 69.1% selected `letter' as one of the preferred forms of contact. Favoring only `letter' contact increased substantially with age. Overall 54.6% of patients stated at least one topic that they wished to give feedback on. The most frequent topics were related to treatment and rather general aspects regarding staff and overall impression. The wish to include suggestions for improvements was rarely mentioned as specific topic.

CONCLUSIONS

The majority of patients seem to be rather indifferent to the existence and content of patient surveys. They mention a wide range of topics from general to specific ones, but do not express interest in the opportunity to suggest changes. There is a need to effectively engage patients in healthcare planning using new approaches to obtain valuable feedback on patients' hospital stay and contact experiences. These new approaches should ideally be more informative and cost-effective than the current practice.

Electronic screening and brief intervention for unhealthy alcohol use in primary care waiting rooms - A pilot project

Background: In primary care, electronic self-administered screening and brief interventions for unhealthy alcohol may overcome some of the implementation barriers of face-to-face intervention. We developed an anonymous electronic self-administered screening brief intervention device for unhealthy alcohol use and assessed its feasibility and acceptability in primary care practice waiting rooms. Two modes of delivery were compared: with or without the presence of a research assistant (RA) to make patients aware of the device's presence and help users. Using the device was optional. Methods: The devices were placed in 10 participating primary care practices waiting rooms for 6 weeks, and were accessible on a voluntary basis. Number of appointments by each practice during the course of the study was recorded. Access to the electronic brief intervention was voluntary among those who screened positive. Screening and brief intervention rates and characteristics of users were compared across the modes of delivery. Results: During the study, there were 7270 appointments and 1511 individuals used the device (20.8%). Mean age of users was 45.3 (19.5), and 57.9% screened positive for unhealthy alcohol use. Of them, 53.8% accessed the brief intervention content. The presence of the RA had a major impact on the device's usage (59.6% vs 17.4% when absent). When the RA was present, participants were less likely to screen positive (49.4% vs 60.7%, P = 0.0003) but more likely to access the intervention (62.7% vs 51.4%, P = 0.009). Results from the satisfaction survey indicated that users found the device easy to use (93.5%), questions useful (89-95%) and 77.2% reported that their friends would be willing to use it. Conclusions: This pilot project indicates that the implementation of an electronic screening and brief intervention device for unhealthy alcohol is feasible and acceptable in primary care practices but that, without human support, its use is rather limited.

Development and evaluation of a tablet-based participation measure for older adults in rehabilitation settings

Purpose: To develop a tablet-based participation measure and to evaluate its reliability and acceptability to an older Chinese population in rehabilitation settings.Method: A multidimensional, self-reported participation measure, the Participation Measure-3 Domains, 4 Dimensions (PM-3D4D), was programed into mobile application software and presented on tablet computers. To explore the reliability of the tablet-based PM-3D4D, 80 adults in rehabilitation outpatient settings aged ≥65 years completed the tablet and the paper versions of the measure at baseline and at 1-week follow-up. Intraclass correlation coefficients were calculated for concordance and test-retest reliability. Participants' acceptability toward the two versions of the measure was described.Results: The tablet-based PM-3D4D showed good to excellent test-retest reliability (Intraclass correlation coefficients = 0.79 ∼ 0.96) and high concordance with the paper-form (Intraclass correlation coefficients = 0.74-1.00). Approximately, 44% participants reported preference for the tablet-based measure, and 20% reported preference for the paper-form measure. Many participants found the tablet-based measure user-friendly, convenient, and environmentally-friendly.Conclusions: Findings of this study provide supportive evidence for administering the tablet-based PM-3D4D to an older Chinese population in rehabilitation settings and suggest a promising measurement methodology for future clinical practice.Implications for rehabilitationThe developed tablet-based participation measure, the Participation Measure-3 Domains, 4 Dimensions (PM-3D4D), fills a critical void for an efficient and reliable rehabilitation outcome measure tailored to the needs of older adults in rehabilitation settings.The tablet-based PM-3D4D is a reliable outcome measure.Most of the older adults in rehabilitation settings preferred to use the tablet-based participation measure than the paper-form measure; and very few of them reported difficulty with using the tablet-version measure.A high concordance was found between data collected by the tablet version PM-3D4D and data collected by the paper version PM-3D4D.

Are Electronic and Paper Questionnaires Equivalent to Assess Patients with Overactive Bladder?

PURPOSE

Overactive bladder syndrome is defined as urinary urgency, usually accompanied by frequency and nocturia, with or without urgency urinary incontinence in the absence of urinary tract infection or another obvious pathological condition. Electronic questionnaires have been used in a few specialties with the hope of improving treatment outcomes and patient satisfaction. However, they have not been widely used in the urological field. When treating overactive bladder, the main outcome is to improve patient quality of life. The primary objective of this study was to evaluate whether electronic questionnaires would be equally accepted as or preferred to paper questionnaires. The secondary objective was to look at the preference in relation to patient age, education and iPad® tablet familiarity.

MATERIALS AND METHODS

We prospectively evaluated the iList® electronic questionnaire application using a friendly iPad tablet in patients with overactive bladder who presented to the urology clinic at our institution. Each of the 80 patients who were recruited randomly completed the validated OABSS (Overactive Bladder Symptom Score) and the PPBC (Patient Perception of Bladder Condition) questionnaires in paper and electronic format on the tablet. Variables potentially associated with the outcomes of interest included demographic data, questionnaire method preference, patient response rate and iPad familiarity. We used the 2-sided Z-test to determine whether the proportion of patients who considered the tablet to be the same, better or much better than paper was significantly greater than 50%. The 2-sided chi-square test was applied to assess whether the intervention effect significantly differed among the demographic subgroups.

RESULTS

A total of 80 patients 21 to 87 years old were enrolled in the study from November 2015 to August 2016. Of the patients 53% were female and 49% were 65 years or younger. The incidence of those who considered the tablet to be the same or better than paper was 82.5% (95% CI 74.2-90.8, p <0.001). The incidence of patients who considered the tablet to be the same or better than paper ranged from 76% to 97% regardless of age, gender and education subgroup as well as in those with any familiarity with the tablet (each p <0.001). Of the 20 patients who were not familiar with the tablet 45% preferred the electronic questionnaire (p = 0.654).

CONCLUSIONS

We found that the proportion of patients who considered electronic questionnaires to be equivalent to or better than paper versions was higher than those who preferred paper questionnaires regardless of age, gender or education level.

Usability of a Novel Mobile Health iPad App by Vulnerable Populations

BACKGROUND

Recent advances in mobile technologies have created new opportunities to reach broadly into populations that are vulnerable to health disparities. However, mobile health (mHealth) strategies could paradoxically increase health disparities, if low socioeconomic status individuals lack the technical or literacy skills needed to navigate mHealth programs.

OBJECTIVE

The aim of this study was to determine whether patients from vulnerable populations could successfully navigate and complete an mHealth patient decision aid.

METHODS

We analyzed usability data from a randomized controlled trial of an iPad program designed to promote colorectal cancer (CRC) screening. The trial was conducted in six primary care practices and enrolled 450 patients, aged 50-74 years, who were due for CRC screening. The iPad program included a self-survey and randomly displayed either a screening decision aid or a video about diet and exercise. We measured participant ability to complete the program without assistance and participant-rated program usability.

RESULTS

Two-thirds of the participants (305/450) were members of a vulnerable population (limited health literacy, annual income < US $20,000, or black race). Over 92% (417/450) of the participants rated the program highly on all three usability items (90.8% for vulnerable participants vs 96.6% for nonvulnerable participants, P=.006). Only 6.9% (31/450) of the participants needed some assistance to complete the program. In multivariable logistic regression, being a member of a vulnerable population was not associated with needing assistance. Only older age, less use of text messaging (short message service, SMS), and lack of Internet use predicted needing assistance.

CONCLUSIONS

Individuals who are vulnerable to health disparities can successfully use well-designed mHealth programs. Future research should investigate whether mHealth interventions can reduce health disparities.

Willingness and Ability of Older Adults in the Emergency Department to Provide Clinical Information Using a Tablet Computer

OBJECTIVES

To estimate the proportion of older adults in the emergency department (ED) who are willing and able to use a tablet computer to answer questions.

DESIGN

Prospective, ED-based cross-sectional study.

SETTING

Two U.S. academic EDs.

PARTICIPANTS

Individuals aged 65 and older.

MEASUREMENTS

As part of screening for another study, potential study participants were asked whether they would be willing to use a tablet computer to answer eight questions instead of answering questions orally. A custom user interface optimized for older adults was used. Trained research assistants observed study participants as they used the tablets. Ability to use the tablet was assessed based on need for assistance and number of questions answered correctly.

RESULTS

Of 365 individuals approached, 248 (68%) were willing to answer screening questions, 121 of these (49%) were willing to use a tablet computer; of these, 91 (75%) were able to answer at least six questions correctly, and 35 (29%) did not require assistance. Only 14 (12%) were able to answer all eight questions correctly without assistance. Individuals aged 65 to 74 and those reporting use of a touchscreen device at least weekly were more likely to be willing and able to use the tablet computer. Of individuals with no or mild cognitive impairment, the percentage willing to use the tablet was 45%, and the percentage answering all questions correctly was 32%.

CONCLUSION

Approximately half of this sample of older adults in the ED was willing to provide information using a tablet computer, but only a small minority of these were able to enter all information correctly without assistance. Tablet computers may provide an efficient means of collecting clinical information from some older adults in the ED, but at present, it will be ineffective for a significant portion of this population.

Psychometric equivalence of electronic and telephone completion of the ICIQ modules

AIMS

To assess the equivalence of touch-screen (hand-held iPad) and telephone completion of patient-completed International Consultation on Incontinence Questionnaire (ICIQ) modules by comparison with corresponding data collected using conventional paper-and-pencil methods.

METHODS

Men and women, attending urology outpatients complaining of LUTS, were randomised to one of three groups which determined the order in which they completed three administrations of the same questionnaire: paper, iPad and telephone. Four ICIQ questionnaires were evaluated: ICIQ-MLUTS, ICIQ-LUTSqol, ICIQ-OABqol and ICIQ-UI SF.

RESULTS

From August 2012 to October 2014 a total of 448 out of 491 (91%) recruits completed the first two administrations and were included in the analysis. Three hundred forty-eight out of 491 (71%) completed the phone administration. The intra-class correlation coefficient (ICC) and Kappa statistic were calculated where appropriate between completed pairs of administrations. Mean ICC correlations were high (>0.8) between paper and iPad administrations. Paired paper and phone administrations were less well correlated, although still high (mean ICC>0.75). This may be partly due to the practical limitation that the phone interview was completed up to a week later than the initial two administrations. There was no evidence that potential moderator effects (gender, age and experience with computers or touch screen devices) significantly affected overall reliability of scores between administrations.

CONCLUSIONS

We can recommend the interchangeable use of ICIQ electronic or paper based questionnaires in a clinical or research setting. Self-report is preferable to telephone delivery where possible. Neurourol. Urodynam. 9999:XX-XX, 2016. © 2016 Wiley Periodicals, Inc.

The usefulness of a mobile device-based system for patient-reported outcomes in a spine outpatient clinic

BACKGROUND CONTEXT

Patient-reported outcomes (PROs) are typically collected using a paper form, but this format is cumbersome to incorporate into outpatient clinic visits as well as in research. Therefore, we developed a mobile device-based system (mobile system) for spinal PRO. We hypothesized that this system may improve the quality of care in an outpatient clinic.

PURPOSE

This study aimed to analyze the patient-reported efficacy of a mobile system through a survey of patients' responses compared with a paper system.

STUDY DESIGN/SETTING

A prospective observational study was carried out.

PATIENT SAMPLE

Surveys were conducted for 103 patients who had experience using both the paper and electronic systems in the outpatient clinic.

OUTCOME MEASURES

Patient-reported positive response score (PRS) was the outcome measure.

METHODS

The survey included the characteristics of the patients (sex, age, use of smartphone, familiarity with smartphone applications, proficiency of typing with mobile device, site of pain, and education level) and eight questions in four domains: (1) efficacy in the waiting room, (2) efficacy during the clinic visit, (3) overall satisfaction, and (4) opinion about the use of this system. The response to each question was scored from 1 to 5 (1, negative; 5, positive response). The patient-reported PRS was calculated by adding the scores of the 8 questions and converting the total range to 0-100 (60, neutral).

RESULTS

The mean PRS of the 8 questions was 79.8 (95% CI, 76.7-83.9). The mean PRS was 78.9 (75.6-82.2) at the waiting room and was 80.5 (77.1-83.9) during the clinic. The PRS for overall satisfaction and use of this system were 83.3 (79.6-87.0) and 77.1 (71.9-82.3), respectively. The use of smartphones and the proficiency of typing were independently significant predictors of PRS with an R(2) value of 0.325.

CONCLUSIONS

The mobile device-based system improved the patient-reported efficacy in spine outpatient clinics. However, various factors such as the use of smartphones need to be considered when developing and applying mobile systems.

A review of approaches to improve participation of culturally and linguistically diverse populations in clinical trials

The under-representation of culturally and linguistically diverse participants in clinical trials is an ongoing concern for medical researchers and the community. The aim of this review is to examine the complex issue of recruiting culturally and linguistically diverse (CALD) older people to medical research and to examine responses to these issues. The review focuses on (1) trends in the existing literature on barriers to and strategies for recruiting CALD and older people to clinical research, (2) issues with informed consent for CALD populations, and (3) the efficacy of innovative approaches, including approaches incorporating multimedia in research and consent processes. The literature indicates that predominant barriers to greater involvement of CALD patients in clinical trials are communication, including literacy and health literacy considerations; English language competence; and cultural factors in the research setting such as mistrust of consent processes, as well as considerable practical and logistical barriers, including mobility considerations. Some evidence exists that incorporating multimedia resources into the informed consent process can improve patient understanding and is preferred by patients, yet these findings are inconclusive. A multi-methodological approach, including the use of culturally and linguistically sensitive multimedia tools, may help address the issue of low inclusion of CALD groups in clinical research. Researcher education needs to be taken into account to address preconceptions about CALD resistance to research participation and to raise awareness of cultural concerns in regard to research participation.

A review of approaches to improve participation of culturally and linguistically diverse populations in clinical trials

The under-representation of culturally and linguistically diverse participants in clinical trials is an ongoing concern for medical researchers and the community. The aim of this review is to examine the complex issue of recruiting culturally and linguistically diverse (CALD) older people to medical research and to examine responses to these issues. The review focuses on (1) trends in the existing literature on barriers to and strategies for recruiting CALD and older people to clinical research, (2) issues with informed consent for CALD populations, and (3) the efficacy of innovative approaches, including approaches incorporating multimedia in research and consent processes. The literature indicates that predominant barriers to greater involvement of CALD patients in clinical trials are communication, including literacy and health literacy considerations; English language competence; and cultural factors in the research setting such as mistrust of consent processes, as well as considerable practical and logistical barriers, including mobility considerations. Some evidence exists that incorporating multimedia resources into the informed consent process can improve patient understanding and is preferred by patients, yet these findings are inconclusive. A multi-methodological approach, including the use of culturally and linguistically sensitive multimedia tools, may help address the issue of low inclusion of CALD groups in clinical research. Researcher education needs to be taken into account to address preconceptions about CALD resistance to research participation and to raise awareness of cultural concerns in regard to research participation.

Implementation of a Computerized Screening Inventory: Improved Usability Through Iterative Testing and Modification

Background

The administration of health screeners in a hospital setting has traditionally required (1) clinicians to ask questions and log answers, which can be time consuming and susceptible to error, or (2) patients to complete paper-and-pencil surveys, which require third-party entry of information into the electronic health record and can be vulnerable to error and misinterpretation. A highly promising method that avoids these limitations and bypasses third-party interpretation is direct entry via a computerized inventory.

Objective

To (1) computerize medical and behavioral health screening for use in general medical settings, (2) optimize patient acceptability and feasibility through iterative usability testing and modification cycles, and (3) examine how age relates to usability.

Methods

A computerized version of 15 screeners, including behavioral health screeners recommended by a National Institutes of Health Office of Behavioral and Social Sciences Research collaborative workgroup, was subjected to systematic usability testing and iterative modification. Consecutive adult, English-speaking patients seeking treatment in an urban emergency department were enrolled. Acceptability was defined as (1) the percentage of eligible patients who agreed to take the assessment (initiation rate) and (2) average satisfaction with the assessment (satisfaction rate). Feasibility was defined as the percentage of the screening items completed by those who initiated the assessment (completion rate). Chi-square tests, analyses of variance, and Pearson correlations were used to detect whether improvements in initiation, satisfaction, and completion rates were seen over time and to examine the relation between age and outcomes.

Results

Of 2157 eligible patients approached, 1280 agreed to complete the screening (initiation rate=59.34%). Statistically significant increases were observed over time in satisfaction (F_3,1061=3.35, P=.019) and completion rates (F_3,1276=25.44, P<.001). Younger age was associated with greater initiation (initiated, mean [SD], 46.6 [18.7] years; declined: 53.0 [19.5] years, t_2,155=−7.6, P<.001), higher completion (r=−.20, P<.001), and stronger satisfaction (r=−.23, P<.001).

Conclusions

In a rapid-paced emergency department with a heterogeneous patient population, 59.34% (1280/2157) of all eligible patients initiated the computerized screener with a completion rate reaching over 90%. Usability testing revealed several critical principles for maximizing usability of the computerized medical and behavioral health screeners used in this study. Further work is needed to identify usability issues pertaining to other screeners, racially and ethnically diverse patient groups, and different health care settings.

Feasibility of automated pre-screening for lifestyle and behavioral health risk factors in primary care

BACKGROUND

Screening of primary care patients for unhealthy behaviors and mental health issues is recommended by numerous governing bodies internationally, yet evidence suggests that provider-initiated screening is not routine practice. The objective of this study was to implement systematic pre-screening of primary care patients for common preventive health issues on a large scale.

METHODS

Patients registered for non-acute visits to one of 40 primary care providers from eight clinics in an Academic Medical Center health care network in the United States from May, 2012 to May, 2014 were contacted one- to three-days prior to their visit. Patients were invited to complete a questionnaire using an Interactive Voice Response (IVR) system. Six items assessed pain, smoking, alcohol use, physical activity, concern about weight, and mood.

RESULTS

The acceptance rate among eligible patients reached by phone was 65.6 %, of which 95.5 % completed the IVR-Screen (N = 8,490; mean age 57; 57 % female). Sample demographics were representative of the overall primary care population from which participants were drawn on gender, race, and insurance status, but participants were slightly older and more likely to be married. Eighty-seven percent of patients screened positive on at least one item, and 59 % endorsed multiple problems. The majority of respondents (64.2 %) reported being never or only somewhat physically active. Weight concern was reported by 43.9 % of respondents, 36.4 % met criteria for unhealthy alcohol use, 23.4 % reported current pain, 19.6 % reported low mood, and 9.4 % reported smoking.

CONCLUSIONS

The percent endorsement for each behavioral health concern was generally consistent with studies of screening using other methods, and contrasts starkly with the reported low rates of screening and intervention for such concerns in typical PC practice. Results support the feasibility of IVR-based, large-scale pre-appointment behavioral health/ lifestyle risk factor screening of primary care patients. Pre-screening in this population facilitated participation in a controlled trial of brief treatment for unhealthy drinking, and also could be valuable clinically because it allows for case identification and management during routine care.

Validity, reliability, and generalizability in qualitative research

In general practice, qualitative research contributes as significantly as quantitative research, in particular regarding psycho-social aspects of patient-care, health services provision, policy setting, and health administrations. In contrast to quantitative research, qualitative research as a whole has been constantly critiqued, if not disparaged, by the lack of consensus for assessing its quality and robustness. This article illustrates with five published studies how qualitative research can impact and reshape the discipline of primary care, spiraling out from clinic-based health screening to community-based disease monitoring, evaluation of out-of-hours triage services to provincial psychiatric care pathways model and finally, national legislation of core measures for children's healthcare insurance. Fundamental concepts of validity, reliability, and generalizability as applicable to qualitative research are then addressed with an update on the current views and controversies.

Validity, reliability, and generalizability in qualitative research

In general practice, qualitative research contributes as significantly as quantitative research, in particular regarding psycho-social aspects of patient-care, health services provision, policy setting, and health administrations. In contrast to quantitative research, qualitative research as a whole has been constantly critiqued, if not disparaged, by the lack of consensus for assessing its quality and robustness. This article illustrates with five published studies how qualitative research can impact and reshape the discipline of primary care, spiraling out from clinic-based health screening to community-based disease monitoring, evaluation of out-of-hours triage services to provincial psychiatric care pathways model and finally, national legislation of core measures for children's healthcare insurance. Fundamental concepts of validity, reliability, and generalizability as applicable to qualitative research are then addressed with an update on the current views and controversies.

The Role of eHealth in Optimizing Preventive Care in the Primary Care Setting

Modifiable health risk behaviors such as smoking, overweight and obesity, risky alcohol consumption, physical inactivity, and poor nutrition contribute to a substantial proportion of the world’s morbidity and mortality burden. General practitioners (GPs) play a key role in identifying and managing modifiable health risk behaviors. However, these are often underdetected and undermanaged in the primary care setting. We describe the potential of eHealth to help patients and GPs to overcome some of the barriers to managing health risk behaviors. In particular, we discuss (1) the role of eHealth in facilitating routine collection of patient-reported data on lifestyle risk factors, and (2) the role of eHealth in improving clinical management of identified risk factors through provision of tailored feedback, point-of-care reminders, tailored educational materials, and referral to online self-management programs. Strategies to harness the capacity of the eHealth medium, including the use of dynamic features and tailoring to help end users engage with, understand, and apply information need to be considered and maximized. Finally, the potential challenges in implementing eHealth solutions in the primary care setting are discussed. In conclusion, there is significant potential for innovative eHealth solutions to make a contribution to improving preventive care in the primary care setting. However, attention to issues such as data security and designing eHealth interfaces that maximize engagement from end users will be important to moving this field forward.

Tablet-based screening improves continence management in multiple sclerosis

Objective

To investigate whether electronic continence questionnaires aid early identification and optimizes management of sphincter dysfunction in a multiple sclerosis clinic.

Methods

A custom designed, tablet-based cross-platform software tool was designed to capture validated multiple sclerosis (MS) patient-reported outcomes. An unselected cohort of MS patients from a tertiary referral clinic completed electronic tablet-based versions of the Bladder Control Scale (BLCS) and the Bowel Control Scale in the waiting room. Data were captured wirelessly “on-the-fly” and stored in a deidentified, secure database; and individual questionnaire results were immediately available to the treating neurologist in the electronic medical record. Scores of ≥2 on either questionnaire generated an automated electronic referral to the clinic MS continence nurse (MS CN).

Results

One hundred and fifty-seven MS patients completed a total of 184 electronic continence test sets and on two occasions only the BLCS was completed. An automatic electronic referral for formal continence review was generated 128 times in 108 patients. Fifty-seven formal continence assessments were undertaken by the MS CN following automated referral. All reviews resulted in at least one clinical intervention being made.

Interpretation

Tablet-based data capture and automated continence referral using this software tool is an efficient, sensitive, and feasible method of screening MS patients for bladder and bowel dysfunction. Concordance with the results of formal continence assessment in this pilot study validates the use of this technology as a screening tool.

Patient preference: a comparison of electronic patient-completed questionnaires with paper among cancer patients

In this study, we compared cancer patients preference for computerised (tablet/web-based) surveys versus paper. We also assessed whether the understanding of a cancer-related topic, pharmacogenomics is affected by the survey format, and examined differences in demographic and medical characteristics which may affect patient preference and understanding. Three hundred and four cancer patients completed a tablet-administered survey and another 153 patients completed a paper-based survey. Patients who participated in the tablet survey were questioned regarding their preference for survey format administration (paper, tablet and web-based). Understanding was assessed with a 'direct' method, by asking patients to assess their understanding of genetic testing, and with a 'composite' score. Patients preferred administration with tablet (71%) compared with web-based (12%) and paper (17%). Patients <65 years old, non-Caucasians and white-collar professionals significantly preferred the computerised format following multivariate analysis. There was no significant difference in understanding between the paper and tablet survey with direct questioning or composite score. Age (<65 years) and white-collar professionals were associated with increased understanding (both P = 0.03). There was no significant difference in understanding between the tablet and print survey in a multivariate analysis. Patients overwhelmingly preferred computerised surveys and understanding of pharmacogenomics was not affected by survey format.

Real-time patient survey data during routine clinical activities for rapid-cycle quality improvement

Background

Surveying patients is increasingly important for evaluating and improving health care delivery, but practical survey strategies during routine care activities have not been available.

Objective

We examined the feasibility of conducting routine patient surveys in a primary care clinic using commercially available technology (Web-based survey creation, deployment on tablet computers, cloud-based management of survey data) to expedite and enhance several steps in data collection and management for rapid quality improvement cycles.

Methods

We used a Web-based data management tool (survey creation, deployment on tablet computers, real-time data accumulation and display of survey results) to conduct four patient surveys during routine clinic sessions over a one-month period. Each survey consisted of three questions and focused on a specific patient care domain (dental care, waiting room experience, care access/continuity, Internet connectivity).

Results

Of the 727 available patients during clinic survey days, 316 patients (43.4%) attempted the survey, and 293 (40.3%) completed the survey. For the four 3-question surveys, the average time per survey was overall 40.4 seconds, with a range of 5.4 to 20.3 seconds for individual questions. Yes/No questions took less time than multiple choice questions (average 9.6 seconds versus 14.0). Average response time showed no clear pattern by order of questions or by proctor strategy, but monotonically increased with number of words in the question (<20 words, 21-30 words, >30 words)—8.0, 11.8, 16.8, seconds, respectively.

Conclusions

This technology-enabled data management system helped capture patient opinions, accelerate turnaround of survey data, with minimal impact on a busy primary care clinic. This new model of patient survey data management is feasible and sustainable in a busy office setting, supports and engages clinicians in the quality improvement process, and harmonizes with the vision of a learning health care system.

A randomized controlled pilot trial of the functional assessment screening tablet to engage patients at the point of care

BACKGROUND

Healthcare providers play an important role in encouraging healthy behaviors and improving health-related quality of life (HRQoL). They are most effective when they partner with informed, engaged patients.

OBJECTIVE

To examine the impact of a new health-information technology intervention (FAST-Feedback) that provides patients with immediate, personalized, guideline-based feedback regarding tobacco use, physical activity, and HRQoL, and encourages patients to initiate discussions regarding these topics with their primary care physician.

DESIGN

A pilot, randomized controlled trial clustered by resident physician, with patients as the unit of analysis.

PARTICIPANTS

Resident physicians and their out-patients in a single academic health center between May and October 2011.

INTERVENTION

Patients received (intervention) or did not receive (control) FAST-Feedback prior to the clinical encounter.

MAIN OUTCOME MEASURES

Primary outcomes were patient reports of initiating any discussions regarding tobacco use, physical activity, and HRQoL. Subgroup analyses examined patient reports of discussions regarding tobacco use, physical activity, and HRQoL, respectively.

KEY RESULTS

Thirty of the 36 eligible resident physicians (83%) agreed to participate; 173 of their 415 eligible patients (42%) expressed interest in the study and 99 (24%) consented to participate. Compared to controls, a higher percentage of intervention patients reported initiating any discussion with their resident physician, although this difference was not statistically significant (40% vs. 27%; p = 0.12). For subgroup analyses regarding specific topics of discussion, patients in the intervention group reported initiating more discussions regarding mental HRQoL than controls (23% vs. 0%; p = 0.02). There was no difference in patient reports of initiating discussions regarding smoking, physical activity or physical HRQoL.

CONCLUSIONS

Providing patients with immediate, personalized, guideline-based feedback prior to the clinical encounter can increase patient-initiated discussions regarding mental HRQoL. Future work should test FAST-Feedback in a larger population and evaluate the impact on tobacco cessation, increased physical activity, and improvements in HRQoL.

Patterns of response to patient-centered decision support through a personal health record

BACKGROUND

Over 140 million people in the United States have at least one chronic medical condition, but they receive fewer than 60% of guideline-recommended services for these conditions. Increasing patients' involvement in their own care may improve the receipt of guideline-recommended services. We evaluated patients' patterns of responses to notifications regarding guideline-recommended services delivered through a personalized health record (PHR).

MATERIALS AND METHODS

We enrolled 584 participants with high cardiovascular disease risk from 73 primary care practices into an active PHR in which they received patient-centered decision support-notifications delivered via a PHR regarding prevention gaps (i.e., unmet preventive healthcare or chronic disease monitoring). Participants with prevention gaps received up to three weekly messages regarding all services due within a 2-month time frame. These three-message cycles could repeat up to every 2 months for a new, or continuing, prevention gap.

RESULTS

Of the 584 participants, 501 (86%) received at least one reminder. Approximately 61% of these participants accessed the PHR or received the care that triggered the message after the first message and 73% after the first two messages. In subsequent three-message cycles, we observed no change in the number of messages required prior to participants accessing the PHR or receiving recommended care (chi-squared = 12.4, p = 0.3). Of the 2,656 prevention gaps these participants had over 1 year, 1,539 (58%) were closed.

CONCLUSIONS

In this low-intensity intervention, participants accessed the PHR and received recommended care. Providing notification through the PHR allows patients to choose when they receive, and take action on, the message. Notifications can be provided to patients through a PHR without alert fatigue and may be an additional tool to help patients achieve better health.

Using a mobile health application to support self-management in COPD: a qualitative study

BACKGROUND

Telehealth shows promise for supporting patients in managing their long-term health conditions, such as chronic obstructive pulmonary disease (COPD). However, it is currently unclear how patients, and particularly older people, may benefit from these technological interventions.

AIM

To explore patients' expectations and experiences of using a mobile telehealth-based (mHealth) application and to determine how such a system may impact on their perceived wellbeing and ability to manage their COPD.

DESIGN AND SETTING

Embedded qualitative study using interviews with patients with COPD from various community NHS services: respiratory community nursing service, general practice, and pulmonary rehabilitation.

METHOD

An embedded qualitative study was conducted to which patients were recruited using purposive sampling to achieve maximum variation. Interviews were carried out prior to receiving the mHealth system and again after a 6-month period. Data were analysed using a grounded theory approach.

RESULTS

The sample comprised 19 patients (aged 50-85 years) with varied levels of computer skills. Patients identified no difficulties in using the mHealth application. The main themes encapsulating patients' experience of using the mHealth application related to an increased awareness of the variability of their symptoms (onset of exacerbation and recovery time) and reassurance through monitoring (continuity of care).

CONCLUSION

Patients were able to use the mHealth application, interpret clinical data, and use these within their self-management approach regardless of previous knowledge. Telehealth interventions can complement current clinical care pathways to support self-management behaviour.

Connected Health: Cancer Symptom and Quality-of-Life Assessment Using a Tablet Computer

Incorporation of tablet computers (TCs) into patient assessment may facilitate safe and secure data collection. We evaluated the usefulness and acceptability of a TC as an electronic self-report symptom assessment instrument. Research Electronic Data Capture Web-based application supported data capture. Information was collected and disseminated in real time and a structured format. Completed questionnaires were printed and given to the physician before the patient visit. Most participants completed the survey without assistance. Completion rate was 100%. The median global quality of life was high for all. More than half reported pain. Based on Edmonton Symptom Assessment System, the top 3 most common symptoms were tiredness, anxiety, and decreased well-being. Patient and physician acceptability for these quick and useful TC-based surveys was excellent.

Usability of an innovative and interactive electronic system for collection of patient-reported data in axial spondyloarthritis: comparison with the traditional paper-administered format

OBJECTIVE

To evaluate the validity, in terms of the patients' acceptance, preference, feasibility and reliability of an innovative, interactive computerized system for collection of patient-reported outcome (PRO) data on axial SpA against the paper-and-pencil version.

METHODS

Fifty-five patients with axial SpA completed both the touch screen and the paper-and-pencil set of questionnaires. A computerized touch-screen system, SPEAMonitor, was developed to capture PRO data. Variables recorded included demographic data, patient's assessment of general health status, BASDAI, BASFI, BASMI and acute-phase reactant levels. In order to assess the patient's acceptance of, preference for and feasibility of computer-based questionnaires, the participants filled in an additional questionnaire. The time taken to complete both formats was measured. In a further test-retest study, 25 patients were re-evaluated.

RESULTS

The agreement between the paper-administered and computer touch-screen format of the BASFI, BASDAI questionnaires and the Ankylosing Spondylitis Disease Activity Scores was excellent. Intraclass correlation coefficients (ICCs) between data ranged from 0.90 to 0.96. Additionally the test-retest study showed a very good agreement between the scores for the two administrations (ICC ≥ 0.90). Age, computer experience and education level had no significant impact on the results. The computerized questionnaires were reported to be easier to use. The mean time spent completing the questionnaires on a touch screen was 5.1 min and on paper 7.9 min.

CONCLUSION

Our newly developed computer-assisted touch-screen questionnaires for PRO in axial SpA were well accepted by patients, with good data quality, reliability and score agreement.

Usability characteristics of self-administered computer-assisted interviewing in the emergency department: factors affecting ease of use, efficiency, and entry error

OBJECTIVE

Self-administered computer-assisted interviewing (SACAI) gathers accurate information from patients and could facilitate Emergency Department (ED) diagnosis. As part of an ongoing research effort whose long-range goal is to develop automated medical interviewing for diagnostic decision support, we explored usability attributes of SACAI in the ED.

METHODS

Cross-sectional study at two urban, academic EDs. Convenience sample recruited daily over six weeks. Adult, non-level I trauma patients were eligible. We collected data on ease of use (self-reported difficulty, researcher documented need for help), efficiency (mean time-per-click on a standardized interview segment), and error (self-report age mismatched with age derived from electronic health records) when using SACAI on three different instruments: Elo TouchSystems ESY15A2 (finger touch), Toshiba M200 (with digitizer pen), and Motion C5 (with digitizer pen). We calculated descriptive statistics and used regression analysis to evaluate the impact of patient and computer factors on time-per-click.

RESULTS

841 participants completed all SACAI questions. Few (<1%) thought using the touch computer to ascertain medical information was difficult. Most (86%) required no assistance. Participants needing help were older (54 ± 19 vs. 40 ± 15 years, p<0.001) and more often lacked internet at home (13.4% vs. 7.3%, p = 0.004). On multivariate analysis, female sex (p<0.001), White (p<0.001) and other (p = 0.05) race (vs. Black race), younger age (p<0.001), internet access at home (p<0.001), high school graduation (p = 0.04), and touch screen entry (vs. digitizer pen) (p = 0.01) were independent predictors of decreased time-per-click. Participant misclick errors were infrequent, but, in our sample, occurred only during interviews using a digitizer pen rather than a finger touch-screen interface (1.9% vs. 0%, p = 0.09).

DISCUSSION

Our results support the facility of interactions between ED patients and SACAI. Demographic factors associated with need for assistance or slower interviews could serve as important triggers to offering human support for SACAI interviews during implementation.

CONCLUSION

Understanding human-computer interactions in real-world clinical settings is essential to implementing automated interviewing as means to a larger long-term goal of enhancing clinical care, diagnostic accuracy, and patient safety.

Understanding women's experiences of electronic interviewing during the clinical episode in urogynaecology: a qualitative study

INTRODUCTION AND HYPOTHESIS

Questionnaires for assessing health and related quality of life are increasingly advocated but little is known about women's views on them. The aim of the study was to understand women's experiences of using an electronic personal assessment questionnaire for pelvic floor disorders (ePAQ-PF) during the clinical episode.

METHODS

A qualitative study was performed in a tertiary referral centre for urogynaecology. Women who completed the electronic questionnaire (ePAQ-PF) before and after intervention for pelvic floor disorders were recruited. Semi-structured interviews were conducted in 20 women and the transcripts were analysed using a thematic approach to identify themes and categories. The main outcome measures were: (1) women's feelings about their experience of using the questionnaire and the impact it had on their clinical episode, (2) exploration of ways in which the questionnaire influenced communication, (3) influence of the questionnaire on anxiety and expectations relating to clinical care and (4) women's feelings about how the use of the questionnaire has affected their health and well-being.

RESULTS

Qualitative analysis identified eight themes relating to the burden and the benefit of questionnaire use with 'benefit' being the dominant theme. Women felt that the questionnaire improved their understanding of their condition, improved communication with clinicians and helped prepare them for clinical consultations, generally finding it relevant, easy and enjoyable to complete. Some women commented on the burden of questionnaire use and expressed concerns about its length and that it's closed multiple choice format was restrictive.

CONCLUSIONS

The identified principal themes of enhanced communication and preparedness for clinical consultation provided by the questionnaire appeared to support improved focus and insight, which in turn contributed to the setting of realistic expectations.

Audio-Enhanced Tablet Computers to Assess Children's Food Frequency From Migrant Farmworker Mothers

This study sought to improve data collection in children's food frequency surveys for non-English speaking immigrant/migrant farmworker mothers using audio-enhanced tablet computers (ATCs). We hypothesized that by using technological adaptations, we would be able to improve data capture and therefore reduce lost surveys. This Food Frequency Questionnaire (FFQ), a paper-based dietary assessment tool, was adapted for ATCs and assessed consumption of 66 food items asking 3 questions for each food item: frequency, quantity of consumption, and serving size. The tablet-based survey was audio enhanced with each question "read" to participants, accompanied by food item images, together with an embedded short instructional video. Results indicated that respondents were able to complete the 198 questions from the 66 food item FFQ on ATCs in approximately 23 minutes. Compared with paper-based FFQs, ATC-based FFQs had less missing data. Despite overall reductions in missing data by use of ATCs, respondents still appeared to have difficulty with question 2 of the FFQ. Ability to score the FFQ was dependent on what sections missing data were located. Unlike the paper-based FFQs, no ATC-based FFQs were unscored due to amount or location of missing data. An ATC-based FFQ was feasible and increased ability to score this survey on children's food patterns from migrant farmworker mothers. This adapted technology may serve as an exemplar for other non-English speaking immigrant populations.

Development of a 5 year life expectancy index in older adults using predictive mining of electronic health record data

OBJECTIVE

Incorporating accurate life expectancy predictions into clinical decision making could improve quality and decrease costs, but few providers do this. We sought to use predictive data mining and high dimensional analytics of electronic health record (EHR) data to develop a highly accurate and clinically actionable 5 year life expectancy index.

MATERIALS AND METHODS

We developed the index using EHR data for 7463 patients ≥50 years old with ≥1 visit(s) in 2003 to a large, academic, multispecialty group practice. We extracted 980 attributes from the EHRs of the practices and affiliated hospitals. Correlation feature selection with greedy stepwise search was used to find the attribute subset with best average merit. Rotation forest ensembling with alternating decision tree as underlying classifier was used to predict 5 year mortality. Model performance was compared with the modified Charlson Comorbidity Index and the Walter life expectancy method.

RESULTS

Within 5 years of the last visit in 2003, 838 (11%) patients had died. The final model included 24 attributes: two demographic (age, sex), 10 comorbidity (eg, cardiovascular disease), one vital sign (mean diastolic blood pressure), two medications (loop diuretic use, digoxin use), six laboratory (eg, mean albumin), and three healthcare utilization (eg, the number of hospitalizations 1 year prior to the last visit in 2003). The index showed very good discrimination (c-statistic 0.86) and outperformed comparators.

CONCLUSIONS

The EHR based index successfully distinguished adults ≥50 years old with life expectancy >5 years from those with life expectancy ≤5 years. This information could be used clinically to optimize preventive service use (eg, cancer screening in the elderly).

Development of an electronic research permissions management system to enhance informed consents and capture research authorizations data

Informed consents are a critical and essential component of the clinical research process. Currently, most consents and research privacy authorizations are being captured on paper. In this paper we describe a novel method of capturing this information electronically. The objective is to allow easier tracking of research participants' intent for current and future research involvement, enhance consent comprehension and facilitate the research workflow. After multidisciplinary analysis in key hospital registration areas and research participant enrollment, an open source software product was designed to capture this data through a user-friendly touch screen interface. The data may then be fed into a clinical data warehouse for use in cohort discovery or consent tracking. Despite ethical, legal and informatics challenges in clinical and research environments, we propose that this technology opens new avenues for significantly enhancing the consent process and positively impacting recruitment.

Using tablet computers compared to interactive voice response to improve subject recruitment in osteoporosis pragmatic clinical trials: feasibility, satisfaction, and sample size

INTRODUCTION

Pragmatic clinical trials (PCTs) provide large sample sizes and enhanced generalizability to assess therapeutic effectiveness, but efficient patient enrollment procedures are a challenge, especially for community physicians. Advances in technology may improve methods of patient recruitment and screening in PCTs. Our study looked at a tablet computer versus an integrated voice response system (IVRS) for patient recruitment and screening for an osteoporosis PCT in community physician offices.

MATERIALS AND METHODS

We recruited women ≥ 65 years of age from community physician offices to answer screening questions for a hypothetical osteoporosis active comparator PCT using a tablet computer or IVRS. We assessed the feasibility of these technologies for patient recruitment as well as for patient, physician, and office staff satisfaction with the process. We also evaluated the implications of these novel recruitment processes in determining the number of primary care practices and screened patients needed to conduct the proposed trial.

RESULTS

A total of 160 women (80% of those approached) agreed to complete the osteoporosis screening questions in ten family physicians' offices. Women using the tablet computer were able to complete all screening questions consistently and showed a nonsignificant trend towards greater ease of use and willingness to spend more time in their physician's office compared to those using IVRS. Using the proportion of women found to be eligible in this study (almost 20%) and other eligibility scenarios, we determined that between 240 and 670 community physician offices would be needed to recruit ample patients for our hypothetical study.

CONCLUSION

We found good satisfaction and feasibility with a tablet computer interface for the recruitment and screening of patients for a hypothetical osteoporosis PCT in community office settings. In addition, we used this experience to estimate the number of research sites needed for such a study.