Assessing the Usability and Feasibility of Digital Assistant Tools for Direct Support Professionals: Participatory Design and Pilot-Testing

BACKGROUND

The United States is experiencing a direct support professional (DSP) crisis, with demand far exceeding supply. Although generating documentation is a critical responsibility, it is one of the most wearisome aspects of DSPs' jobs. Technology that enables DSPs to log informal time-stamped notes throughout their shift could help reduce the burden of end-of-shift documentation and increase job satisfaction, which in turn could improve the quality of life of the individuals with intellectual and developmental disabilities (IDDs) whom DSPs support. However, DSPs, with varied ages, levels of education, and comfort using technology, are not likely to adopt tools that detract from caregiving responsibilities or increase workload; therefore, technological tools for them must be relatively simple, extremely intuitive, and provide highly valued capabilities.

OBJECTIVE

This paper describes the development and pilot-testing of a digital assistant tool (DAT) that enables DSPs to create informal notes throughout their shifts and use these notes to facilitate end-of-shift documentation. The purpose of the pilot study was to assess the usability and feasibility of the DAT.

METHODS

The research team applied an established user-centered participatory design process to design, develop, and test the DAT prototypes between May 2020 and April 2023. Pilot-testing entailed having 14 DSPs who support adults with IDDs use the first full implementation of the DAT prototypes during 2 or 3 successive work shifts and fill out demographic and usability questionnaires.

RESULTS

Participants used the DAT prototypes to create notes and help generate end-of-shift reports. The System Usability Scale score of 81.79 indicates that they found the prototypes easy to use. Survey responses imply that using the DAT made it easier for participants to produce required documentation and suggest that they would adopt the DAT if this tool were available for daily use.

CONCLUSIONS

Simple technologies such as the DAT prototypes, which enable DSPs to use mobile devices to log time-stamped notes throughout their shift with minimal effort and use the notes to help write reports, have the potential to both reduce the burden associated with producing documentation and enhance the quality (level of detail and accuracy) of this documentation. This could help to increase job satisfaction and reduce turnover in DSPs, both of which would help improve the quality of life of the individuals with IDDs whom they support. The pilot test results indicate that DSPs found the DAT easy to use. Next steps include (1) producing more robust versions of the DAT with additional capabilities, such as storing data locally on mobile devices when Wi-Fi is not available; and (2) eliciting input from agency directors, families, and others who use data about adults with IDDs to help care for them to ensure that data produced by DSPs are relevant and useful.

Mental Distress, Label Avoidance, and Use of a Mental Health Chatbot: Results From a US Survey

BACKGROUND

For almost two decades, researchers and clinicians have argued that certain aspects of mental health treatment can be removed from clinicians' responsibilities and allocated to technology, preserving valuable clinician time and alleviating the burden on the behavioral health care system. The service delivery tasks that could arguably be allocated to technology without negatively impacting patient outcomes include screening, triage, and referral.

OBJECTIVE

We pilot-tested a chatbot for mental health screening and referral to understand the relationship between potential users' demographics and chatbot use; the completion rate of mental health screening when delivered by a chatbot; and the acceptability of a prototype chatbot designed for mental health screening and referral. This chatbot not only screened participants for psychological distress but also referred them to appropriate resources that matched their level of distress and preferences. The goal of this study was to determine whether a mental health screening and referral chatbot would be feasible and acceptable to users.

METHODS

We conducted an internet-based survey among a sample of US-based adults. Our survey collected demographic data along with a battery of measures assessing behavioral health and symptoms, stigma (label avoidance and perceived stigma), attitudes toward treatment-seeking, readiness for change, and technology readiness and acceptance. Participants were then offered to engage with our chatbot. Those who engaged with the chatbot completed a mental health screening, received a distress score based on this screening, were referred to resources appropriate for their current level of distress, and were asked to rate the acceptability of the chatbot.

RESULTS

We found that mental health screening using a chatbot was feasible, with 168 (75.7%) of our 222 participants completing mental health screening within the chatbot sessions. Various demographic characteristics were associated with a willingness to use the chatbot. The participants who used the chatbot found it to be acceptable. Logistic regression produced a significant model with perceived usefulness and symptoms as significant positive predictors of chatbot use for the overall sample, and label avoidance as the only significant predictor of chatbot use for those currently experiencing distress.

CONCLUSIONS

Label avoidance, the desire to avoid mental health services to avoid the stigmatized label of mental illness, is a significant negative predictor of care seeking. Therefore, our finding regarding label avoidance and chatbot use has significant public health implications in terms of facilitating access to mental health resources. Those who are high on label avoidance are not likely to seek care in a community mental health clinic, yet they are likely willing to engage with a mental health chatbot, participate in mental health screening, and receive mental health resources within the chatbot session. Chatbot technology may prove to be a way to engage those in care who have previously avoided treatment due to stigma.

A Practical Guide to Pilot Testing Community-Based Vaccination Coverage Surveys

Pilot testing is crucial when preparing any community-based vaccination coverage survey. In this paper, we use the term pilot test to mean informative work conducted before a survey protocol has been finalized for the purpose of guiding decisions about how the work will be conducted. We summarize findings from seven pilot tests and provide practical guidance for piloting similar studies. We selected these particular pilots because they are excellent models of preliminary efforts that informed the refinement of data collection protocols and instruments. We recommend survey coordinators devote time and budget to identify aspects of the protocol where testing could mitigate project risk and ensure timely assessment yields, credible estimates of vaccination coverage and related indicators. We list specific items that may benefit from pilot work and provide guidance on how to prioritize what to pilot test when resources are limited.

Development of a Preventive Health Screening Procedure Enabling Supportive Service Planning for Home-Dwelling Older Adults (PORI75): Protocol for an Action Research Study

BACKGROUND

In Finland, at least 1 in 4 residents will be >75 years of age in 2030. The national aging policy has emphasized the need to improve supportive services to enable older people to live in their own homes for as long as possible.

OBJECTIVE

This study aimed to develop a preventive health screening procedure for home-dwelling older adults aged 75 years to enable the use of clinical patient data for purposes of strategic planning of supportive services in primary care.

METHODS

The action research method was applied to develop the health screening procedure with selected validated health measures in cooperation with the local practicing interprofessional health care teams from 10 primary care centers in the Social Security Center of Pori, Western Finland (99,485 residents, n=11,938, 12% of them >75 years). The selection of evidence-based validated health measures was based on the national guide to screen factors increasing fall risk and the national functioning measures database. The cut-off points of the selected health measures and laboratory tests were determined in consecutive consensus meetings with the local primary care physicians, with decisions based on internationally validated measures, national current care guidelines, and local policies in clinical practice.

RESULTS

The health screening procedure for 75-year-old residents comprised 30 measures divided into three categories: (1) validated self-assessments (9 measures), (2) nurse-conducted screenings (14 measures), and (3) laboratory tests (7 measures). The procedure development process comprised the following steps: (1) inventory and selection of the validated health measures and laboratory tests, (2) training of practical nurses to perform screenings for the segment of 75-year-old residents and to guide them to possible further medical actions, (3) creation of research data from clinical patient data for secondary use purposes, (4) secondary data analysis, and (5) consensus meeting after the pilot test of the health screening procedure for 75-year-old residents procedure in 2019 based on the experiences of health care professionals and collected research data.

CONCLUSIONS

The developed preventive health screening procedure for 75-year-old residents enables the use of clinical patient data for purposes of strategic planning of supportive services in primary care if the potential bias by a low participation rate is controlled.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/48753.

Pilot testing of the International Council of Cardiovascular Prevention and Rehabilitation Registry

The International Council of Cardiovascular Prevention and Rehabilitation developed an International Cardiac Rehabilitation (CR) Registry (ICRR) to support CR programs in low-resource settings to optimize care provision and patient outcomes. This study assessed implementation of the ICRR, site data steward experience with on-boarding and data entry, and patient acceptability. Multimethod observational pilot involves (I) analysis of ICRR data from three centers (Iran, Pakistan, and Qatar) from inception to May 2022, (II) focus group with on-boarded site data stewards (also from Mexico and India), and (III) semistructured interviews with participating patients. Five hundred sixty-seven patients were entered. Based on volumes at each program, 85.6% of patients were entered in ICRR. 99.3% patients approached consented to participate. The average time to enter data at pre- and follow-up assessments by source was 6.8-12.6 min. Of 22 variables preprogram, completion was 89.5%. Among patients with any follow-up data, of four program-reported variables, completion was 99.0% in program completers and 51.5% in none; of 10 patient-reported variables, completion was 97.0% in program completers and 84.8% in none. The proportion of patients with any follow-up data was 84.8% in program completers, with 43.6% of noncompleters having any data entered other than completion status. Twelve data stewards participated in the focus group. Main themes were valuable on-boarding process, data entry, process of engaging patients, and benefits of participation. Thirteen patients were interviewed. Themes were good understanding of the registry, positive experience providing data, and value of lay summary and eagerness for annual assessment. Feasibility and data quality of ICRR were demonstrated.

The Preschool Eating, Lifestyle, and Sleeping Attitudes Scale (PRELSA Scale): Construction and Pilot Testing of a Tool to Measure Factors Associated with Childhood Obesity

(1) Background: Childhood obesity poses a global health challenge. In the period from two to six years, the fundamental risk factors are associated with modifiable habits, related to parental attitudes. In this study, we will analyze the construction and pilot test of the PRELSA Scale, designed to be a comprehensive tool that covers the whole problem of childhood obesity, from which we can later develop a brief instrument. (2) Methods: First, we described the scale construction process. After that, we conducted a pilot test on parents to check the instrument's comprehensibility, acceptability, and feasibility. We detected items to be modified or eliminated through two criteria: the frequencies of the categories of each item and responses in the Not Understood/Confused category. Finally, we sought expert opinion through a questionnaire to ensure the content validity of the scale. (3) Results: The pilot test on parents detected 20 possible items for modification and other changes in the instrument. The experts' questionnaire showed good values on the scale's content, highlighting some feasibility problems. The final version of the scale went from 69 items to 60. (4) Conclusions: Developing scales that detect parental attitudes associated with the onset of childhood obesity may be the basis for future interventions to address this health challenge.

Evidence of the content validity, acceptability, and feasibility of a new Patient-Reported Impact of Dermatological Diseases measure

Background

The Global Research on the Impact of Dermatological Diseases (GRIDD) team is developing the new Patient-Reported Impact of Dermatological Diseases (PRIDD) measure of the impact of dermatological conditions on the patient's life, in partnership with patients. To develop PRIDD, we conducted a systematic review, followed by a qualitative interview study with 68 patients worldwide and subsequently a global Delphi survey of 1,154 patients to ensure PRIDD items were meaningful and important to patients.

Objective

To pilot test PRIDD with patients with dermatological conditions, focusing on its content validity (comprehensiveness, comprehensibility, and relevance), acceptability, and feasibility.

Methods

We conducted a theory-led qualitative study using the Three-Step Test-Interview method of cognitive interviewing. Three rounds of semi-structured interviews were conducted online. Adults (≥ 18 years) living with a dermatological condition and who spoke English sufficiently to take part in the interview were recruited through the International Alliance of Dermatology Patient Organizations' (GlobalSkin) global membership network. The topic guide met the gold-standard COSMIN (Consensus-based Standards for the Selection of Health Measurement Instruments) standards for cognitive interviewing. Analysis followed the thematic analytical model of cognitive interviewing.

Results

Twelve people (58% male) representing six dermatological conditions from four countries participated. Overall, patients found PRIDD to be comprehensible, comprehensive, relevant, acceptable, and feasible. Participants were able to discern the conceptual framework domains from the items. Feedback resulted in: the recall period being extended from 1 week to 1 month; removal of the 'not relevant' response option; and changes to the instructions and item ordering and wording to improve clarity and increase respondents' confidence in their ability to respond. These evidence-based adjustments resulted in a 26-item version of PRIDD.

Conclusion

This study met the gold-standard COSMIN criteria for the pilot testing of health measurement instruments. The data triangulated our previous findings, in particular the conceptual framework of impact. Our findings illuminate how patients understand and respond to PRIDD and other patient-reported measurement instruments. The results of comprehensibility, comprehensiveness, relevance, acceptability, and feasibility of PRIDD provide evidence of content validity from the target population. The next step in the development and validation of PRIDD is psychometric testing.

A Proof-of-Concept Evaluation of the 1616 Story-Based Positive Youth Development Program

The 1616 Program is a newly developed and evidence-informed story-based positive youth development (PYD) program for young ice hockey players (10-12 years of age) in North America. The program uses elite ice hockey players as role models-through story-telling-to serve as inspirational figures to engage youth athletes and important social agents (i.e., parents, coaches) with evidence-informed PYD concepts. The objective of this study was to use a Proof-of-Concept evaluation to assess whether the 1616 Program 'worked' in enhancing PYD outcomes and to determine if the concepts were engaging and enjoyable for youth, their parents, and coaches. The 5 week Proof-of-Concept evaluation was conducted with 11 ice hockey teams (n = 160 youths, 93 parents, and 11 coaches), encompassing both qualitative (e.g., focus groups) and quantitative (e.g., retrospective pretest-posttest questionnaires) processes and outcome assessments. Results showed that the program was well received by participants and positively impacted the intended outcomes. Overall, the data presented in this Proof-of-Concept evaluation was deemed to support the development and implementation of the full-scale 1616 Program for a more comprehensive evaluation.

Adding Mobile Elements to Online Physical Activity Interventions for Adults Aged Over 50 Years: Prototype Development Study

BACKGROUND

Only a minority of adults aged over 50 years meet physical activity (PA) guidelines of the World Health Organization (WHO). eHealth interventions are proven effective tools to help this population increase its PA levels in the short term, among which the Active Plus and I Move interventions have been developed by our own research group. To achieve long-term effects, increase intervention use, and decrease dropout rates, 3 emergent but different mobile elements (an activity tracker, an ecological momentary intervention [EMI] program, and a chatbot) were added separately to Active Plus and I Move. In this study, the prototype development and pilot-testing of these interventions is described.

OBJECTIVE

This study aims to enhance 2 existing PA-stimulating computer-based interventions with 3 mobile elements (an activity tracker, an EMI program, or a chatbot) and test the prototypes on usability and appreciation within a target population of adults aged over 50 years.

METHODS

A systematic design protocol consisting of development, evaluation, and adaptation procedures was followed with involvement of the target population. Literature searches separated per mobile element and interviews with the target population (N=11) led to 6 prototypes: Active Plus or I Move including (1) an activity tracker, (2) EMI, or (3) a chatbot. These prototypes were tested on usability and appreciation during pilot tests (N=47) and subsequently fine-tuned based on the results.

RESULTS

The literature searches and interviews provided important recommendations on the preferences of the target population, which enabled us to develop prototypes. The subsequent pilot tests showed that the mobile elements scored moderate to good on usability, with average System Usability Scale (SUS) scores of 52.2-82.2, and moderate to good on enjoyment and satisfaction, with average scores ranging from 5.1 to 8.1 on a scale of 1-10. The activity tracker received the best scores, followed by EMI, followed by the chatbot. Based on the findings, the activity tracker interventions were fine-tuned and technical difficulties regarding EMI and the chatbot were solved, which is expected to further improve usability and appreciation.

CONCLUSIONS

During this study, 6 prototypes of online PA interventions with added mobile elements were developed and tested for usability and appreciation. Although all prototypes scored moderate to high on usability, enjoyment, and satisfaction, it can be concluded that the integration of an activity tracker with a computer-based PA intervention is the most promising option among the 3 mobile elements tested during this study. The prototype development steps of the systematic design protocol followed can be considered useful and successful for the purposes of this study. The interventions can now be evaluated on a larger scale through a randomized controlled trial.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/31677.

Using PrEP and Doing it for Ourselves (UPDOs Protective Styles), a Web-Based Salon Intervention to Improve Uptake of Pre-exposure Prophylaxis Among Black Women: Protocol for a Pilot Feasibility Study

Background

Multilevel interventions are necessary to address the complex social contributors to health that limit pre-exposure prophylaxis use among Black women, including medical distrust, pre-exposure prophylaxis stigma, and access to equitable health care. Strategies to improve knowledge, awareness, and uptake of pre-exposure prophylaxis among Black women will be more successful if information-sharing and implementation take place within trusted environments. Providing women with information through trusted cultural and social channels can effectively support informed decision-making about pre-exposure prophylaxis for themselves and members of their social networks who are eligible for pre-exposure prophylaxis.

Objective

The goal of this project is to improve knowledge, awareness, uptake, and trust of pre-exposure prophylaxis, as well as reduce pre-exposure prophylaxis stigma, among Black women living in the US South.

Methods

This multilevel, mixed methods study uses a community-engagement approach to develop and pilot test a salon-based intervention. There are three components of this intervention: (1) stylist training, (2) women-focused entertainment videos and modules, and (3) engagement of a pre-exposure prophylaxis navigator. First, stylist training will be provided through two 2-hour training sessions delivered over 2 consecutive weeks. We will use a pre- and posttest design to examine knowledge and awareness improvement of pre-exposure prophylaxis among the stylists. Upon full completion of training, the stylists will receive a certificate of completion and “Ask Me about PrEP” signage for their beauty salons. Second, together with the community, we have codeveloped a 4-part entertainment series (The Wright Place) that uses culturally and socially relevant stories to highlight key messages about (1) HIV, (2) pre-exposure prophylaxis, and (3) Black women’s social contributors to health. Quantitative and qualitative measures will be used in a pre- and posttest design to examine pre-exposure prophylaxis knowledge, awareness, risk, stigma, trust, intentions, and women’s perceptions of the usability and acceptability of the overall intervention and its implementation strategies. A video blog will be provided after each video. Third, participants will have access through an email or text message link to a pre-exposure prophylaxis navigator, who will respond to them privately to answer questions or make referrals for pre-exposure prophylaxis as requested.

Results

This project was funded in October 2020 by Gilead Sciences and was approved by the Duke University School of Nursing institutional review board in April 2021 (Pro00106307). Intervention components were developed in partnership with community partners in the first year. Data collection for phase 1 began in April 2022. Data collection for phase 2 began in May 2022. The study will be complete by October 2022.

Conclusions

Multilevel interventions that consider the assets of the community have promise for promoting health among Black women who have influence within their social networks. The findings of this study have the potential to be generalizable to other populations.

International Registered Report Identifier (IRRID)

PRR1-10.2196/34556

A Smoking Cessation Mobile App for Persons Living With HIV: Preliminary Efficacy and Feasibility Study

BACKGROUND

The prevalence of smoking in the United States general population has gradually declined to the lowest rate ever recorded; however, this has not been true for persons with HIV.

OBJECTIVE

We conducted a pilot test to assess the feasibility and efficacy of the Lumme Quit Smoking mobile app and smartwatch combination with sensing capabilities to improve smoking cessation in persons with HIV.

METHODS

A total of 40 participants were enrolled in the study and randomly assigned 1:1 to the control arm, which received an 8-week supply of nicotine replacement therapy, a 30-minute smoking cessation counseling session, and weekly check-in calls with study staff, or to the intervention arm, which additionally received the Lumme Quit Smoking app and smartwatch.

RESULTS

Of the 40 participants enrolled, 37 completed the follow-up study assessments and 16 used the app every day during the 56-day period. During the 6-month recruitment and enrollment period, 122 people were screened for eligibility, with 67.2% (82/122) deemed ineligible. Smoking criteria and incompatible tech were the major reasons for ineligibility. There was no difference in the proportion of 7-day point prevalence abstinence by study arm and no significant decrease in exhaled carbon monoxide for the intervention and control arms separately. However, the average exhaled carbon monoxide decreased over time when analyzing both arms together (P=.02).

CONCLUSIONS

Results suggest excellent feasibility and acceptability of using a smoking sensor app among this smoking population. The knowledge gained from this research will enable the scientific community, clinicians, and community stakeholders to improve tobacco cessation outcomes for persons with HIV.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04808609; https://clinicaltrials.gov/ct2/show/NCT04808609.

Developing a clinical presentation dental education model and a pilot test

INTRODUCTION

Accurate clinical decision-making of dentists should be based on their knowledge and experience. In the past 10 years, interest in competency-based dentistry education has rapidly increased, but there has been little attention paid to methods of improving dental education competency. The purpose of this study was to develop a clinical presentation education model that provides opportunities for students to practice problem-solving from the moment they greet the patient so that students can obtain the practical experience of competency-based education and the effectiveness of this model can be confirmed through pilot test.

METHODS

This article is divided two parts: First, developing the clinical presentation dental education model (CPDEM) and Second, a pilot study adopted CPDEM. To confirm the effectiveness of this model, the students' satisfaction, their perception of self-achievement were analysed.

RESULTS

Clinical presentation dental education model has been developed to provide practice-related education experience and provide linkage between basic science and clinical science. The result of applying this education model to 10 students as a pilot test was shown an overall high satisfaction level. In addition, self-achievement students' reported of all intended competencies was higher than for non-participating students of this model.

CONCLUSIONS

This study focuses on practical education centring on clinical presentation. This model could get a meaningful and realistic experiences through the practice using clinical presentation of patients, use their metacognition for organizing and memorizing the patient's case by using concept map. It can be used as a future instructional method to enhance students' competency.

Face and Content Validity, Acceptability, and Feasibility of the Adapted Version of the Children's Palliative Outcome Scale: A Qualitative Pilot Study

Objective: To assess the face and content validity, acceptability and feasibility of a French version of the Children's Palliative Outcome Scale (CPOS). Background: Instruments in French used to measure outcomes in pediatric palliative care are lacking. Methods: After forward-backward translation of the 12-item English CPOS to French, we conducted a qualitative pilot study. During semi structured interviews among children and parents, we used the CPOS, the Schedule for the Evaluation of Individual Quality of Life interview guide (SEIQoL) and the Quality of Life in Life-threatening Illness-Family Carer questionnaire (QOLLTI-F), in addition to three expert meetings with PLTs. Results: Fourteen children and adolescents (8-18 years) with life-limiting or life-threatening conditions cared for at home, in hospital or in respite care services, 19 parents, and 9 members of 4 pediatric liaison teams (PLTs) providing palliative care in a Belgian francophone region were included in the study. No families refused to participate. All children with verbal capacities chose to be interviewed in the presence of their parents and a PLT member. The children valued being given the opportunity to share their experiences. New QOL dimensions pertaining to social, emotional, and administrative health-care related issues were added to the original version of the 12-item CPOS, leading to a 22-item CPOS-2. Discussion: The CPOS-2 was perceived as relevant and easy to use by the principal stakeholders. Our study paves the way for a large-scale field study assessing its psychometric characteristics and its implementation in routine clinical care.

[Pilot Study on Start-up and Stable Operation at Low Temperature Based on Denitrifying Phosphorus Removal]

In order to understand the denitrifying and phosphorus removal characteristics of denitrifying phosphate-accumulating organisms (DPAOs), a pilot scale (20 m³) denitrifying and phosphorus removal experiment was carried out using a modified University of Cape Town (UCT) process at low temperatures of (6-16)℃. The test results show that at such temperatures, the hydraulic retention time (HRT) is 20 h and the solids retention time (SRT) is 35 days, and the modified UCT process can start up successfully and run steadily. When running steadily, the system can maintain nitrogen and phosphorus removal rates of 60%±5% and 80%±5%, respectively. The effluent concentrations of chemical oxygen demand (COD), ammonium nitrogen (NH₄⁺-N), total nitrogen (TN), and total phosphorus (TP) were 20, 5, 11, and 0.5 mg·L^-1, respectively, which meet the first A emission standard of "Pollutant Discharge Standard for Urban Sewage Treatment Plant" (GB 18918-2002). In order to further investigate the characteristics of nitrogen and phosphorus removal in the system, the reflux ratio from the aerobic tank to the anoxic tank was increased to 150%. After the system was stabilized, it obtained higher nitrogen and phosphorus removal rates of 80%±10% and 90%±5%, respectively. Among them, denitrifying phosphorus removal in the anoxic tank accounted for 80%±4% of the total biological phosphorus removal. The average effluent concentrations of COD, NH₄⁺-N, TN, and TP were 19.55, 0.1, 7.8, and 0.15 mg·L^-1, respectively, which meet the Beijing Standard A discharge standard.

A pilot study on the Spanish version of the Psychosocial Adjustment to Illness Scale (PAIS-SR) with carers of people with Parkinson's disease

AIM

To report the cross-cultural adaptation and pilot study of the ongoing validation of the Spanish version of the Psychosocial Adjustment to Illness Scale with carers of people with Parkinson's disease.

DESIGN

Cross-cultural adaptation and pilot study with a cross-sectional validation design of the Spanish version of the Psychosocial Adjustment to Illness Scale - Carers.

METHODS

Twenty-one carers of people with Parkinson's disease from a Primary Care practice in Spain were recruited and completed the PAIS-Carers, the SF-36 Health Survey, the Brief COPE Inventory and an assessment form. SPSS 23.0 was used to determine viability/acceptability and preliminary aspects of internal consistency of the instrument.

RESULTS

Five of the seven domains presented floor effect (71.42%), and only one presented ceiling effect (14.28%). The internal consistency of the scale and domains showed acceptable values (over 0.7). The content validity of the Spanish version seemed satisfactory with positive comments in general from participants.

A Smartphone Game to Prevent HIV Among Young Africans: Protocol for a Randomized Pilot Study of a Mobile Intervention

Background

Young people aged under 25 years make up an increasing proportion of the population in emerging economies such as Kenya, where half of new adult HIV infections are among 15- to 24-year olds. Interventions targeting this age group have the potential to avert HIV infections among an increasingly large at-risk population. Interactive communication technologies offer a promising platform for reaching young people in engaging ways.

Objective

Tumaini is a narrative-based smartphone game designed to help young Africans protect themselves from HIV. The objective of this study was to pilot test the game, focusing on the data needed to inform a future randomized controlled efficacy trial, including assessments of study feasibility and safety.

Methods

The study took place in Kisumu Town, western Kenya, in spring 2017. The game-based intervention was pilot tested for 16 days with a sample of 60 preadolescents aged 11 to 14 years. Participant recruitment was initiated through schools. Participants were randomly assigned to the control or intervention arms of the study. One parent for each of the intervention arm participants was also recruited (n=30). The intervention arm participants were provided with smartphones on which Tumaini was loaded so that they could play the game at home. Youth completed behavioral surveys at baseline, posttest, and 6-week follow-up. The intervention arm participants provided quantitative feedback on their experience of the game-based intervention at posttest. They and their parents further participated in postintervention focus group discussions. Feasibility-related study metrics were collected on recruitment, enrollment, attrition, safety of participants, and return of phones.

Results

Recruitment and enrollment of the 60 preadolescents and parents were successfully completed within 18 days. No participants were lost to follow-up: all youth completed all 3 waves of the survey and 27 intervention arm youth and 22 parents and caregivers participated in the focus groups. No safety concerns were reported. All phones were returned after the intervention period; none were damaged or lost. All intervention arm participants initiated gameplay, recording a mean exposure time just under 27 hours.

Conclusions

Findings indicate that it is feasible and safe to test a smartphone-based HIV prevention intervention for very young adolescents in urban and peri-urban sub-Saharan Africa by initiating recruitment in schools and temporarily providing youth participants with smartphones on which the game is loaded. A randomized controlled trial powered to assess the efficacy of the game-based intervention is being designed to be carried out in the same geographic area as the pilot, using similar methods.

Trial Registration

ClinicalTrials.gov NCT03054051; https://clinicaltrials.gov/ct2/show/NCT03054051 (Archived by WebCite at http://www.webcitation.org/6wjwpX8Bg.)

International Registered Report Identifier (IRRID)

DERR1-10.2196/11209

Virtual environments in cancer care: Pilot-testing a three-dimensional web-based platform as a tool for support in young cancer patients

Bringing virtual environments into cancer support may offer a particular potential to engage patients and increase adherence to treatment. Developing and pilot-testing an online real-time multi-user three-dimensional platform, this study tested the use of an early prototype of the platform among adolescent and young adult cancer patients. Data were collected with an online questionnaire and using ethnographic methods of participant observation. The adolescent and young adult patients tested basic features of the virtual environment and some conducted brief in-world interactions with fellow patients during hospitalization. They had no reservations about using the technology and shared their ideas about its use. Our pilot test pointed to a number of areas of development for virtual environment applications as potential platforms for medical or behavioral interventions in cancer care. Overall, the results demonstrate the need for high user involvement in the development of such interventions and early testing of intervention designs.

Promoting development and uptake of health innovations: The Nose to Tail Tool

Introduction

Health sector management is increasingly complex as new health technologies, treatments, and innovative service delivery strategies are developed. Many of these innovations are implemented prematurely, or fail to be implemented at scale, resulting in substantial wasted resources.  

Methods

A scoping review was conducted to identify articles that described the scale up process conceptually or that described an instance in which a healthcare innovation was scaled up. We define scale up as the expansion and extension of delivery or access to an innovation for all end users in a jurisdiction who will benefit from it.

Results

Sixty nine articles were eligible for review. Frequently described stages in the innovation process and contextual issues that influence progress through each stage were mapped. 16 stages were identified: 12 deliberation and 4 action stages. Included papers suggest that innovations progress through stages of maturity and the uptake of innovation depends on the innovation aligning with the interests of 3 critical stakeholder groups (innovators, end users and the decision makers) and is also influenced by 3 broader contexts (social and physical environment, the health system, and the regulatory, political and economic environment). The 16 stages form the rows of the Nose to Tail Tool (NTT) grid and the 6 contingency factors form columns. The resulting stage-by-issue grid consists of 72 cells, each populated with cell-specific questions, prompts and considerations from the reviewed literature.

Conclusion

We offer a tool that helps stakeholders identify the stage of maturity of their innovation, helps facilitate deliberative discussions on the key considerations for each major stakeholder group and the major contextual barriers that the innovation faces. We believe the NTT will help to identify potential problems that the innovation will face and facilitates early modification, before large investments are made in a potentially flawed solution.

Development and pilot testing of a multiple mini-interview for admission to a pharmacy degree program

OBJECTIVES

To develop and pilot test a multiple mini-interview (MMI) to select students for admission to a pharmacy degree program.

METHODS

A nominal group process was used to identify 8 important nonacademic attributes of pharmacists, with relative importance determined by means of a paired-comparison survey of pharmacy stakeholders (ie, university-affiliated individuals with a vested interest in the quality of student admitted to the pharmacy program, such as faculty members, students, admissions staff members, and practitioners). A 10-station MMI based on the weighted-attribute blueprint was pilot tested with 30 incoming pharmacy students. MMI score reliability (intraclass correlation coefficient [ICC]) and correlation with other admissions tool scores were determined.

RESULTS

Station scores provided by student interviewers were slightly higher than those of faculty member or practitioner interviewers. While most interviewers judged a 6-minute interview as "just right" and an 8-minute interview "a bit long," candidates had the opposite opinion. Station scenarios had face validity for candidates and interviewers. The ICC for the MMI was 0.77 and correlations with prepharmacy average (PPA) and Pharmacy College Admission Test (PCAT) composite were negligible.

CONCLUSIONS

MMI feasibility was confirmed, based on the finding that interview scores were reliable and that this admissions tool measures different attributes than do the PCAT and PPA.

Adding the female condom to HIV prevention interventions for women with severe mental illness: a pilot test

We evaluated the efficacy of a gender-specific intervention to reduce sexual risk behaviors by introducing female-initiated methods to urban women with severe mental illness. Seventy-nine women received 10 sessions of an HIV prevention intervention or a control intervention. The primary outcome was unprotected oral, anal, or vaginal intercourse, expressed using the Vaginal Episode Equivalent (VEE) score. Knowledge and use of the female condom were also assessed. Women in the HIV prevention intervention showed a three-fold reduction in the VEE score at the 3-month follow-up compared to the control group, but the difference was not significant. These women were significantly more likely to know about female condoms, have inserted one and used it with a sexual partner at the 3-month follow-up and to have inserted it at 6 months compared to controls. The female condom may be a useful addition, for a subset of women with SMI, to comprehensive HIV prevention programs.

[Pilot testing of an internet based pregnancy planning study "Snart-gravid.dk"]

Before launching a new study pilot testing is often recommended, however, it is seldom described in depth. Here, we report extensively on a pilot study using the internet as a new method for recruitment and data collection in a prospective cohort study of women planning a pregnancy.We aimed to enroll 2500 participants in six months and attained more than 75 % after 12 months follow up. To test data completeness and validity we randomized participants to fill either a long or a short version of the baseline questionnaire and compared self reported data with registry based data.We succeeded in enrolling 2288 participants, and participation rate was 82 % after 12 months. We found high correlations (0.96) for self-reported vs. registry based data and no difference in participation rate or data completeness according to questionnaire length. Overall, the internet based methods seem promising and we plan to launch the full study.