Artificial Intelligence Chatbot Behavior Change Model for Designing Artificial Intelligence Chatbots to Promote Physical Activity and a Healthy Diet: Viewpoint

Evaluation of artificial intelligence (AI) chatbots for providing sexual health information: a consensus study using real-world clinical queries

INTRODUCTION

Artificial Intelligence (AI) chatbots could potentially provide information on sensitive topics, including sexual health, to the public. However, their performance compared to nurses and across different AI chatbots, particularly in the field of sexual health, remains understudied. This study evaluated the performance of three AI chatbots - two prompt-tuned (Alice and Azure) and one standard chatbot (ChatGPT by OpenAI) - in providing sexual health information on questions that experienced sexual health nurses could correctly answer.

METHODS

We analysed 195 anonymised sexual health questions received by the Melbourne Sexual Health Centre phone line. A panel of experts in a blinded order using a consensus-based approach evaluated responses to these questions from nurses and the three AI chatbots. Performance was assessed based on overall correctness and five specific measures: guidance, accuracy, safety, ease of access, and provision of necessary information. We conducted subgroup analyses for clinic-specific (e.g., opening hours) and general sexual health questions and a sensitivity analysis excluding questions that Azure could not answer.

RESULTS

Alice demonstrated the highest overall correctness (85.2%; 95% confidence interval (CI), 82.1-88.0%), followed by Azure (69.3%; 95% CI, 65.3-73.0%) and ChatGPT (64.8%; 95% CI, 60.7-68.7%). Prompt-tuned chatbots outperformed the base ChatGPT across all measures. Among all outcome measures, all chatbots performed best on safety, with Azure achieving the highest safety score (97.9%; 95% CI, 96.4-98.9%), indicating the lowest risk of providing potentially harmful advice. In subgroup analysis, all chatbots performed better on general sexual health questions compared to clinic-specific queries. Sensitivity analysis showed a narrower performance gap between Alice and Azure when excluding questions Azure could not answer.

CONCLUSIONS

Prompt-tuned AI chatbots demonstrated superior performance in providing sexual health information compared to base ChatGPT, with high safety scores particularly noteworthy. However, all AI chatbots showed susceptibility to generating incorrect information. These findings suggest the potential for AI chatbots as adjuncts to human healthcare providers for providing sexual health information while highlighting the need for continued refinement and human oversight. Future research should focus on larger-scale evaluations and real-world implementations.

Artificial intelligence-powered social robots for promoting physical activity in older adults: A systematic review

BACKGROUND

The aging global population necessitates innovative strategies to enhance older adults' health and quality of life. Physical activity (PA) is crucial for healthy aging, yet many older adults struggle to exercise regularly. Artificial intelligence (AI)-powered social robots offer an interactive, engaging, and personalized solution to promote PA among this demographic. This systematic review investigates the role of AI-powered social robots in encouraging PA in older adults.

METHODS

We conducted a systematic literature search in databases including PubMed, IEEE Xplore, Scopus, Cochrane Library, and Web of Science, focusing on studies published until February 2024. We included peer-reviewed articles reporting empirical findings on designing, implementing, and evaluating AI-enabled social robots to promote PA among older adults. Studies were conducted in nursing homes, rehabilitation centers, community centers, and home environments.

RESULTS

A total of 19 studies were included in the review. Analysis reveals that AI-powered social robots effectively motivate older adults to engage in PAs, leading to increased exercise adherence, higher engagement levels, and extended training durations. Social robots have demonstrated effectiveness across various environments, including nursing homes, rehabilitation centers, community centers, home environments, and elder care facilities. In structured environments like nursing homes and rehabilitation centers, robots help maintain regular exercise routines, improving adherence and recovery outcomes. In community and elder care centers, robots promote PA and social engagement by facilitating group exercises and enhancing participation. In home environments, robots provide personalized support for daily activities, offering reminders and engagement, which fosters long-term activity engagement. User acceptance and satisfaction are high, with participants finding the robots engaging and enjoyable. Additionally, several studies indicate potential health benefits, such as improved medication adherence, better sleep patterns, and enhanced overall well-being. Nevertheless, additional research is imperative to address unresolved issues concerning the technological maintenance costs, design constraints, and adaptability of AI-powered social robots to specific user demographics.

CONCLUSION

AI-powered social robots play a promising role in promoting PA among older adults, enhancing their health, well-being, and independence. This review provides insights for researchers, designers, and healthcare professionals developing AI-enabled social robotic systems for older adults.

MARIA (Medical Assistance and Rehabilitation Intelligent Agent) for Medication Adherence in Patients With Heart Failure: Empirical Results From a Wizard of Oz Systematic Conversational Agent Design Clinical Protocol

BACKGROUND

Nonadherence to medication is a key factor contributing to high heart failure (HF) rehospitalization rates. A conversational agent (CA) or chatbot is a technology that can enhance medication adherence by helping patients self-manage their medication routines at home.

OBJECTIVE

This study outlines the conception of a design method for developing a CA to support patients in medication adherence, utilizing design thinking as the primary process for gathering requirements, prototyping, and testing. We apply this design method to the ongoing development of Medical Assistance and Rehabilitation Intelligent Agent (MARIA), a rule-based CA.

METHODS

Following the design thinking process, at the ideation stage, we engaged a multidisciplinary group of stakeholders (patients and pharmacists) to elicit requirements for the early conception of MARIA. In collaboration with pharmacists, we structured MARIA's dialogue into a workflow based on Adlerian therapy, a psychoeducational theory. At the testing stage, we conducted an observational study using the Wizard of Oz (WoZ) research method to simulate the MARIA prototype with 20 patient participants. This approach validated and refined our application of Adlerian therapy in the CA's dialogue. We incorporated human-likeness and trust scoring into user satisfaction assessments after each WoZ session to evaluate MARIA's feasibility and acceptance of medication adherence. Dialogue data collected through WoZ simulations were analyzed using a coding analysis technique.

RESULTS

Our design method for the CA revealed gaps in MARIA's conception, including (1) handling negative responses, (2) appropriate use of emoticons to enhance human-likeness, (3) system feedback mechanisms during turn-taking delays, and (4) defining the extent to which a CA can communicate on behalf of a health care provider regarding medication adherence.

CONCLUSIONS

The design thinking process provided interactive steps to involve users early in the development of a CA. Notably, the use of WoZ in an observational clinical protocol highlighted the following: (1) coding analysis offered guidelines for modeling CA dialogue with patient safety in mind; (2) incorporating human-likeness and trust in user satisfaction assessments provided insights into attributes that foster patient trust in a CA; and (3) the application of Adlerian therapy demonstrated its effectiveness in motivating patients with HF to adhere to medication within a CA framework. In conclusion, our method is valuable for modeling and validating CA interactions with patients, assessing system reliability, user expectations, and constraints. It can guide designers in leveraging existing CA technologies, such as ChatGPT or AWS Lex, for adaptation in health care settings.

Impact of Oral Health Chatbot With and Without Toothbrushing Training on Childhood Caries

OBJECTIVES

Standalone oral health chatbots targeting young children's oral health are rare. The aim of this research was to compare the effectiveness of a standalone chatbot and a combination chatbot with in-person toothbrushing training for caregivers in improving young children's oral health.

METHODS

A randomised, parallel, 2-group pretest-posttest design was employed with 320 caregiver-child pairs (aged 6-42 months). Group I (160 pairs) used the 21-Day FunDee (modified) chatbot along with in-person toothbrushing training, whilst Group II (160 pairs) used only the 21-Day FunDee Plus chatbot. Oral examination assessed plaque levels and caries, whilst a self-administered questionnaire evaluated oral hygiene care, dietary practices, and oral health perceptions based on the protection motivation theory (PMT). Data were analysed using 2-way repeated-measures analysis of variance, a t test, and chi-square measures for group comparisons.

RESULTS

The majority of caregivers were Muslim mothers. No significant differences were observed between groups at the baseline, 3-month, and 6-month follow-ups in mean dmft (Group I: 4.16, 4.64, and 5.30 vs Group II: 4.30, 5.54, and 5.82), mean plaque scores (Group I: 0.72, 0.53, and 0.55 vs Group II (0.84, 0.52, and 0.59), and most dietary habits. However, significant improvements were found within groups from baseline to follow-ups in plaque reduction, toothbrushing practices, overall knowledge score, PMT perceptions, proper tooth brushing, fluoride toothpaste usage, and dietary behaviours (frequency of bottle feeding, frequency of nocturnal bottle feeding, proportion of children who went to bed without consuming anything after cleaning their teeth before bedtime). The significant differences between groups were found in self-efficacy at all time points, but only at the 6-month evaluation for percentage of fluoride toothpaste and overall PMT perceptions.

CONCLUSIONS

Both interventions were comparable in preventing caries, reducing plaque, improving feeding practices, increasing parental involvement in tooth brushing, and enhancing knowledge. The standalone chatbot 21-Day FunDee Plus presents a viable alternative for promoting oral health in young children.

A Joint LLM-KG System for Disease Q&A

Medical question answer (QA) assistants respond to lay users' health-related queries by synthesizing information from multiple sources using natural language processing and related techniques. They can serve as vital tools to alleviate issues of misinformation, information overload, and complexity of medical language, thus addressing lay users' information needs while reducing the burden on healthcare professionals. QA systems, the engines of such assistants, have often used large language models (LLMs) or knowledge graphs (KG), though the approaches could be complementary. LLM-based QA systems excel at understanding complex questions and providing well-formed answers but are prone to factual mistakes. KG-based QA systems, which represent facts well, are mostly limited to answering short-answer questions with pre-created templates. While a few studies have used both LLM and KG for text-based QA, the approaches are still prone to incomplete or inaccurate answers. Extant QA systems also have limitations in terms of automation and performance. We address these challenges by designing a novel, automated disease QA system named Disease Guru-Long-Form Question Answer (DG-LFQA), which effectively utilizes both LLM and KG techniques through a joint reasoning approach to answer disease-related questions appropriate for lay users. Our evaluation of the system using a range of quality metrics demonstrates its efficacy over related baseline systems.

Development of Chatbot-Based Oral Health Care for Young Children and Evaluation of its Effectiveness, Usability, and Acceptability: Mixed Methods Study

Background

Chatbots are increasingly accepted in public health for their ability to replicate human-like communication and provide scalable, 24/7 services. The high prevalence of dental caries in children underscores the need for early and effective intervention.

Objective

This study aimed to develop the 30-Day FunDee chatbot and evaluate its effectiveness, usability, and acceptability in delivering oral health education to caregivers of children aged 6 to 36 months.

Methods

The chatbot was created using the artificial intelligence (AI) chatbot behavior change model, integrating behavioral change theories into content designed for 3-5 minutes of daily use over 30 days. A pre-post experimental study was conducted from December 2021 to February 2022 in Hat Yai District, Songkhla Province, and Maelan District, Pattani Province, Thailand. Fifty-eight caregivers completed a web-based structured questionnaire at baseline and 2 months post baseline to evaluate knowledge, protection motivation theory-based perceptions, and tooth-brushing practices. Usability was assessed via chatbot logfiles and a web-based questionnaire at 2 months post baseline. Acceptability was evaluated through three methods: (1) open-ended chatbot interactions on day 30, (2) a web-based structured questionnaire at 2 months post baseline, and (3) semistructured telephone interviews with 15 participants 2 weeks post intervention. Participants for interviews were stratified by adherence levels and randomly selected from Hatyai and Maelan districts. All self-reported variables were measured on a 5-point Likert scale (1=lowest, 5=highest).

Results

The chatbot was successfully developed based on the 4 components of the AI chatbot behavior change model. Participants had a mean age of 34.5 (SD 8.6) years. The frequency of tooth brushing among caregivers significantly improved, increasing from 72.4% at baseline to 93.1% two months post baseline (P=.006). Protection motivation theory-based perceptions also showed significant improvement, with mean scores rising from 4.0 (SD 0.6) at baseline to 4.5 (SD 0.6) two months post baseline (P<.001). The chatbot received high ratings for satisfaction (4.7/5, SD 0.6) and usability (4.7/5, SD 0.5). Participants engaged with the chatbot for an average of 24.7 (SD 7.2) days out of 30. Caregivers praised the chatbot's content quality, empathetic communication, and multimedia design, but noted the intervention's lengthy duration and messaging system as limitations.

Conclusions

The 30-Day FunDee chatbot effectively enhanced caregivers' perceptions of oral health care and improved tooth-brushing practices for children aged 6-36 months. High user satisfaction and engagement demonstrate its potential as an innovative tool for oral health education. These findings warrant further validation through large-scale, randomized controlled trials.

Rapid, Tailored Dietary and Health Education Through A Social Media Chatbot Microintervention: Development and Usability Study With Practical Recommendations

BACKGROUND

There is an urgent need to innovate methods of health education, which can often be resource- and time-intensive. Microinterventions have shown promise as a platform for rapid, tailored resource dissemination yet have been underexplored as a method of standardized health or dietary education; social media chatbots display unique potential as a modality for accessible, efficient, and affordable educational microinterventions.

OBJECTIVE

This study aims to provide public health professionals with practical recommendations on the use of social media chatbots for health education by (1) documenting the development of a novel social media chatbot intervention aimed at improving dietary attitudes and self-efficacy among South Asian American young adults and (2) describing the applied experiences of implementing the chatbot, along with user experience and engagement data.

METHODS

In 2023, the "Roti" chatbot was developed on Facebook and Instagram to administer a 4-lesson tailored dietary health curriculum, informed by formative research and the Theory of Planned Behavior, to 18- to 29-year-old South Asian American participants (recruited through social media from across the United States). Each lesson (10-15 minutes) consisted of 40-50 prescripted interactive texts with the chatbot (including multiple-choice and open-response questions). A preintervention survey determined which lesson(s) were suggested to participants based on their unique needs, followed by a postintervention survey informed by the Theory of Planned Behavior to assess changes in attitudes, self-efficacy, and user experiences (User Experience Questionnaire). This study uses a cross-sectional design to examine postintervention user experiences, engagement, challenges encountered, and solutions developed during the chatbot implementation.

RESULTS

Data from 168 participants of the intervention (n=92, 54.8% Facebook; n=76, 45.2% Instagram) were analyzed (mean age 24.5, SD 3.1 years; n=129, 76.8% female). Participants completed an average of 2.6 lessons (13.9 minutes per lesson) and answered an average of 75% of questions asked by the chatbot. Most reported a positive chatbot experience (User Experience Questionnaire: 1.34; 81/116, 69.8% positive), with pragmatic quality (ease of use) being higher than hedonic quality (how interesting it felt; 88/116, 75.9% vs 64/116, 55.2% positive evaluation); younger participants reported greater hedonic quality (P=.04). On a scale out of 10 (highest agreement), participants reported that the chatbot was relevant (8.53), that they learned something new (8.24), and that the chatbot was helpful (8.28). Qualitative data revealed an appreciation for the cheerful, interactive messaging of the chatbot and outlined areas of improvement for the length, timing, and scope of text content. Quick replies, checkpoints, online forums, and self-administered troubleshooting were some solutions developed to meet the challenges experienced.

CONCLUSIONS

The implementation of a standardized, tailored health education curriculum through an interactive social media chatbot displayed strong feasibility. Lessons learned from challenges encountered and user input provide a tangible roadmap for future exploration of such chatbots for accessible, engaging health interventions.

Innovative Approaches to Addressing Pediatric Mental Health: Digital Technologies in Pediatric Primary Care

Digital technologies can be used at multiple levels to support the mental health care of children including (1) health system/health care provider level; (2) patient-provider interface; (3) patient-facing consumer applications; and (4) new technology, including artificial intelligence. At each of these levels, these novel technologies may lead to care improvements but also may have risks. This review provides an overview of each of innovations across the digital landscape.

Effects of Chatbot Components to Facilitate Mental Health Services Use in Individuals With Eating Disorders Following Online Screening: An Optimization Randomized Controlled Trial

OBJECTIVE

Few individuals with eating disorders (EDs) receive treatment. Innovations are needed to identify individuals with EDs and address care barriers. We developed a chatbot for promoting services uptake that could be paired with online screening. However, it is not yet known which components drive effects. This study estimated individual and combined contributions of four chatbot components on mental health services use (primary), chatbot helpfulness, and attitudes toward changing eating/shape/weight concerns ("change attitudes," with higher scores indicating greater importance/readiness).

METHODS

Two hundred five individuals screening with an ED but not in treatment were randomized in an optimization randomized controlled trial to receive up to four chatbot components: psychoeducation, motivational interviewing, personalized service recommendations, and repeated administration (follow-up check-ins/reminders). Assessments were at baseline and 2, 6, and 14 weeks.

RESULTS

Participants who received repeated administration were more likely to report mental health services use, with no significant effects of other components on services use. Repeated administration slowed the decline in change attitudes participants experienced over time. Participants who received motivational interviewing found the chatbot more helpful, but this component was also associated with larger declines in change attitudes. Participants who received personalized recommendations found the chatbot more helpful, and receiving this component on its own was associated with the most favorable change attitude time trend. Psychoeducation showed no effects.

DISCUSSION

Results indicated important effects of components on outcomes; findings will be used to finalize decision making about the optimized intervention package. The chatbot shows high potential for addressing the treatment gap for EDs.

eHealth Communication Intervention to Promote Human Papillomavirus Vaccination Among Middle-School Girls: Development and Usability Study

BACKGROUND

As the age of initiating sexual intercourse has gradually decreased among South Korean adolescents, earlier vaccination of adolescents for human papillomavirus (HPV) is necessary before their exposure to HPV. Health communication includes "cues to action" that lead to preventive health behaviors, and recently, social networking services, which operate with fewer time and space constraints, have been used in various studies as a form of eHealth communication.

OBJECTIVE

This study aims to investigate the feasibility and usability of an eHealth communication intervention for HPV vaccination in middle-school girls aimed at the girls and their mothers.

METHODS

The eHealth communication intervention for HPV vaccination was developed using a 6-step intervention mapping process: needs assessments, setting program outcomes, selection of a theory-based method and practical strategies, development of the intervention, implementation plan, and testing the validity of the intervention.

RESULTS

A review of 10 studies identified effective health communication messages, delivery methods, and theories for HPV vaccination among adolescents. Barriers including low knowledge, perceived threat, and the inconvenience of taking 2 doses of the vaccine were identified through focus groups, suggesting a need for youth-friendly and easy-to-understand information for adolescents delivered via mobile phones. The expected outcomes and the performance objectives are specifically tailored to reflect the vaccination intention. Behavior change techniques were applied using trusted sources and a health belief model. Health messages delivered through a KakaoTalk chatbot improved awareness and self-efficacy. Quality control was ensured with the use of a log system. The experts' chatbot usability average score was 80.13 (SD 8.15) and the average score of girls was 84.06 (SD 7.61).

CONCLUSIONS

Future studies need to verify the effectiveness of health communication strategies in promoting HPV vaccination and the effectiveness of scientific intervention using a chatbot as a delivery method for the intervention.

Present and Future Applications of Artificial Intelligence in Kidney Transplantation

Artificial intelligence (AI) has a wide and increasing range of applications across various sectors. In medicine, AI has already made an impact in numerous fields, rapidly transforming healthcare delivery through its growing applications in diagnosis, treatment and overall patient care. Equally, AI is swiftly and essentially transforming the landscape of kidney transplantation (KT), offering innovative solutions for longstanding problems that have eluded resolution through traditional approaches outside its spectrum. The purpose of this review is to explore the present and future applications of artificial intelligence in KT, with a focus on pre-transplant evaluation, surgical assistance, outcomes and post-transplant care. We discuss its great potential and the inevitable limitations that accompany these technologies. We conclude that by fostering collaboration between AI technologies and medical practitioners, we can pave the way for a future where advanced, personalised care becomes the standard in KT and beyond.

Clinician voices on ethics of LLM integration in healthcare: a thematic analysis of ethical concerns and implications

OBJECTIVES

This study aimed to explain and categorize key ethical concerns about integrating large language models (LLMs) in healthcare, drawing particularly from the perspectives of clinicians in online discussions.

MATERIALS AND METHODS

We analyzed 3049 posts and comments extracted from a self-identified clinician subreddit using unsupervised machine learning via Latent Dirichlet Allocation and a structured qualitative analysis methodology.

RESULTS

Analysis uncovered 14 salient themes of ethical implications, which we further consolidated into 4 overarching domains reflecting ethical issues around various clinical applications of LLM in healthcare, LLM coding, algorithm, and data governance, LLM's role in health equity and the distribution of public health services, and the relationship between users (human) and LLM systems (machine).

DISCUSSION

Mapping themes to ethical frameworks in literature illustrated multifaceted issues covering transparent LLM decisions, fairness, privacy, access disparities, user experiences, and reliability.

CONCLUSION

This study emphasizes the need for ongoing ethical review from stakeholders to ensure responsible innovation and advocates for tailored governance to enhance LLM use in healthcare, aiming to improve clinical outcomes ethically and effectively.

Chatbot for the Return of Positive Genetic Screening Results for Hereditary Cancer Syndromes: a Prompt Engineering Study

Background

The growing demand for genomic testing and limited access to experts necessitate innovative service models. While chatbots have shown promise in supporting genomic services like pre-test counseling, their use in returning positive genetic results, especially using the more recent large language models (LLMs) remains unexplored.

Objective

This study reports the prompt engineering process and intrinsic evaluation of the LLM component of a chatbot designed to support returning positive population-wide genomic screening results.

Methods

We used a three-step prompt engineering process, including Retrieval-Augmented Generation (RAG) and few-shot techniques to develop an open-response chatbot. This was then evaluated using two hypothetical scenarios, with experts rating its performance using a 5-point Likert scale across eight criteria: tone, clarity, program accuracy, domain accuracy, robustness, efficiency, boundaries, and usability.

Results

The chatbot achieved an overall score of 3.88 out of 5 across all criteria and scenarios. The highest ratings were in Tone (4.25), Usability (4.25), and Boundary management (4.0), followed by Efficiency (3.88), Clarity and Robustness (3.81), and Domain Accuracy (3.63). The lowest-rated criterion was Program Accuracy, which scored 3.25.

Discussion

The LLM handled open-ended queries and maintained boundaries, while the lower Program Accuracy rating indicates areas for improvement. Future work will focus on refining prompts, expanding evaluations, and exploring optimal hybrid chatbot designs that integrate LLM components with rule-based chatbot components to enhance genomic service delivery.

Approaches for the Use of AI in Workplace Health Promotion and Prevention: Systematic Scoping Review

BACKGROUND

Artificial intelligence (AI) is an umbrella term for various algorithms and rapidly emerging technologies with huge potential for workplace health promotion and prevention (WHPP). WHPP interventions aim to improve people's health and well-being through behavioral and organizational measures or by minimizing the burden of workplace-related diseases and associated risk factors. While AI has been the focus of research in other health-related fields, such as public health or biomedicine, the transition of AI into WHPP research has yet to be systematically investigated.

OBJECTIVE

The systematic scoping review aims to comprehensively assess an overview of the current use of AI in WHPP. The results will be then used to point to future research directions. The following research questions were derived: (1) What are the study characteristics of studies on AI algorithms and technologies in the context of WHPP? (2) What specific WHPP fields (prevention, behavioral, and organizational approaches) were addressed by the AI algorithms and technologies? (3) What kind of interventions lead to which outcomes?

METHODS

A systematic scoping literature review (PRISMA-ScR [Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews]) was conducted in the 3 academic databases PubMed, Institute of Electrical and Electronics Engineers, and Association for Computing Machinery in July 2023, searching for papers published between January 2000 and December 2023. Studies needed to be (1) peer-reviewed, (2) written in English, and (3) focused on any AI-based algorithm or technology that (4) were conducted in the context of WHPP or (5) an associated field. Information on study design, AI algorithms and technologies, WHPP fields, and the patient or population, intervention, comparison, and outcomes framework were extracted blindly with Rayyan and summarized.

RESULTS

A total of 10 studies were included. Risk prevention and modeling were the most identified WHPP fields (n=6), followed by behavioral health promotion (n=4) and organizational health promotion (n=1). Further, 4 studies focused on mental health. Most AI algorithms were machine learning-based, and 3 studies used combined deep learning algorithms. AI algorithms and technologies were primarily implemented in smartphone apps (eg, in the form of a chatbot) or used the smartphone as a data source (eg, Global Positioning System). Behavioral approaches ranged from 8 to 12 weeks and were compared to control groups. Additionally, 3 studies evaluated the robustness and accuracy of an AI model or framework.

CONCLUSIONS

Although AI has caught increasing attention in health-related research, the review reveals that AI in WHPP is marginally investigated. Our results indicate that AI is promising for individualization and risk prediction in WHPP, but current research does not cover the scope of WHPP. Beyond that, future research will profit from an extended range of research in all fields of WHPP, longitudinal data, and reporting guidelines.

TRIAL REGISTRATION

OSF Registries osf.io/bfswp; https://osf.io/bfswp.

Ameliorating Racial Disparities in HIV Prevention via a Nurse-Led, AI-Enhanced Program for Pre-Exposure Prophylaxis Utilization Among Black Cisgender Women: Protocol for a Mixed Methods Study

BACKGROUND

HIV pre-exposure prophylaxis (PrEP) is a critical biomedical strategy to prevent HIV transmission among cisgender women. Despite its proven effectiveness, Black cisgender women remain significantly underrepresented throughout the PrEP care continuum, facing barriers such as limited access to care, medical mistrust, and intersectional racial or HIV stigma. Addressing these disparities is vital to improving HIV prevention outcomes within this community. On the other hand, nurse practitioners (NPs) play a pivotal role in PrEP utilization but are underrepresented due to a lack of awareness, a lack of human resources, and insufficient support. Equipped with the rapid evolution of artificial intelligence (AI) and advanced large language models, chatbots effectively facilitate health care communication and linkage to care in various domains, including HIV prevention and PrEP care.

OBJECTIVE

Our study harnesses NPs' holistic care capabilities and the power of AI through natural language processing algorithms, providing targeted, patient-centered facilitation for PrEP care. Our overarching goal is to create a nurse-led, stakeholder-inclusive, and AI-powered program to facilitate PrEP utilization among Black cisgender women, ultimately enhancing HIV prevention efforts in this vulnerable group in 3 phases. This project aims to mitigate health disparities and advance innovative, technology-based solutions.

METHODS

The study uses a mixed methods design involving semistructured interviews with key stakeholders, including 50 PrEP-eligible Black women, 10 NPs, and a community advisory board representing various socioeconomic backgrounds. The AI-powered chatbot is developed using HumanX technology and SmartBot360's Health Insurance Portability and Accountability Act-compliant framework to ensure data privacy and security. The study spans 18 months and consists of 3 phases: exploration, development, and evaluation.

RESULTS

As of May 2024, the institutional review board protocol for phase 1 has been approved. We plan to start recruitment for Black cisgender women and NPs in September 2024, with the aim to collect information to understand their preferences regarding chatbot development. While institutional review board approval for phases 2 and 3 is still in progress, we have made significant strides in networking for participant recruitment. We plan to conduct data collection soon, and further updates on the recruitment and data collection progress will be provided as the study advances.

CONCLUSIONS

The AI-powered chatbot offers a novel approach to improving PrEP care utilization among Black cisgender women, with opportunities to reduce barriers to care and facilitate a stigma-free environment. However, challenges remain regarding health equity and the digital divide, emphasizing the need for culturally competent design and robust data privacy protocols. The implications of this study extend beyond PrEP care, presenting a scalable model that can address broader health disparities.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/59975.

Effectiveness and User Experience of a Smoking Cessation Chatbot: Mixed Methods Study Comparing Motivational Interviewing and Confrontational Counseling

BACKGROUND

Cigarette smoking poses a major public health risk. Chatbots may serve as an accessible and useful tool to promote cessation due to their high accessibility and potential in facilitating long-term personalized interactions. To increase effectiveness and acceptability, there remains a need to identify and evaluate counseling strategies for these chatbots, an aspect that has not been comprehensively addressed in previous research.

OBJECTIVE

This study aims to identify effective counseling strategies for such chatbots to support smoking cessation. In addition, we sought to gain insights into smokers' expectations of and experiences with the chatbot.

METHODS

This mixed methods study incorporated a web-based experiment and semistructured interviews. Smokers (N=229) interacted with either a motivational interviewing (MI)-style (n=112, 48.9%) or a confrontational counseling-style (n=117, 51.1%) chatbot. Both cessation-related (ie, intention to quit and self-efficacy) and user experience-related outcomes (ie, engagement, therapeutic alliance, perceived empathy, and interaction satisfaction) were assessed. Semistructured interviews were conducted with 16 participants, 8 (50%) from each condition, and data were analyzed using thematic analysis.

RESULTS

Results from a multivariate ANOVA showed that participants had a significantly higher overall rating for the MI (vs confrontational counseling) chatbot. Follow-up discriminant analysis revealed that the better perception of the MI chatbot was mostly explained by the user experience-related outcomes, with cessation-related outcomes playing a lesser role. Exploratory analyses indicated that smokers in both conditions reported increased intention to quit and self-efficacy after the chatbot interaction. Interview findings illustrated several constructs (eg, affective attitude and engagement) explaining people's previous expectations and timely and retrospective experience with the chatbot.

CONCLUSIONS

The results confirmed that chatbots are a promising tool in motivating smoking cessation and the use of MI can improve user experience. We did not find extra support for MI to motivate cessation and have discussed possible reasons. Smokers expressed both relational and instrumental needs in the quitting process. Implications for future research and practice are discussed.

[Mobile health in primary care. New challenges in the development of solutions to promote physical activity and well-being]

The use of smart devices such as mobile phones (smartphones) or smart watches (smartwatch) to promote physical activity and well-being has increased in recent years among patients and professionals in primary care. This change is driven by the access of patients and professionals to a large catalog of health applications, which can complement the provision of services and promote the empowerment of patients in their own health and lifestyles. These applications are beginning to be integrated with areas such as Artificial Intelligence (AI), the Internet of Medical Things (IoMT) and data storage in the cloud, among other emerging technological systems, offering a new complementary approach to clinical practice known so far. Despite the great potential, there are numerous limitations and major challenges for its full implementation in clinical practice.

Bibliometric top ten healthcare-related ChatGPT publications in the first ChatGPT anniversary

Since its public release on November 30, 2022, ChatGPT has shown promising potential in diverse healthcare applications despite ethical challenges, privacy issues, and possible biases. The aim of this study was to identify and assess the most influential publications in the field of ChatGPT utility in healthcare using bibliometric analysis. The study employed an advanced search on three databases, Scopus, Web of Science, and Google Scholar, to identify ChatGPT-related records in healthcare education, research, and practice between November 27 and 30, 2023. The ranking was based on the retrieved citation count in each database. The additional alternative metrics that were evaluated included (1) Semantic Scholar highly influential citations, (2) PlumX captures, (3) PlumX mentions, (4) PlumX social media and (5) Altmetric Attention Scores (AASs). A total of 22 unique records published in 17 different scientific journals from 14 different publishers were identified in the three databases. Only two publications were in the top 10 list across the three databases. Variable publication types were identified, with the most common being editorial/commentary publications (n=8/22, 36.4%). Nine of the 22 records had corresponding authors affiliated with institutions in the United States (40.9%). The range of citation count varied per database, with the highest range identified in Google Scholar (1019-121), followed by Scopus (242-88), and Web of Science (171-23). Google Scholar citations were correlated significantly with the following metrics: Semantic Scholar highly influential citations (Spearman's correlation coefficient ρ=0.840, p<0.001), PlumX captures (ρ=0.831, p<0.001), PlumX mentions (ρ=0.609, p=0.004), and AASs (ρ=0.542, p=0.009). In conclusion, despite several acknowledged limitations, this study showed the evolving landscape of ChatGPT utility in healthcare. There is an urgent need for collaborative initiatives by all stakeholders involved to establish guidelines for ethical, transparent, and responsible use of ChatGPT in healthcare. The study revealed the correlation between citations and alternative metrics, highlighting its usefulness as a supplement to gauge the impact of publications, even in a rapidly growing research field.

Chatbot for Social Need Screening and Resource Sharing With Vulnerable Families: Iterative Design and Evaluation Study

BACKGROUND

Health outcomes are significantly influenced by unmet social needs. Although screening for social needs has become common in health care settings, there is often poor linkage to resources after needs are identified. The structural barriers (eg, staffing, time, and space) to helping address social needs could be overcome by a technology-based solution.

OBJECTIVE

This study aims to present the design and evaluation of a chatbot, DAPHNE (Dialog-Based Assistant Platform for Healthcare and Needs Ecosystem), which screens for social needs and links patients and families to resources.

METHODS

This research used a three-stage study approach: (1) an end-user survey to understand unmet needs and perception toward chatbots, (2) iterative design with interdisciplinary stakeholder groups, and (3) a feasibility and usability assessment. In study 1, a web-based survey was conducted with low-income US resident households (n=201). Following that, in study 2, web-based sessions were held with an interdisciplinary group of stakeholders (n=10) using thematic and content analysis to inform the chatbot's design and development. Finally, in study 3, the assessment on feasibility and usability was completed via a mix of a web-based survey and focus group interviews following scenario-based usability testing with community health workers (family advocates; n=4) and social workers (n=9). We reported descriptive statistics and chi-square test results for the household survey. Content analysis and thematic analysis were used to analyze qualitative data. Usability score was descriptively reported.

RESULTS

Among the survey participants, employed and younger individuals reported a higher likelihood of using a chatbot to address social needs, in contrast to the oldest age group. Regarding designing the chatbot, the stakeholders emphasized the importance of provider-technology collaboration, inclusive conversational design, and user education. The participants found that the chatbot's capabilities met expectations and that the chatbot was easy to use (System Usability Scale score=72/100). However, there were common concerns about the accuracy of suggested resources, electronic health record integration, and trust with a chatbot.

CONCLUSIONS

Chatbots can provide personalized feedback for families to identify and meet social needs. Our study highlights the importance of user-centered iterative design and development of chatbots for social needs. Future research should examine the efficacy, cost-effectiveness, and scalability of chatbot interventions to address social needs.

ChatGPT/GPT-4 (large language models): Opportunities and challenges of perspective in bariatric healthcare professionals

ChatGPT/GPT-4 is a conversational large language model (LLM) based on artificial intelligence (AI). The potential application of LLM as a virtual assistant for bariatric healthcare professionals in education and practice may be promising if relevant and valid issues are actively examined and addressed. In general medical terms, it is possible that AI models like ChatGPT/GPT-4 will be deeply integrated into medical scenarios, improving medical efficiency and quality, and allowing doctors more time to communicate with patients and implement personalized health management. Chatbots based on AI have great potential in bariatric healthcare and may play an important role in predicting and intervening in weight loss and obesity-related complications. However, given its potential limitations, we should carefully consider the medical, legal, ethical, data security, privacy, and liability issues arising from medical errors caused by ChatGPT/GPT-4. This concern also extends to ChatGPT/GPT -4's ability to justify wrong decisions, and there is an urgent need for appropriate guidelines and regulations to ensure the safe and responsible use of ChatGPT/GPT-4.

Possible benefits, challenges, pitfalls, and future perspective of using ChatGPT in pathology

The much-hyped artificial intelligence (AI) model called ChatGPT developed by Open AI can have great benefits for physicians, especially pathologists, by saving time so that they can use their time for more significant work. Generative AI is a special class of AI model, which uses patterns and structures learned from existing data and can create new data. Utilizing ChatGPT in Pathology offers a multitude of benefits, encompassing the summarization of patient records and its promising prospects in Digital Pathology, as well as its valuable contributions to education and research in this field. However, certain roadblocks need to be dealt like integrating ChatGPT with image analysis which will act as a revolution in the field of pathology by increasing diagnostic accuracy and precision. The challenges with the use of ChatGPT encompass biases from its training data, the need for ample input data, potential risks related to bias and transparency, and the potential adverse outcomes arising from inaccurate content generation. Generation of meaningful insights from the textual information which will be efficient in processing different types of image data, such as medical images, and pathology slides. Due consideration should be given to ethical and legal issues including bias.

Infusing behavior science into large language models for activity coaching

Large language models (LLMs) have shown promise for task-oriented dialogue across a range of domains. The use of LLMs in health and fitness coaching is under-explored. Behavior science frameworks such as COM-B, which conceptualizes behavior change in terms of capability (C), Opportunity (O) and Motivation (M), can be used to architect coaching interventions in a way that promotes sustained change. Here we aim to incorporate behavior science principles into an LLM using two knowledge infusion techniques: coach message priming (where exemplar coach responses are provided as context to the LLM), and dialogue re-ranking (where the COM-B category of the LLM output is matched to the inferred user need). Simulated conversations were conducted between the primed or unprimed LLM and a member of the research team, and then evaluated by 8 human raters. Ratings for the primed conversations were significantly higher in terms of empathy and actionability. The same raters also compared a single response generated by the unprimed, primed and re-ranked models, finding a significant uplift in actionability and empathy from the re-ranking technique. This is a proof of concept of how behavior science frameworks can be infused into automated conversational agents for a more principled coaching experience.

Dissecting the rationale for thromboprophylaxis in challenging surgical cases

Pulmonary embolism (PE) is a leading preventable cause of death in surgical patients, and rates of fatal PE are increasing. Individual assessment, to balance the risks of thrombosis and bleeding, is the key to providing appropriate prophylaxis. The risk assessment process includes use of evidence-based guidelines, literature published since the latest guidelines, large registries, and risk scoring systems together with clinical experience and judgment. Risk assessment is a dynamic process and needs to be updated both during the hospital stay and just prior to discharge since clinical events may change the level of risk. The final assessment may identify patients who require ongoing anticoagulant prophylaxis after discharge. The Caprini risk score is widely used in surgical patients and is a composite of the number of risk factors and their relative weights. The Caprini risk score set point for risk levels requiring anticoagulant prophylaxis varies depending on the type of surgical procedure, surgical population, and number of risk factors. Mandatory implementation of evidence-based care pathways is helpful in lowering PE-related mortality. This review presents several challenging cases, emphasizing the importance of employing all available assessment tools, including dynamic assessment of risk during hospitalization. Finally, the limitations of evidence-based guidelines in complex scenarios and the need to employ all available tools to properly protect very high-risk patients are emphasized.

Using ChatGPT-Like Solutions to Bridge the Communication Gap Between Patients With Rheumatoid Arthritis and Health Care Professionals

The communication gap between patients and health care professionals has led to increased disputes and resource waste in the medical domain. The development of artificial intelligence and other technologies brings new possibilities to solve this problem. This viewpoint paper proposes a new relationship between patients and health care professionals-"shared decision-making"-allowing both sides to obtain a deeper understanding of the disease and reach a consensus during diagnosis and treatment. Then, this paper discusses the important impact of ChatGPT-like solutions in treating rheumatoid arthritis using methotrexate from clinical and patient perspectives. For clinical professionals, ChatGPT-like solutions could provide support in disease diagnosis, treatment, and clinical trials, but attention should be paid to privacy, confidentiality, and regulatory norms. For patients, ChatGPT-like solutions allow easy access to massive amounts of information; however, the information should be carefully managed to ensure safe and effective care. To ensure the effective application of ChatGPT-like solutions in improving the relationship between patients and health care professionals, it is essential to establish a comprehensive database and provide legal, ethical, and other support. Above all, ChatGPT-like solutions could benefit patients and health care professionals if they ensure evidence-based solutions and data protection and collaborate with regulatory authorities and regulatory evolution.

Digital Anti-Aging Healthcare: An Overview of the Applications of Digital Technologies in Diet Management

Diet management has long been an important practice in healthcare, enabling individuals to get an insight into their nutrient intake, prevent diseases, and stay healthy. Traditional methods based on self-reporting, food diaries, and periodic assessments have been used for a long time to control dietary habits. These methods have shown limitations in accuracy, compliance, and real-time analysis. The rapid advancement of digital technologies has revolutionized healthcare, including the diet control landscape, allowing for innovative solutions to control dietary patterns and generate accurate and personalized recommendations. This study examines the potential of digital technologies in diet management and their effectiveness in anti-aging healthcare. After underlining the importance of nutrition in the aging process, we explored the applications of mobile apps, web-based platforms, wearables devices, sensors, the Internet of Things, artificial intelligence, blockchain, and other technologies in managing dietary patterns and improving health outcomes. The research further examines the effects of digital dietary control on anti-aging healthcare, including improved nutritional monitoring, personalized recommendations, and behavioral and sustainable changes in habits, leading to an expansion of longevity and health span. The challenges and limitations of digital diet monitoring are discussed, and some future directions are provided. Although many digital tools are used in diet control, their accuracy, effectiveness, and impact on health outcomes are not discussed much. This review consolidates the existing literature on digital diet management using emerging digital technologies to analyze their practical implications, guiding researchers, healthcare professionals, and policy makers toward personalized dietary management and healthy aging.

The Effects of Artificial Intelligence Chatbots on Women's Health: A Systematic Review and Meta-Analysis

PURPOSE

This systematic review and meta-analysis aimed to investigate the effects of artificial intelligence chatbot interventions on health outcomes in women.

METHODS

Ten relevant studies published between 2019 and 2023 were extracted from the PubMed, Cochrane Library, EMBASE, CINAHL, and RISS databases in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. This review focused on experimental studies concerning chatbot interventions in women's health. The literature was assessed using the ROB 2 quality appraisal checklist, and the results were visualized with a risk-of-bias visualization program.

RESULTS

This review encompassed seven randomized controlled trials and three single-group experimental studies. Chatbots were effective in addressing anxiety, depression, distress, healthy relationships, cancer self-care behavior, preconception intentions, risk perception in eating disorders, and gender attitudes. Chatbot users experienced benefits in terms of internalization, acceptability, feasibility, and interaction. A meta-analysis of three studies revealed significant effects in reducing anxiety (I2 = 0%, Q = 8.10, p < 0.017), with an effect size of -0.30 (95% CI, -0.42 to -0.18).

CONCLUSIONS

Artificial intelligence chatbot interventions had positive effects on physical, physiological, and cognitive health outcomes. Using chatbots may represent pivotal nursing interventions for female populations to improve health status and support women socially as a form of digital therapy.

Special Issue "Sports Science in Children"

In recent times, research and technological advancements have opened an unprecedented window of opportunity for sports science to play a pivotal role in the holistic well-being of children [...].

Investigating the Potential of a Conversational Agent (Phyllis) to Support Adolescent Health and Overcome Barriers to Physical Activity: Co-Design Study

BACKGROUND

Conversational agents (CAs) are a promising solution to support people in improving physical activity (PA) behaviors. However, there is a lack of CAs targeted at adolescents that aim to provide support to overcome barriers to PA. This study reports the results of the co-design, development, and evaluation of a prototype CA called "Phyllis" to support adolescents in overcoming barriers to PA with the aim of improving PA behaviors. The study presents one of the first theory-driven CAs that use existing research, a theoretical framework, and a behavior change model.

OBJECTIVE

The aim of the study is to use a mixed methods approach to investigate the potential of a CA to support adolescents in overcoming barriers to PA and enhance their confidence and motivation to engage in PA.

METHODS

The methodology involved co-designing with 8 adolescents to create a relational and persuasive CA with a suitable persona and dialogue. The CA was evaluated to determine its acceptability, usability, and effectiveness, with 46 adolescents participating in the study via a web-based survey.

RESULTS

The co-design participants were students aged 11 to 13 years, with a sex distribution of 56% (5/9) female and 44% (4/9) male, representing diverse ethnic backgrounds. Participants reported 37 specific barriers to PA, and the most common barriers included a "lack of confidence," "fear of failure," and a "lack of motivation." The CA's persona, named "Phyllis," was co-designed with input from the students, reflecting their preferences for a friendly, understanding, and intelligent personality. Users engaged in 61 conversations with Phyllis and reported a positive user experience, and 73% of them expressed a definite intention to use the fully functional CA in the future, with a net promoter score indicating a high likelihood of recommendation. Phyllis also performed well, being able to recognize a range of different barriers to PA. The CA's persuasive capacity was evaluated in modules focusing on confidence and motivation, with a significant increase in students' agreement in feeling confident and motivated to engage in PA after interacting with Phyllis. Adolescents also expect to have a personalized experience and be able to personalize all aspects of the CA.

CONCLUSIONS

The results showed high acceptability and a positive user experience, indicating the CA's potential. Promising outcomes were observed, with increasing confidence and motivation for PA. Further research and development are needed to create further interventions to address other barriers to PA and assess long-term behavior change. Addressing concerns regarding bias and privacy is crucial for achieving acceptability in the future. The CA's potential extends to health care systems and multimodal support, providing valuable insights for designing digital health interventions including tackling global inactivity issues among adolescents.

Conversational AI and equity through assessing GPT-3's communication with diverse social groups on contentious topics

Autoregressive language models, which use deep learning to produce human-like texts, have surged in prevalence. Despite advances in these models, concerns arise about their equity across diverse populations. While AI fairness is discussed widely, metrics to measure equity in dialogue systems are lacking. This paper presents a framework, rooted in deliberative democracy and science communication studies, to evaluate equity in human-AI communication. Using it, we conducted an algorithm auditing study to examine how GPT-3 responded to different populations who vary in sociodemographic backgrounds and viewpoints on crucial science and social issues: climate change and the Black Lives Matter (BLM) movement. We analyzed 20,000 dialogues with 3290 participants differing in gender, race, education, and opinions. We found a substantively worse user experience among the opinion minority groups (e.g., climate deniers, racists) and the education minority groups; however, these groups changed attitudes toward supporting BLM and climate change efforts much more compared to other social groups after the chat. GPT-3 used more negative expressions when responding to the education and opinion minority groups. We discuss the social-technological implications of our findings for a conversational AI system that centralizes diversity, equity, and inclusion.

Wearable Devices to Improve Physical Activity and Reduce Sedentary Behaviour: An Umbrella Review

BACKGROUND

Several systematic reviews (SRs), with and without meta-analyses, have investigated the use of wearable devices to improve physical activity, and there is a need for frequent and updated syntheses on the topic.

OBJECTIVE

We aimed to evaluate whether using wearable devices increased physical activity and reduced sedentary behaviour in adults.

METHODS

We conducted an umbrella review searching PubMed, Cumulative Index to Nursing and Allied Health Literature, the Cochrane Library, MedRxiv, Rxiv and bioRxiv databases up to February 5th, 2023. We included all SRs that evaluated the efficacy of interventions when wearable devices were used to measure physical activity in adults aged over 18 years. The primary outcomes were physical activity and sedentary behaviour measured as the number of steps per day, minutes of moderate to vigorous physical activity (MVPA) per week, and minutes of sedentary behaviour (SB) per day. We assessed the methodological quality of each SR using the Assessment of Multiple Systematic Reviews, version 2 (AMSTAR 2) and the certainty of evidence of each outcome measure using the GRADE (Grading of Recommendations, Assessment, Development, and Evaluations). We interpreted the results using a decision-making framework examining the clinical relevance and the concordances or discordances of the SR effect size.

RESULTS

Fifty-one SRs were included, of which 38 included meta-analyses (302 unique primary studies). Of the included SRs, 72.5% were rated as 'critically low methodological quality'. Overall, with a slight overlap of primary studies (corrected cover area: 3.87% for steps per day, 3.12% for MVPA, 4.06% for SB) and low-to-moderate certainty of the evidence, the use of WDs may increase PA by a median of 1,312.23 (IQR 627-1854) steps per day and 57.8 (IQR 37.7 to 107.3) minutes per week of MVPA. Uncertainty is present for PA in pathologies and older adults subgroups and for SB in mixed and older adults subgroups (large confidence intervals).

CONCLUSIONS

Our findings suggest that the use of WDs may increase physical activity in middle-aged adults. Further studies are needed to investigate the effects of using WDs on specific subgroups (such as pathologies and older adults) in different follow-up lengths, and the role of other intervention components.

Assessing the potential of ChatGPT for psychodynamic formulations in psychiatry: An exploratory study

Although there were several attempts to apply ChatGPT (Generative Pre-Trained Transformer) to medicine, little is known about therapeutic applications in psychiatry. In this exploratory study, we aimed to evaluate the characteristics and appropriateness of the psychodynamic formulations created by ChatGPT. Along with a case selected from the psychoanalytic literature, input prompts were designed to include different levels of background knowledge. These included naïve prompts, keywords created by ChatGPT, keywords created by psychiatrists, and psychodynamic concepts from the literature. The psychodynamic formulations generated from the different prompts were evaluated by five psychiatrists from different institutions. We next conducted further tests in which instructions on the use of different psychodynamic models were added to the input prompts. The models used were ego psychology, self-psychology, and object relations. The results from naïve prompts and psychodynamic concepts were rated as appropriate by most raters. The psychodynamic concept prompt output was rated the highest. Interrater agreement was statistically significant. The results from the tests using instructions in different psychoanalytic theories were also rated as appropriate by most raters. They included key elements of the psychodynamic formulation and suggested interpretations similar to the literature. These findings suggest potential of ChatGPT for use in psychiatry.

Navigating healthier beverage consumption in adolescents using the "R-Ma Bot" chatbot: A usability and evaluation study

Objective

This pilot study aimed to evaluate the usability and effectiveness of a behavior change technique (BCT)-based chatbot developed to promote healthier beverage consumption among adolescents.

Methods

The Read and Manage your health roBot ("R-Ma Bot"), designed with 13 BCTs, was tested with 42 adolescents (13 men, 29 women, mean age 15.0 ± 0.7) for 2 weeks. Usability was assessed after the 2-week intervention using a chatbot usability questionnaire, recruitment, retention, participation, and engagement. Scores above 70 out of 100 were considered high usability. Qualitative data from open-ended questions were collected for evaluation. Effectiveness was measured by changes in knowledge, use and impact of nutrition labels, and weekly consumption of sugar, sodium, and caffeine from carbonated and/or energy drinks before and after the 2-week intervention.

Results

The score of R-Ma Bot's usability averaged 74.7, with participants addressing it useful, friendly, and easy to use, though they suggested improving unnatural conversation flow. All participants engaged with the chatbot for at least 13 out of 14 days, with over half using it daily for the entire period. After intervention, awareness of nutrition labels increased from 64.3% to 92.9%, and nonreaders decreased from 42.9% to 16.7%. Weekly sugar intake from beverages significantly decreased by 60%, from 13.1 ± 20.1 mg to 7.9 ± 12.8 mg.

Conclusions

R-Ma Bot's high usability contributed to high retention and behavioral changes, significantly reduced sugar consumption from beverages and improved awareness of nutrition labels. We suggest integrating strategies that enhance knowledge, motivation, and opportunities through BCTs with youth-friendly design elements in the development of interventions for adolescents.

Evaluation of the Current State of Chatbots for Digital Health: Scoping Review

BACKGROUND

Chatbots have become ubiquitous in our daily lives, enabling natural language conversations with users through various modes of communication. Chatbots have the potential to play a significant role in promoting health and well-being. As the number of studies and available products related to chatbots continues to rise, there is a critical need to assess product features to enhance the design of chatbots that effectively promote health and behavioral change.

OBJECTIVE

This scoping review aims to provide a comprehensive assessment of the current state of health-related chatbots, including the chatbots' characteristics and features, user backgrounds, communication models, relational building capacity, personalization, interaction, responses to suicidal thoughts, and users' in-app experiences during chatbot use. Through this analysis, we seek to identify gaps in the current research, guide future directions, and enhance the design of health-focused chatbots.

METHODS

Following the scoping review methodology by Arksey and O'Malley and guided by the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) checklist, this study used a two-pronged approach to identify relevant chatbots: (1) searching the iOS and Android App Stores and (2) reviewing scientific literature through a search strategy designed by a librarian. Overall, 36 chatbots were selected based on predefined criteria from both sources. These chatbots were systematically evaluated using a comprehensive framework developed for this study, including chatbot characteristics, user backgrounds, building relational capacity, personalization, interaction models, responses to critical situations, and user experiences. Ten coauthors were responsible for downloading and testing the chatbots, coding their features, and evaluating their performance in simulated conversations. The testing of all chatbot apps was limited to their free-to-use features.

RESULTS

This review provides an overview of the diversity of health-related chatbots, encompassing categories such as mental health support, physical activity promotion, and behavior change interventions. Chatbots use text, animations, speech, images, and emojis for communication. The findings highlight variations in conversational capabilities, including empathy, humor, and personalization. Notably, concerns regarding safety, particularly in addressing suicidal thoughts, were evident. Approximately 44% (16/36) of the chatbots effectively addressed suicidal thoughts. User experiences and behavioral outcomes demonstrated the potential of chatbots in health interventions, but evidence remains limited.

CONCLUSIONS

This scoping review underscores the significance of chatbots in health-related applications and offers insights into their features, functionalities, and user experiences. This study contributes to advancing the understanding of chatbots' role in digital health interventions, thus paving the way for more effective and user-centric health promotion strategies. This study informs future research directions, emphasizing the need for rigorous randomized control trials, standardized evaluation metrics, and user-centered design to unlock the full potential of chatbots in enhancing health and well-being. Future research should focus on addressing limitations, exploring real-world user experiences, and implementing robust data security and privacy measures.

Revolutionizing healthcare: the role of artificial intelligence in clinical practice

INTRODUCTION

Healthcare systems are complex and challenging for all stakeholders, but artificial intelligence (AI) has transformed various fields, including healthcare, with the potential to improve patient care and quality of life. Rapid AI advancements can revolutionize healthcare by integrating it into clinical practice. Reporting AI's role in clinical practice is crucial for successful implementation by equipping healthcare providers with essential knowledge and tools.

RESEARCH SIGNIFICANCE

This review article provides a comprehensive and up-to-date overview of the current state of AI in clinical practice, including its potential applications in disease diagnosis, treatment recommendations, and patient engagement. It also discusses the associated challenges, covering ethical and legal considerations and the need for human expertise. By doing so, it enhances understanding of AI's significance in healthcare and supports healthcare organizations in effectively adopting AI technologies.

MATERIALS AND METHODS

The current investigation analyzed the use of AI in the healthcare system with a comprehensive review of relevant indexed literature, such as PubMed/Medline, Scopus, and EMBASE, with no time constraints but limited to articles published in English. The focused question explores the impact of applying AI in healthcare settings and the potential outcomes of this application.

RESULTS

Integrating AI into healthcare holds excellent potential for improving disease diagnosis, treatment selection, and clinical laboratory testing. AI tools can leverage large datasets and identify patterns to surpass human performance in several healthcare aspects. AI offers increased accuracy, reduced costs, and time savings while minimizing human errors. It can revolutionize personalized medicine, optimize medication dosages, enhance population health management, establish guidelines, provide virtual health assistants, support mental health care, improve patient education, and influence patient-physician trust.

CONCLUSION

AI can be used to diagnose diseases, develop personalized treatment plans, and assist clinicians with decision-making. Rather than simply automating tasks, AI is about developing technologies that can enhance patient care across healthcare settings. However, challenges related to data privacy, bias, and the need for human expertise must be addressed for the responsible and effective implementation of AI in healthcare.

A Beta-Prototype Chatbot for Increasing Health Literacy of Patients With Decompensated Cirrhosis: Usability Study

BACKGROUND

Health literacy is low among patients with chronic liver disease (CLD) and associated with poor health outcomes and increased health care use. Lucy LiverBot, an artificial intelligence chatbot was created by a multidisciplinary team at Monash Health, Australia, to improve health literacy and self-efficacy in patients with decompensated CLD.

OBJECTIVE

The aim of this study was to explore users' experience with Lucy LiverBot using an unmoderated, in-person, qualitative test.

METHODS

Lucy LiverBot is a simple, low cost, and scalable digital intervention, which was at the beta prototype development phase at the time of usability testing. The concept and prototype development was realized in 2 phases: concept development and usability testing. We conducted a mixed methods study to assess usability of Lucy LiverBot as a tool for health literacy education among ambulatory and hospitalized patients with decompensated CLD at Monash Health. Patients were provided with free reign to interact with Lucy LiverBot on an iPad device under moderator observation. A 3-part survey (preuser, user, and postuser) was developed using the Unified Acceptance Theory Framework to capture the user experience.

RESULTS

There were 20 participants with a median age of 55.5 (IQR 46.0-60.5) years, 55% (n=11) of them were female, and 85% (n=17) of them were White. In total, 35% (n=7) of them reported having difficulty reading and understanding written medical information. Alcohol was the predominant etiology in 70% (n=14) of users. Participants actively engaged with Lucy LiverBot and identified it as a potential educational tool and device that could act as a social companion to improve well-being. In total, 25% (n=5) of them reported finding it difficult to learn about their health problems and 20% (n=4) of them found it difficult to find medical information they could trust. Qualitative interviews revealed the conversational nature of Lucy LiverBot was considered highly appealing with improvement in mental health and well-being reported as an unintended benefit of Lucy LiverBot. Patients who had been managing their liver cirrhosis for several years identified that they would be less likely to use Lucy LiverBot, but that it would have been more useful at the time of their diagnosis. Overall, Lucy LiverBot was perceived as a reliable and trustworthy source of information.

CONCLUSIONS

Lucy LiverBot was well received and may be used to improve health literacy and address barriers to health care provision in patients with decompensated CLD. The study revealed important feedback that has been used to further optimize Lucy LiverBot. Further acceptability and validation studies are being undertaken to investigate whether Lucy LiverBot can improve clinical outcomes and health related quality of life in patients with decompensated CLD.

A theory-based and data-driven approach to promoting physical activity through message-based interventions

Objective

We investigated how physical activity can be effectively promoted with a message-based intervention, by combining the explanatory power of theory-based structural equation modeling with the predictive power of data-driven artificial intelligence.

Methods

A sample of 564 participants took part in a two-week message intervention via a mobile app. We measured participants' regulatory focus, attitude, perceived behavioral control, social norm, and intention to engage in physical activity. We then randomly assigned participants to four message conditions (gain, non-loss, non-gain, loss). After the intervention ended, we measured emotions triggered by the messages, involvement, deep processing, and any change in intention to engage in physical activity.

Results

Data analysis confirmed the soundness of our theory-based structural equation model (SEM) and how the emotions triggered by the messages mediated the influence of regulatory focus on involvement, deep processing of the messages, and intention. We then developed a Dynamic Bayesian Network (DBN) that incorporated the SEM model and the message frame intervention as a structural backbone to obtain the best combination of in-sample explanatory power and out-of-sample predictive power. Using a Deep Reinforcement Learning (DRL) approach, we then developed an automated, fast-profiling strategy to quickly select the best message strategy, based on the characteristics of each potential respondent. Finally, the fast-profiling method was integrated into an AI-based chatbot.

Conclusion

Combining the explanatory power of theory-driven structural equation modeling with the predictive power of data-driven artificial intelligence is a promising strategy to effectively promote physical activity with message-based interventions.

An Overview of Chatbot-Based Mobile Mental Health Apps: Insights From App Description and User Reviews

BACKGROUND

Chatbots are an emerging technology that show potential for mental health care apps to enable effective and practical evidence-based therapies. As this technology is still relatively new, little is known about recently developed apps and their characteristics and effectiveness.

OBJECTIVE

In this study, we aimed to provide an overview of the commercially available popular mental health chatbots and how they are perceived by users.

METHODS

We conducted an exploratory observation of 10 apps that offer support and treatment for a variety of mental health concerns with a built-in chatbot feature and qualitatively analyzed 3621 consumer reviews from the Google Play Store and 2624 consumer reviews from the Apple App Store.

RESULTS

We found that although chatbots' personalized, humanlike interactions were positively received by users, improper responses and assumptions about the personalities of users led to a loss of interest. As chatbots are always accessible and convenient, users can become overly attached to them and prefer them over interacting with friends and family. Furthermore, a chatbot may offer crisis care whenever the user needs it because of its 24/7 availability, but even recently developed chatbots lack the understanding of properly identifying a crisis. Chatbots considered in this study fostered a judgment-free environment and helped users feel more comfortable sharing sensitive information.

CONCLUSIONS

Our findings suggest that chatbots have great potential to offer social and psychological support in situations where real-world human interaction, such as connecting to friends or family members or seeking professional support, is not preferred or possible to achieve. However, there are several restrictions and limitations that these chatbots must establish according to the level of service they offer. Too much reliance on technology can pose risks, such as isolation and insufficient assistance during times of crisis. Recommendations for customization and balanced persuasion to inform the design of effective chatbots for mental health support have been outlined based on the insights of our findings.

Feasibility and Acceptability of Chatbots for Nutrition and Physical Activity Health Promotion Among Adolescents: Systematic Scoping Review With Adolescent Consultation

BACKGROUND

Reducing lifestyle risk behaviors among adolescents depends on access to age-appropriate health promotion information. Chatbots-computer programs designed to simulate conversations with human users-have the potential to deliver health information to adolescents to improve their lifestyle behaviors and support behavior change, but research on the feasibility and acceptability of chatbots in the adolescent population is unknown.

OBJECTIVE

This systematic scoping review aims to evaluate the feasibility and acceptability of chatbots in nutrition and physical activity interventions among adolescents. A secondary aim is to consult adolescents to identify features of chatbots that are acceptable and feasible.

METHODS

We searched 6 electronic databases from March to April 2022 (MEDLINE, Embase, Joanna Briggs Institute, the Cumulative Index to Nursing and Allied Health, the Association for Computing Machinery library, and the IT database Institute of Electrical and Electronics Engineers). Peer-reviewed studies were included that were conducted in the adolescent population (10-19 years old) without any chronic disease, except obesity or type 2 diabetes, and assessed chatbots used nutrition or physical activity interventions or both that encouraged individuals to meet dietary or physical activity guidelines and support positive behavior change. Studies were screened by 2 independent reviewers, with any queries resolved by a third reviewer. Data were extracted into tables and collated in a narrative summary. Gray literature searches were also undertaken. Results of the scoping review were presented to a diverse youth advisory group (N=16, 13-18 years old) to gain insights into this topic beyond what is published in the literature.

RESULTS

The search identified 5558 papers, with 5 (0.1%) studies describing 5 chatbots meeting the inclusion criteria. The 5 chatbots were supported by mobile apps using a combination of the following features: personalized feedback, conversational agents, gamification, and monitoring of behavior change. Of the 5 studies, 2 (40.0%) studies focused on nutrition, 2 (40.0%) studies focused on physical activity, and 1 (20.0%) focused on both nutrition and physical activity. Feasibility and acceptability varied across the 5 studies, with usage rates above 50% in 3 (60.0%) studies. In addition, 3 (60.0%) studies reported health-related outcomes, with only 1 (20.0%) study showing promising effects of the intervention. Adolescents presented novel concerns around the use of chatbots in nutrition and physical activity interventions, including ethical concerns and the use of false or misleading information.

CONCLUSIONS

Limited research is available on chatbots in adolescent nutrition and physical activity interventions, finding insufficient evidence on the acceptability and feasibility of chatbots in the adolescent population. Similarly, adolescent consultation identified issues in the design features that have not been mentioned in the published literature. Therefore, chatbot codesign with adolescents may help ensure that such technology is feasible and acceptable to an adolescent population.

The Use of Chatbots in Oncological Care: A Narrative Review

BACKGROUND

Few reports have investigated chatbots in patient care. We aimed to assess the current applications, limitations, and challenges in the literature on chatbots employed in oncological care.

METHODS

We queried the PubMed database through April 2022 and included studies that investigated the use of chatbots in different phases of oncological care. The search used five different combinations of the specific terms "chatbot", "cancer", "oncology", and "conversational agent". Inclusion criteria were chatbot use in any aspect of oncological care-prevention, patient education, treatment, and surveillance.

RESULTS

The initial search yielded 196 records, 21 of which met inclusion criteria. The identified chatbots mostly focused on breast and ovarian cancer (n=8), with the second most common being cervical cancer (n=3). Good patient satisfaction was reported among 14 of 21 chatbots. The most reported chatbot applications were cancer screening, prevention, risk stratification, treatment, monitoring, and management. Of 12 studies examining efficacy of care via chatbot, 9 demonstrated improvements compared to standard care.

CONCLUSION

Chatbots used for oncological care to date demonstrate high user satisfaction, and many have shown efficacy in improving patient-centered communication, accessibility to cancer-related information, and access to care. Currently, chatbots are primarily limited by the need for extensive user-testing and iterative improvement before widespread implementation.

Artificial Intelligence-Based Chatbots for Promoting Health Behavioral Changes: Systematic Review

BACKGROUND

Artificial intelligence (AI)-based chatbots can offer personalized, engaging, and on-demand health promotion interventions.

OBJECTIVE

The aim of this systematic review was to evaluate the feasibility, efficacy, and intervention characteristics of AI chatbots for promoting health behavior change.

METHODS

A comprehensive search was conducted in 7 bibliographic databases (PubMed, IEEE Xplore, ACM Digital Library, PsycINFO, Web of Science, Embase, and JMIR publications) for empirical articles published from 1980 to 2022 that evaluated the feasibility or efficacy of AI chatbots for behavior change. The screening, extraction, and analysis of the identified articles were performed by following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines.

RESULTS

Of the 15 included studies, several demonstrated the high efficacy of AI chatbots in promoting healthy lifestyles (n=6, 40%), smoking cessation (n=4, 27%), treatment or medication adherence (n=2, 13%), and reduction in substance misuse (n=1, 7%). However, there were mixed results regarding feasibility, acceptability, and usability. Selected behavior change theories and expert consultation were used to develop the behavior change strategies of AI chatbots, including goal setting, monitoring, real-time reinforcement or feedback, and on-demand support. Real-time user-chatbot interaction data, such as user preferences and behavioral performance, were collected on the chatbot platform to identify ways of providing personalized services. The AI chatbots demonstrated potential for scalability by deployment through accessible devices and platforms (eg, smartphones and Facebook Messenger). The participants also reported that AI chatbots offered a nonjudgmental space for communicating sensitive information. However, the reported results need to be interpreted with caution because of the moderate to high risk of internal validity, insufficient description of AI techniques, and limitation for generalizability.

CONCLUSIONS

AI chatbots have demonstrated the efficacy of health behavior change interventions among large and diverse populations; however, future studies need to adopt robust randomized control trials to establish definitive conclusions.

Setting Physical Activity Goals with a Virtual Coach: Vicarious Experiences, Personalization and Acceptance

Goal-setting is often used in eHealth applications for behavior change as it motivates and helps to stay focused on a desired outcome. However, for goals to be effective, they need to meet criteria such as being specific, measurable, attainable, relevant and time-bound (SMART). Moreover, people need to be confident to reach their goal. We thus created a goal-setting dialog in which the virtual coach Jody guided people in setting SMART goals. Thereby, Jody provided personalized vicarious experiences by showing examples from other people who reached a goal to increase people's confidence. These experiences were personalized, as it is helpful to observe a relatable other succeed. Data from an online study with a between-subjects with pre-post measurement design (n=39 participants) provide credible support that personalized experiences are seen as more motivating than generic ones. Motivational factors for participants included information about the goal, path to the goal, and the person who accomplished a goal, as well as the mere fact that a goal was reached. Participants also had a positive attitude toward Jody. We see these results as an indication that people are positive toward using a goal-setting dialog with a virtual coach in eHealth applications for behavior change. Moreover, contrary to hypothesized, our observed data give credible support that participants' self-efficacy was lower after the dialog than before. These results warrant further research on how such dialogs affect self-efficacy, especially whether these lower post-measurements of self-efficacy are associated with people's more realistic assessment of their abilities.

Supporting Autonomous Motivation for Physical Activity With Chatbots During the COVID-19 Pandemic: Factorial Experiment

BACKGROUND

Although physical activity can mitigate disease trajectories and improve and sustain mental health, many people have become less physically active during the COVID-19 pandemic. Personal information technology, such as activity trackers and chatbots, can technically converse with people and possibly enhance their autonomous motivation to engage in physical activity. The literature on behavior change techniques (BCTs) and self-determination theory (SDT) contains promising insights that can be leveraged in the design of these technologies; however, it remains unclear how this can be achieved.

OBJECTIVE

This study aimed to evaluate the feasibility of a chatbot system that improves the user's autonomous motivation for walking based on BCTs and SDT. First, we aimed to develop and evaluate various versions of a chatbot system based on promising BCTs. Second, we aimed to evaluate whether the use of the system improves the autonomous motivation for walking and the associated factors of need satisfaction. Third, we explored the support for the theoretical mechanism and effectiveness of various BCT implementations.

METHODS

We developed a chatbot system using the mobile apps Telegram (Telegram Messenger Inc) and Google Fit (Google LLC). We implemented 12 versions of this system, which differed in 3 BCTs: goal setting, experimenting, and action planning. We then conducted a feasibility study with 102 participants who used this system over the course of 3 weeks, by conversing with a chatbot and completing questionnaires, capturing their perceived app support, need satisfaction, physical activity levels, and motivation.

RESULTS

The use of the chatbot systems was satisfactory, and on average, its users reported increases in autonomous motivation for walking. The dropout rate was low. Although approximately half of the participants indicated that they would have preferred to interact with a human instead of the chatbot, 46.1% (47/102) of the participants stated that the chatbot helped them become more active, and 42.2% (43/102) of the participants decided to continue using the chatbot for an additional week. Furthermore, the majority thought that a more advanced chatbot could be very helpful. The motivation was associated with the satisfaction of the needs of competence and autonomy, and need satisfaction, in turn, was associated with the perceived system support, providing support for SDT underpinnings. However, no substantial differences were found across different BCT implementations.

CONCLUSIONS

The results provide evidence that chatbot systems are a feasible means to increase autonomous motivation for physical activity. We found support for SDT as a basis for the design, laying a foundation for larger studies to confirm the effectiveness of the selected BCTs within chatbot systems, explore a wider range of BCTs, and help the development of guidelines for the design of interactive technology that helps users achieve long-term health benefits.

An artificially intelligent, natural language processing chatbot designed to promote COVID-19 vaccination: A proof-of-concept pilot study

Objective

Our goal is to establish the feasibility of using an artificially intelligent chatbot in diverse healthcare settings to promote COVID-19 vaccination.

Methods

We designed an artificially intelligent chatbot deployed via short message services and web-based platforms. Guided by communication theories, we developed persuasive messages to respond to users' COVID-19-related questions and encourage vaccination. We implemented the system in healthcare settings in the U.S. between April 2021 and March 2022 and logged the number of users, topics discussed, and information on system accuracy in matching responses to user intents. We regularly reviewed queries and reclassified responses to better match responses to query intents as COVID-19 events evolved.

Results

A total of 2479 users engaged with the system, exchanging 3994 COVID-19 relevant messages. The most popular queries to the system were about boosters and where to get a vaccine. The system's accuracy rate in matching responses to user queries ranged from 54% to 91.1%. Accuracy lagged when new information related to COVID emerged, such as that related to the Delta variant. Accuracy increased when we added new content to the system.

Conclusions

It is feasible and potentially valuable to create chatbot systems using AI to facilitate access to current, accurate, complete, and persuasive information on infectious diseases. Such a system can be adapted to use with patients and populations needing detailed information and motivation to act in support of their health.

Addressing people's current and future states in a reinforcement learning algorithm for persuading to quit smoking and to be physically active

Behavior change applications often assign their users activities such as tracking the number of smoked cigarettes or planning a running route. To help a user complete these activities, an application can persuade them in many ways. For example, it may help the user create a plan or mention the experience of peers. Intuitively, the application should thereby pick the message that is most likely to be motivating. In the simplest case, this could be the message that has been most effective in the past. However, one could consider several other elements in an algorithm to choose a message. Possible elements include the user's current state (e.g., self-efficacy), the user's future state after reading a message, and the user's similarity to the users on which data has been gathered. To test the added value of subsequently incorporating these elements into an algorithm that selects persuasive messages, we conducted an experiment in which more than 500 people in four conditions interacted with a text-based virtual coach. The experiment consisted of five sessions, in each of which participants were suggested a preparatory activity for quitting smoking or increasing physical activity together with a persuasive message. Our findings suggest that adding more elements to the algorithm is effective, especially in later sessions and for people who thought the activities were useful. Moreover, while we found some support for transferring knowledge between the two activity types, there was rather low agreement between the optimal policies computed separately for the two activity types. This suggests limited policy generalizability between activities for quitting smoking and those for increasing physical activity. We see our results as supporting the idea of constructing more complex persuasion algorithms. Our dataset on 2,366 persuasive messages sent to 671 people is published together with this article for researchers to build on our algorithm.

Public perceptions of a healthy lifestyle change conversational agent in Singapore: A qualitative study

OBJECTIVE

Conversational agents (CAs) are increasingly used for the delivery of healthy lifestyle behaviour interventions. This qualitative study aimed to explore the barriers and facilitators to participants' usage of a healthy lifestyle change CA and collect their views on areas for its improvement.

METHODS

Twenty participants were recruited from a convenience sample of users interacting with a CA promoting healthy lifestyle changes to the general population in Singapore. This CA, Precilla, educated users on healthy living, specifically: diet, exercise, sleep and stress; for four weeks. The volunteers participated in semi-structured interviews where an interview guide was used, with questions on acceptability, satisfaction and critical appraisal of the CA. Interviews were transcribed and analysed in parallel by two researchers using thematic content analysis.

RESULTS

Four main themes were identified: (1) enjoyable and acceptable experiences, (2) suboptimal experience(s), (3) alterations to Precilla for enhanced interaction and (4) suggestions for the future. Enjoyable experiences referenced the CA's friendly personality and important content that motivated a positive change to their lifestyle. Some participants were less satisfied and found the content to be too simple or sometimes, the messages too lengthy.

CONCLUSIONS

Participants suggested that in the future, CAs should provide regularly updated content on healthy living, specifically pre-diabetes. Multiple answer options should also be provided for more personalisation along with links to external resources to help improve users' health literacy. Further recommendations include a necessity for a user-centered approach in CA development, employment of engagement strategies, use of a delivery platform most familiar to the target population and stratified message timings to suit the population and purpose of CA. Translating the health CAs to languages relevant to the target group could also enable wider reach and applicability.

Interactive Conversational Agents for Health Promotion, Prevention, and Care: Protocol for a Mixed Methods Systematic Scoping Review

BACKGROUND

Interactive conversational agents, also known as "chatbots," are computer programs that use natural language processing to engage in conversations with humans to provide or collect information. Although the literature on the development and use of chatbots for health interventions is growing, important knowledge gaps remain, such as identifying design aspects relevant to health care and functions to offer transparency in decision-making automation.

OBJECTIVE

This paper presents the protocol for a scoping review that aims to identify and categorize the interactive conversational agents currently used in health care.

METHODS

A mixed methods systematic scoping review will be conducted according to the Arksey and O'Malley framework and the guidance of Peters et al for systematic scoping reviews. A specific search strategy will be formulated for 5 of the most relevant databases to identify studies published in the last 20 years. Two reviewers will independently apply the inclusion criteria using the full texts and extract data. We will use structured narrative summaries of main themes to present a portrait of the current scope of available interactive conversational agents targeting health promotion, prevention, and care. We will also summarize the differences and similarities between these conversational agents.

RESULTS

The search strategy and screening steps were completed in March 2022. Data extraction and analysis started in May 2022, and the results are expected to be published in October 2022.

CONCLUSIONS

This fundamental knowledge will be useful for the development of interactive conversational agents adapted to specific groups in vulnerable situations in health care and community settings.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/40265.

Using Chatbot as an Alternative Approach for In-Person Tooth Brushing Training During the COVID-19 Pandemic

Background

It is recommended that caregivers receive oral health education and in-person training to improve toothbrushing for young children. To strengthen oral health education before COVID-19, the 21-Day FunDee chatbot with in-person toothbrushing training for caregivers was used. During the pandemic, practical experience was difficult to implement. Therefore, the 30-Day FunDee chatbot was created to extend the coverage of chatbots from 21 days to 30 days by incorporating more videos on toothbrushing demonstrations and dialogue. This was a secondary data comparison of 2 chatbots in similar rural areas of Pattani province: Maikan district (Study I) and Maelan district (Study II).

Objective

This study aimed to evaluate the effectiveness and usability of 2 chatbots, 21-Day FunDee (Study I) and 30-Day FunDee (Study II), based on the protection motivation theory (PMT). This study explored the feasibility of using the 30-Day FunDee chatbot to increase toothbrushing behaviors for caregivers in oral hygiene care for children aged 6 months to 36 months without in-person training during the COVID-19 pandemic.

Methods

A pre-post design was used in both studies. The effectiveness was evaluated among caregivers in terms of oral hygiene practices, knowledge, and oral health care perceptions based on PMT. In Study I, participants received in-person training and a 21-day chatbot course during October 2018 to February 2019. In Study II, participants received only daily chatbot programming for 30 days during December 2021 to February 2022. Data were gathered at baseline of each study and at 30 days and 60 days after the start of Study I and Study II, respectively. After completing their interventions, the chatbot's usability was assessed using open-ended questions. Study I evaluated the plaque score, whereas Study II included an in-depth interview. The 2 studies were compared to determine the feasibility of using the 30-Day FunDee chatbot as an alternative to in-person training.

Results

There were 71 pairs of participants: 37 in Study I and 34 in Study II. Both chatbots significantly improved overall knowledge (Study I: P<.001; Study II: P=.001), overall oral health care perceptions based on PMT (Study I: P<.001; Study II: P<.001), and toothbrushing for children by caregivers (Study I: P=.02; Study II: P=.04). Only Study I had statistically significant differences in toothbrushing at least twice a day (P=.002) and perceived vulnerability (P=.003). The highest overall chatbot satisfaction was 9.2 (SD 0.9) in Study I and 8.6 (SD 1.2) in Study II. In Study I, plaque levels differed significantly (P<.001).

Conclusions

This was the first study using a chatbot in oral health education. We established the effectiveness and usability of 2 chatbot programs for promoting oral hygiene care of young children by caregivers. The 30-Day FunDee chatbot showed the possibility of improving toothbrushing skills without requiring in-person training.

Trial Registration

Thai Clinical Trials Registry TCTR20191223005; http://www.thaiclinicaltrials.org/show/TCTR20191223005 and TCTR20210927004; https://www.thaiclinicaltrials.org/show/TCTR20210927004