TensioBot: a Chatbot Assistant for Self-Managed in-House Blood Pressure Checking

Effect of telemonitoring and home blood pressure monitoring on blood pressure reduction in hypertensive adults: a network meta-analysis

INTRODUCTION

Telemonitoring and home blood pressure monitoring (HBPM) are becoming popular approaches for managing hypertension. They are believed to improve patient compliance as compared to the usual care monitoring. This network meta-analysis was undertaken to compare blood pressure (BP) reduction following telemonitoring, HBPM and usual care BP monitoring approaches.

METHODS

PubMed and clinicaltrial.gov were searched till 15 May 2024 for randomized controlled trials (RCTs) comparing telemonitoring, HBPM and usual care monitoring for reduction in BP and the postintervention BP in hypertensive adults.

RESULTS

A network meta-analysis with 24 RCTs was performed using MetaInsight. Telemonitoring produced a significantly greater reduction in the systolic blood pressure (SBP) (-3.69 mmHg [95% CI -5.82; -1.57, P < 0.001]) and the diastolic blood pressure (DBP) (-1.82 mmHg [95% CI -2.98 to -0.67, P < 0.001]) as compared to the usual care monitoring. Home BP monitoring also produced a greater lowering of SBP (-2.73 mmHg [95% CI -5.69 to 0.22, P = 0.069]) and DBP (-2.09 mm Hg [95% CI -3.66 to -0.52, P < 0.001]) than usual care, with a significant reduction in the DBP alone. The postintervention SBP and DBP were also lower in the telemonitoring and the HBPM groups than the usual care group. However, there was no significant difference between the SBP and the DBP reductions in the telemonitoring and the HBPM groups.

CONCLUSION

Telemonitoring and HBPM may be more useful in controlling BP as compared to usual care management alone. However, more direct studies comparing telemonitoring with HBPM are needed in the future.

Chatbot -assisted self-assessment (CASA): Co-designing an AI -powered behaviour change intervention for ethnic minorities

BACKGROUND

The digitalisation of healthcare has provided new ways to address disparities in sexual health outcomes that particularly affect ethnic and sexual minorities. Conversational artificial intelligence (AI) chatbots can provide personalised health education and refer users for appropriate medical consultations. We aimed to explore design principles of a chatbot-assisted culturally sensitive self-assessment intervention based on the disclosure of health-related information.

METHODS

In 2022, an online survey was conducted among an ethnically diverse UK sample (N = 1,287) to identify the level and type of health-related information disclosure to sexual health chatbots, and reactions to chatbots' risk appraisal. Follow-up interviews (N = 41) further explored perceptions of chatbot-led health assessment to identify aspects related to acceptability and utilisation. Datasets were analysed using one-way ANOVAs, linear regression, and thematic analysis.

RESULTS

Participants had neutral-to-positive attitudes towards chatbots and were comfortable disclosing demographic and sensitive health information. Chatbot awareness, previous experience and positive attitudes towards chatbots predicted information disclosure. Qualitatively, four main themes were identified: "Chatbot as an artificial health advisor", "Disclosing information to a chatbot", "Ways to facilitate trust and disclosure", and "Acting on self-assessment".

CONCLUSION

Chatbots were acceptable for health self-assessment among this sample of ethnically diverse individuals. Most users reported being comfortable disclosing sensitive and personal information, but user anonymity is key to engagement with chatbots. As this technology becomes more advanced and widely available, chatbots could potentially become supplementary tools for health education and screening eligibility assessment. Future research is needed to establish their impact on screening uptake and access to health services among minoritised communities.

A systematic review of artificial intelligence-powered (AI-powered) chatbot intervention for managing chronic illness

BACKGROUND

Utilizing artificial intelligence (AI) in chatbots, especially for chronic diseases, has become increasingly prevalent. These AI-powered chatbots serve as crucial tools for enhancing patient communication, addressing the rising prevalence of chronic conditions, and meeting the growing demand for supportive healthcare applications. However, there is a notable gap in comprehensive reviews evaluating the impact of AI-powered chatbot interventions in healthcare within academic literature. This study aimed to assess user satisfaction, intervention efficacy, and the specific characteristics and AI architectures of chatbot systems designed for chronic diseases.

METHOD

A thorough exploration of the existing literature was undertaken by employing diverse databases such as PubMed MEDLINE, CINAHL, EMBASE, PsycINFO, ACM Digital Library and Scopus. The studies incorporated in this analysis encompassed primary research that employed chatbots or other forms of AI architecture in the context of preventing, treating or rehabilitating chronic diseases. The assessment of bias risk was conducted using Risk of 2.0 Tools.

RESULTS

Seven hundred and eighty-four results were obtained, and subsequently, eight studies were found to align with the inclusion criteria. The intervention methods encompassed health education (n = 3), behaviour change theory (n = 1), stress and coping (n = 1), cognitive behavioural therapy (n = 2) and self-care behaviour (n = 1). The research provided valuable insights into the effectiveness and user-friendliness of AI-powered chatbots in handling various chronic conditions. Overall, users showed favourable acceptance of these chatbots for self-managing chronic illnesses.

CONCLUSIONS

The reviewed studies suggest promising acceptance of AI-powered chatbots for self-managing chronic conditions. However, limited evidence on their efficacy due to insufficient technical documentation calls for future studies to provide detailed descriptions and prioritize patient safety. These chatbots employ natural language processing and multimodal interaction. Subsequent research should focus on evidence-based evaluations, facilitating comparisons across diverse chronic health conditions.

Engagement With Conversational Agent-Enabled Interventions in Cardiometabolic Disease Management: Protocol for a Systematic Review

BACKGROUND

Cardiometabolic diseases (CMDs) are a group of interrelated conditions, including heart failure and diabetes, that increase the risk of cardiovascular and metabolic complications. The rising number of Australians with CMDs has necessitated new strategies for those managing these conditions, such as digital health interventions. The effectiveness of digital health interventions in supporting people with CMDs is dependent on the extent to which users engage with the tools. Augmenting digital health interventions with conversational agents, technologies that interact with people using natural language, may enhance engagement because of their human-like attributes. To date, no systematic review has compiled evidence on how design features influence the engagement of conversational agent-enabled interventions supporting people with CMDs. This review seeks to address this gap, thereby guiding developers in creating more engaging and effective tools for CMD management.

OBJECTIVE

The aim of this systematic review is to synthesize evidence pertaining to conversational agent-enabled intervention design features and their impacts on the engagement of people managing CMD.

METHODS

The review is conducted in accordance with the Cochrane Handbook for Systematic Reviews of Interventions and reported in accordance with PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Searches will be conducted in the Ovid (Medline), Web of Science, and Scopus databases, which will be run again prior to manuscript submission. Inclusion criteria will consist of primary research studies reporting on conversational agent-enabled interventions, including measures of engagement, in adults with CMD. Data extraction will seek to capture the perspectives of people with CMD on the use of conversational agent-enabled interventions. Joanna Briggs Institute critical appraisal tools will be used to evaluate the overall quality of evidence collected.

RESULTS

This review was initiated in May 2023 and was registered with the International Prospective Register of Systematic Reviews (PROSPERO) in June 2023, prior to title and abstract screening. Full-text screening of articles was completed in July 2023 and data extraction began August 2023. Final searches were conducted in April 2024 prior to finalizing the review and the manuscript was submitted for peer review in July 2024.

CONCLUSIONS

This review will synthesize diverse observations pertaining to conversational agent-enabled intervention design features and their impacts on engagement among people with CMDs. These observations can be used to guide the development of more engaging conversational agent-enabled interventions, thereby increasing the likelihood of regular intervention use and improved CMD health outcomes. Additionally, this review will identify gaps in the literature in terms of how engagement is reported, thereby highlighting areas for future exploration and supporting researchers in advancing the understanding of conversational agent-enabled interventions.

TRIAL REGISTRATION

PROSPERO CRD42023431579; https://tinyurl.com/55cxkm26.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/52973.

Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review

BACKGROUND

Chatbots, or conversational agents, have emerged as significant tools in health care, driven by advancements in artificial intelligence and digital technology. These programs are designed to simulate human conversations, addressing various health care needs. However, no comprehensive synthesis of health care chatbots' roles, users, benefits, and limitations is available to inform future research and application in the field.

OBJECTIVE

This review aims to describe health care chatbots' characteristics, focusing on their diverse roles in the health care pathway, user groups, benefits, and limitations.

METHODS

A rapid review of published literature from 2017 to 2023 was performed with a search strategy developed in collaboration with a health sciences librarian and implemented in the MEDLINE and Embase databases. Primary research studies reporting on chatbot roles or benefits in health care were included. Two reviewers dual-screened the search results. Extracted data on chatbot roles, users, benefits, and limitations were subjected to content analysis.

RESULTS

The review categorized chatbot roles into 2 themes: delivery of remote health services, including patient support, care management, education, skills building, and health behavior promotion, and provision of administrative assistance to health care providers. User groups spanned across patients with chronic conditions as well as patients with cancer; individuals focused on lifestyle improvements; and various demographic groups such as women, families, and older adults. Professionals and students in health care also emerged as significant users, alongside groups seeking mental health support, behavioral change, and educational enhancement. The benefits of health care chatbots were also classified into 2 themes: improvement of health care quality and efficiency and cost-effectiveness in health care delivery. The identified limitations encompassed ethical challenges, medicolegal and safety concerns, technical difficulties, user experience issues, and societal and economic impacts.

CONCLUSIONS

Health care chatbots offer a wide spectrum of applications, potentially impacting various aspects of health care. While they are promising tools for improving health care efficiency and quality, their integration into the health care system must be approached with consideration of their limitations to ensure optimal, safe, and equitable use.

Opportunities and Risks of Large Language Models in Psychiatry

The integration of Large Language Models (LLMs) into mental healthcare and research heralds a potentially transformative shift, one offering enhanced access to care, efficient data collection, and innovative therapeutic tools. This paper reviews the development, function, and burgeoning use of LLMs in psychiatry, highlighting their potential to enhance mental healthcare through improved diagnostic accuracy, personalized care, and streamlined administrative processes. It is also acknowledged that LLMs introduce challenges related to computational demands, potential for misinterpretation, and ethical concerns, necessitating the development of pragmatic frameworks to ensure their safe deployment. We explore both the promise of LLMs in enriching psychiatric care and research through examples such as predictive analytics and therapy chatbots and risks including labor substitution, privacy concerns, and the necessity for responsible AI practices. We conclude by advocating for processes to develop responsible guardrails, including red teaming, multi-stakeholder oriented safety, and ethical guidelines/frameworks, to mitigate risks and harness the full potential of LLMs for advancing mental health.

Depiction of conversational agents as health professionals: a scoping review

OBJECTIVE

The purpose of this scoping review was to examine the depiction of conversational agents as health professionals. We identified the professional characteristics that are used with these depictions and determined the prevalence of these characteristics among conversational agents that are used for health care.

INTRODUCTION

The depiction of conversational agents as health professionals has implications for both the users and the developers of these programs. For this reason, it is important to know more about these depictions and how they are implemented in practical settings.

INCLUSION CRITERIA

This review included scholarly literature on conversational agents that are used for health care. It focused on conversational agents designed for patients and health seekers, not health professionals or trainees. Conversational agents that address physical and/or mental health care were considered, as were programs that promote healthy behaviors.

METHODS

This review was conducted in accordance with JBI methodology for scoping reviews. The databases searched included MEDLINE (PubMed), Embase, CINAHL with Full Text (EBSCOhost), Scopus, Web of Science, ACM Guide to Computing Literature (Association for Computing Machinery Digital Library), and IEEE Xplore (IEEE). The main database search was conducted in June 2021, and an updated search was conducted in January 2022. Extracted data included characteristics of the report, basic characteristics of the conversational agent, and professional characteristics of the conversational agent. Extracted data were summarized using descriptive statistics. Results are presented in a narrative summary and accompanying tables.

RESULTS

A total of 38 health-related conversational agents were identified across 41 reports. Six of these conversational agents (15.8%) had professional characteristics. Four conversational agents (10.5%) had a professional appearance in which they displayed the clothing and accessories of health professionals and appeared in professional settings. One conversational agent (2.6%) had a professional title (Dr), and 4 conversational agents (10.5%) were described as having professional roles. Professional characteristics were more common among embodied vs disembodied conversational agents.

CONCLUSIONS

The results of this review show that the depiction of conversational agents as health professionals is not particularly common, although it does occur. More discussion is needed on the potential ethical and legal issues surrounding the depiction of conversational agents as health professionals. Future research should examine the impact of these depictions, as well as people's attitudes toward them, to better inform recommendations for practice.

Unlocking human-like conversations: Scoping review of automation techniques for personalized healthcare interventions using conversational agents

BACKGROUND

Conversational agents (CAs) offer a sustainable approach to deliver personalized interventions and improve health outcomes.

OBJECTIVES

To review how human-like communication and automation techniques of CAs in personalized healthcare interventions have been implemented. It is intended for designers and developers, computational scientists, behavior scientists, and biomedical engineers who aim at developing CAs for healthcare interventions.

METHODOLOGY

A scoping review was conducted in accordance with PRISMA Extension for Scoping Review. A search was performed in May 2023 in Web of Science, Pubmed, Scopus and IEEE databases. Search results were extracted, duplicates removed, and the remaining results were screened. Studies that contained personalized and automated CAs within the healthcare domain were included. Information regarding study characterization, and human-like communication and automation techniques was extracted from articles that met the eligibility criteria.

RESULTS

Twenty-three studies were selected. These articles described the development of CAs designed for patients to either self-manage their diseases (such as diabetes, mental health issues, cancer, asthma, COVID-19, and other chronic conditions) or to enhance healthy habits. The human-like communication characteristics studied encompassed aspects like system flexibility, personalization, and affective characteristics. Seven studies used rule-based models, eleven applied retrieval-based techniques for content delivery, five used AI models, and six integrated affective computing.

CONCLUSIONS

The increasing interest in employing CAs for personalized healthcare interventions is noteworthy. The adaptability of dialogue structures and personalization features is still limited. Unlocking human-like conversations may encompass the use of affective computing and generative AI to help improve user engagement. Future research should focus on the integration of holistic methods to describe the end-user, and the safe use of generative models.

Patient Engagement with Conversational Agents in Health Applications 2016-2022: A Systematic Review and Meta-Analysis

Clinicians and patients seeking electronic health applications face challenges in selecting effective solutions due to a high market failure rate. Conversational agent applications ("chatbots") show promise in increasing healthcare user engagement by creating bonds between the applications and users. It is unclear if chatbots improve patient adherence or if past trends to include chatbots in electronic health applications were due to technology hype dynamics and competitive pressure to innovate. We conducted a systematic literature review using Preferred Reporting Items for Systematic reviews and Meta-Analyses methodology on health chatbot randomized control trials. The goal of this review was to identify if user engagement indicators are published in eHealth chatbot studies. A meta-analysis examined patient clinical trial retention of chatbot apps. The results showed no chatbot arm patient retention effect. The small number of studies suggests a need for ongoing eHealth chatbot research, especially given the claims regarding their effectiveness made outside the scientific literatures.

Technological Innovations to Improve Patient Engagement in Nephrology

Technological innovation has accelerated exponentially over the last 2 decades. From the rise of smartphones and social media in the early 2000s to the mainstream accessibility of artificial intelligence (AI) in 2023, digital advancements have transformed the way we live and work. These innovations have permeated health care, covering a spectrum of applications from virtual reality training platforms to AI-powered clinical decision support tools. In this review, we explore fascinating recent innovations that have and can facilitate patient engagement in nephrology. These include integrated care mobile applications, wearable health monitoring tools, virtual/augmented reality consultation and education platforms, AI-powered appointment booking systems, and patient information tools. We also discuss potential pitfalls in implementation and paradigms to adopt that may protect patients from unintended consequences of being cared for in a digitalized health care system.

Democratizing the Development of Chatbots to Improve Public Health: Feasibility Study of COVID-19 Misinformation

BACKGROUND

Chatbots enable users to have humanlike conversations on various topics and can vary widely in complexity and functionality. An area of research priority in chatbots is democratizing chatbots to all, removing barriers to entry, such as financial ones, to help make chatbots a possibility for the wider global population to improve access to information, help reduce the digital divide between nations, and improve areas of public good (eg, health communication). Chatbots in this space may help create the potential for improved health outcomes, potentially alleviating some of the burdens on health care providers and systems to be the sole voices of outreach to public health.

OBJECTIVE

This study explored the feasibility of developing a chatbot using approaches that are accessible in low- and middle-resource settings, such as using technology that is low cost, can be developed by nonprogrammers, and can be deployed over social media platforms to reach the broadest-possible audience without the need for a specialized technical team.

METHODS

This study is presented in 2 parts. First, we detailed the design and development of a chatbot, VWise, including the resources used and development considerations for the conversational model. Next, we conducted a case study of 33 participants who engaged in a pilot with our chatbot. We explored the following 3 research questions: (1) Is it feasible to develop and implement a chatbot addressing a public health issue with only minimal resources? (2) What is the participants' experience with using the chatbot? (3) What kinds of measures of engagement are observed from using the chatbot?

RESULTS

A high level of engagement with the chatbot was demonstrated by the large number of participants who stayed with the conversation to its natural end (n=17, 52%), requested to see the free online resource, selected to view all information about a given concern, and returned to have a dialogue about a second concern (n=12, 36%).

CONCLUSIONS

This study explored the feasibility of and the design and development considerations for a chatbot, VWise. Our early findings from this initial pilot suggest that developing a functioning and low-cost chatbot is feasible, even in low-resource environments. Our results show that low-resource environments can enter the health communication chatbot space using readily available human and technical resources. However, despite these early indicators, many limitations exist in this study and further work with a larger sample size and greater diversity of participants is needed. This study represents early work on a chatbot in its virtual infancy. We hope this study will help provide those who feel chatbot access may be out of reach with a useful guide to enter this space, enabling more democratized access to chatbots for all.

The Intersection of ChatGPT, Clinical Medicine, and Medical Education

As we progress deeper into the digital age, the robust development and application of advanced artificial intelligence (AI) technology, specifically generative language models like ChatGPT (OpenAI), have potential implications in all sectors including medicine. This viewpoint article aims to present the authors' perspective on the integration of AI models such as ChatGPT in clinical medicine and medical education. The unprecedented capacity of ChatGPT to generate human-like responses, refined through Reinforcement Learning with Human Feedback, could significantly reshape the pedagogical methodologies within medical education. Through a comprehensive review and the authors' personal experiences, this viewpoint article elucidates the pros, cons, and ethical considerations of using ChatGPT within clinical medicine and notably, its implications for medical education. This exploration is crucial in a transformative era where AI could potentially augment human capability in the process of knowledge creation and dissemination, potentially revolutionizing medical education and clinical practice. The importance of maintaining academic integrity and professional standards is highlighted. The relevance of establishing clear guidelines for the responsible and ethical use of AI technologies in clinical medicine and medical education is also emphasized.

Older adults' intention to use voice assistants: Usability and emotional needs

Population aging is a global problem, and improving the well-being of older adults is an urgent issue. Voice assistants (VAs) offer hands-free voice control and friendly human-computer interaction, making them a significant solution to address the aging problem. Most extant research on VAs is fragmented, and there are relatively few studies conducted from the perspective of emotional needs. This work proposes a comprehensive research model extending the technology acceptance model (TAM) by incorporating the influencing factors subordinate to two research directions: usability and emotional needs. Usability needs include three factors: perceived convenience, security/privacy, and Internet self-efficacy. Emotional needs include humanized interaction, perceived enjoyment, and perceived companionship. A structural equation model (SEM) was used to validate the model empirically with a sample of 425 older users of VAs. The analysis results are quite consistent with the research assumptions, and the findings illustrate that companionship is the most critical factor affecting older adults' intention to adopt VA use, which demonstrates the pivotal role of VAs in meeting the emotional needs of the elderly. The most unexpected observation was seen for the relationship between perceived ease of use and behavioral intention, which was non-significant. This result confirms that when a technology is perceived as very easy to use, perceived ease of use has little to no impact on individuals' intention to use that technology. The novelty of this study lies in the investigation of older adults' behavioral intentions toward using VAs, providing valuable insights for the design and development of VAs tailored for the elderly population. Beyond the academic realm, this research serves as direct inspiration for designers, developers, and policymakers in the fields of assistive technologies and geriatric care. It offers practical insights into creating VAs that effectively address the emotional needs of older adults and enhance their quality of life. Furthermore, elderly individuals are poised to experience significant benefits from the outcomes of this study，the insights garnered from this study empower the elderly to embrace technological advancements that align with their preferences and comfort levels. This study contributes to a more comprehensive understanding of VAs and their potential to enhance the well-being of older adults, while also paving the way for future investigations in this domain. As underscored by this study's emphasis on the significance of emotional needs in technology acceptance, it encourages the adoption of more user-centered design strategies in the development of future VAs.

Conversational Agents in Health Care: Expert Interviews to Inform the Definition, Classification, and Conceptual Framework

BACKGROUND

Conversational agents (CAs), or chatbots, are computer programs that simulate conversations with humans. The use of CAs in health care settings is recent and rapidly increasing, which often translates to poor reporting of the CA development and evaluation processes and unreliable research findings. We developed and published a conceptual framework, designing, developing, evaluating, and implementing a smartphone-delivered, rule-based conversational agent (DISCOVER), consisting of 3 iterative stages of CA design, development, and evaluation and implementation, complemented by 2 cross-cutting themes (user-centered design and data privacy and security).

OBJECTIVE

This study aims to perform in-depth, semistructured interviews with multidisciplinary experts in health care CAs to share their views on the definition and classification of health care CAs and evaluate and validate the DISCOVER conceptual framework.

METHODS

We conducted one-on-one semistructured interviews via Zoom (Zoom Video Communications) with 12 multidisciplinary CA experts using an interview guide based on our framework. The interviews were audio recorded, transcribed by the research team, and analyzed using thematic analysis.

RESULTS

Following participants' input, we defined CAs as digital interfaces that use natural language to engage in a synchronous dialogue using ≥1 communication modality, such as text, voice, images, or video. CAs were classified by 13 categories: response generation method, input and output modalities, CA purpose, deployment platform, CA development modality, appearance, length of interaction, type of CA-user interaction, dialogue initiation, communication style, CA personality, human support, and type of health care intervention. Experts considered that the conceptual framework could be adapted for artificial intelligence-based CAs. However, despite recent advances in artificial intelligence, including large language models, the technology is not able to ensure safety and reliability in health care settings. Finally, aligned with participants' feedback, we present an updated iteration of the conceptual framework for health care conversational agents (CHAT) with key considerations for CA design, development, and evaluation and implementation, complemented by 3 cross-cutting themes: ethics, user involvement, and data privacy and security.

CONCLUSIONS

We present an expanded, validated CHAT and aim at guiding researchers from a variety of backgrounds and with different levels of expertise in the design, development, and evaluation and implementation of rule-based CAs in health care settings.

A chatbot for hypertension self-management support: user-centered design, development, and usability testing

Objectives

Health-related chatbots have demonstrated early promise for improving self-management behaviors but have seldomly been utilized for hypertension. This research focused on the design, development, and usability evaluation of a chatbot for hypertension self-management, called "Medicagent."

Materials and Methods

A user-centered design process was used to iteratively design and develop a text-based chatbot using Google Cloud's Dialogflow natural language understanding platform. Then, usability testing sessions were conducted among patients with hypertension. Each session was comprised of: (1) background questionnaires, (2) 10 representative tasks within Medicagent, (3) System Usability Scale (SUS) questionnaire, and (4) a brief semi-structured interview. Sessions were video and audio recorded using Zoom. Qualitative and quantitative analyses were used to assess effectiveness, efficiency, and satisfaction of the chatbot.

Results

Participants (n = 10) completed nearly all tasks (98%, 98/100) and spent an average of 18 min (SD = 10 min) interacting with Medicagent. Only 11 (8.6%) utterances were not successfully mapped to an intent. Medicagent achieved a mean SUS score of 78.8/100, which demonstrated acceptable usability. Several participants had difficulties navigating the conversational interface without menu and back buttons, felt additional information would be useful for redirection when utterances were not recognized, and desired a health professional persona within the chatbot.

Discussion

The text-based chatbot was viewed favorably for assisting with blood pressure and medication-related tasks and had good usability.

Conclusion

Flexibility of interaction styles, handling unrecognized utterances gracefully, and having a credible persona were highlighted as design components that may further enrich the user experience of chatbots for hypertension self-management.

Conversational Agents and Avatars for Cardiometabolic Risk Factors and Lifestyle-Related Behaviors: Scoping Review

BACKGROUND

In recent years, there has been a rise in the use of conversational agents for lifestyle medicine, in particular for weight-related behaviors and cardiometabolic risk factors. Little is known about the effectiveness and acceptability of and engagement with conversational and virtual agents as well as the applicability of these agents for metabolic syndrome risk factors such as an unhealthy dietary intake, physical inactivity, diabetes, and hypertension.

OBJECTIVE

This review aimed to get a greater understanding of the virtual agents that have been developed for cardiometabolic risk factors and to review their effectiveness.

METHODS

A systematic review of PubMed and MEDLINE was conducted to review conversational agents for cardiometabolic risk factors, including chatbots and embodied avatars.

RESULTS

A total of 50 studies were identified. Overall, chatbots and avatars appear to have the potential to improve weight-related behaviors such as dietary intake and physical activity. There were limited studies on hypertension and diabetes. Patients seemed interested in using chatbots and avatars for modifying cardiometabolic risk factors, and adherence was acceptable across the studies, except for studies of virtual agents for diabetes. However, there is a need for randomized controlled trials to confirm this finding. As there were only a few clinical trials, more research is needed to confirm whether conversational coaches may assist with cardiovascular disease and diabetes, and physical activity.

CONCLUSIONS

Conversational coaches may regulate cardiometabolic risk factors; however, quality trials are needed to expand the evidence base. A future chatbot could be tailored to metabolic syndrome specifically, targeting all the areas covered in the literature, which would be novel.

Feasibility and effectiveness of artificial intelligence-driven conversational agents in healthcare interventions: A systematic review of randomized controlled trials

BACKGROUND

A virtual conversational agent is a program that typically utilizes artificial intelligence technology to mimic human interactions. Many robust and high-quality clinical trials have been conducted to test the effectiveness of conversational agent-based interventions. However, there is a lack of systematic reviews of randomized controlled trials that evaluate the effects of artificial intelligence-driven conversational agents in healthcare interventions.

OBJECTIVE

To examine the feasibility and effectiveness of conversational agent-based interventions evaluated by randomized controlled trials in the healthcare context, as well as to evaluate the information quality of artificial intelligence-driven conversational agents.

DESIGN

A systematic review.

DATA SOURCE

A systematic search of relevant literature published in English in Scopus, Pubmed, Embase, PsycINFO, Cochrane Library, Information Science & Technology, and Web of Science, was performed. Only randomized controlled trials from the inception of the databases until May 2022 were included.

REVIEW METHODS

Two reviewers independently selected the articles according to the inclusion and exclusion criteria. Study findings were narratively synthesized and summarized. The studies' risk of bias was evaluated using the Risk of Bias 2.0 tool. The Silberg Scale was used to evaluate the quality of the conversational agent system utilized in each reviewed study.

RESULTS

Twenty-one studies were included in the data synthesis. The recruitment rates ranged from 34% to 100% (mean = 84%), and completion rates ranged from 40% to 100% (mean = 83%). A moderate to high level of intervention acceptability was reported. The intervention approaches included health counseling and education (n = 8), cognitive-behavioral interventions (n = 7), storytelling (n = 1), acceptance and commitment therapy (n = 1), and coping skills training (n = 1). Findings indicated inconsistent effects on improving participants' physical activity and function, healthy lifestyle modifications, knowledge of the diseases, and mental health and psychosocial outcomes. The overall risk of bias varied from low risk (n = 6) to high risk (n = 7) across the studies. The mean Silberg score of included studies was 5.4/9, with a standard deviation of 1.6.

CONCLUSION

Our review findings indicated that conversational agent-based interventions were feasible, acceptable, and had positive effects on physical functioning, healthy lifestyle, mental health and psychosocial outcomes. Conversational agents can provide low-threshold access to healthcare services. They can serve as remote medical assistants to support patients' recovery or health promotion needs before or after medical treatments. The conversational agent-based interventions can also play adjunctive roles and be integrated into current healthcare systems, which could improve the comprehensiveness of services and make more efficient use of physicians' and nurses' time.

Evaluation of chatbot-delivered interventions for self-management of depression: Content analysis

BACKGROUND

Conversational agents (CAs) or chatbots are increasingly used for depression, anxiety, and wellbeing management. CAs are considered acceptable and helpful. However, little is known about the adequacy of CA responses. This study assessed the structure, content, and user-customization of mental health CA dialogues with users with depression or at risk of suicide.

METHODS

We used content analysis to examine the dialogues of CAs previously included in three assessments of mental health apps (depression education, self-guided cognitive behavioural therapy, and suicide prevention) performed between 2019 and 2020. Two standardized user personas with depression were developed to interact with the CA. All conversations were saved as screenshots, transcribed verbatim, and coded inductively.

RESULTS

Nine CAs were included. Seven CAs (78%) had Android and iOS versions; five CAs (56%) had at least 500,000 downloads. The analysis generated eight categories: self-introduction, personalization, appropriateness of CA responses, conveying empathy, guiding users through mood-boosting activities, mood monitoring, suicide risk management, and others. CAs could engage in empathic, non-judgemental conversations with users, offer support, and guide psychotherapeutic exercises.

LIMITATIONS

CA evaluations were performed using standardized personas, not real-world users. CAs were included for evaluation only if retrieved in the search strategies associated with the previous assessment studies.

CONCLUSION

Assessed CAs offered anonymous, empathic, non-judgemental interactions that align with evidence for face-to-face psychotherapy. CAs from app stores are not suited to provide comprehensive suicide risk management. Further research should evaluate the effectiveness of CA-led interventions in mental health care and in enhancing suicide risk management strategies.

The Development and Use of Chatbots in Public Health: Scoping Review

BACKGROUND

Chatbots are computer programs that present a conversation-like interface through which people can access information and services. The COVID-19 pandemic has driven a substantial increase in the use of chatbots to support and complement traditional health care systems. However, despite the uptake in their use, evidence to support the development and deployment of chatbots in public health remains limited. Recent reviews have focused on the use of chatbots during the COVID-19 pandemic and the use of conversational agents in health care more generally. This paper complements this research and addresses a gap in the literature by assessing the breadth and scope of research evidence for the use of chatbots across the domain of public health.

OBJECTIVE

This scoping review had 3 main objectives: (1) to identify the application domains in public health in which there is the most evidence for the development and use of chatbots; (2) to identify the types of chatbots that are being deployed in these domains; and (3) to ascertain the methods and methodologies by which chatbots are being evaluated in public health applications. This paper explored the implications for future research on the development and deployment of chatbots in public health in light of the analysis of the evidence for their use.

METHODS

Following the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) guidelines for scoping reviews, relevant studies were identified through searches conducted in the MEDLINE, PubMed, Scopus, Cochrane Central Register of Controlled Trials, IEEE Xplore, ACM Digital Library, and Open Grey databases from mid-June to August 2021. Studies were included if they used or evaluated chatbots for the purpose of prevention or intervention and for which the evidence showed a demonstrable health impact.

RESULTS

Of the 1506 studies identified, 32 were included in the review. The results show a substantial increase in the interest of chatbots in the past few years, shortly before the pandemic. Half (16/32, 50%) of the research evaluated chatbots applied to mental health or COVID-19. The studies suggest promise in the application of chatbots, especially to easily automated and repetitive tasks, but overall, the evidence for the efficacy of chatbots for prevention and intervention across all domains is limited at present.

CONCLUSIONS

More research is needed to fully understand the effectiveness of using chatbots in public health. Concerns with the clinical, legal, and ethical aspects of the use of chatbots for health care are well founded given the speed with which they have been adopted in practice. Future research on their use should address these concerns through the development of expertise and best practices specific to public health, including a greater focus on user experience.

Designing, Developing, Evaluating, and Implementing a Smartphone-Delivered, Rule-Based Conversational Agent (DISCOVER): Development of a Conceptual Framework

BACKGROUND

Conversational agents (CAs), also known as chatbots, are computer programs that simulate human conversations by using predetermined rule-based responses or artificial intelligence algorithms. They are increasingly used in health care, particularly via smartphones. There is, at present, no conceptual framework guiding the development of smartphone-based, rule-based CAs in health care. To fill this gap, we propose structured and tailored guidance for their design, development, evaluation, and implementation.

OBJECTIVE

The aim of this study was to develop a conceptual framework for the design, evaluation, and implementation of smartphone-delivered, rule-based, goal-oriented, and text-based CAs for health care.

METHODS

We followed the approach by Jabareen, which was based on the grounded theory method, to develop this conceptual framework. We performed 2 literature reviews focusing on health care CAs and conceptual frameworks for the development of mobile health interventions. We identified, named, categorized, integrated, and synthesized the information retrieved from the literature reviews to develop the conceptual framework. We then applied this framework by developing a CA and testing it in a feasibility study.

RESULTS

The Designing, Developing, Evaluating, and Implementing a Smartphone-Delivered, Rule-Based Conversational Agent (DISCOVER) conceptual framework includes 8 iterative steps grouped into 3 stages, as follows: design, comprising defining the goal, creating an identity, assembling the team, and selecting the delivery interface; development, including developing the content and building the conversation flow; and the evaluation and implementation of the CA. They were complemented by 2 cross-cutting considerations-user-centered design and privacy and security-that were relevant at all stages. This conceptual framework was successfully applied in the development of a CA to support lifestyle changes and prevent type 2 diabetes.

CONCLUSIONS

Drawing on published evidence, the DISCOVER conceptual framework provides a step-by-step guide for developing rule-based, smartphone-delivered CAs. Further evaluation of this framework in diverse health care areas and settings and for a variety of users is needed to demonstrate its validity. Future research should aim to explore the use of CAs to deliver health care interventions, including behavior change and potential privacy and safety concerns.

Conversational Agents in Health Care: Scoping Review of Their Behavior Change Techniques and Underpinning Theory

BACKGROUND

Conversational agents (CAs) are increasingly used in health care to deliver behavior change interventions. Their evaluation often includes categorizing the behavior change techniques (BCTs) using a classification system of which the BCT Taxonomy v1 (BCTTv1) is one of the most common. Previous studies have presented descriptive summaries of behavior change interventions delivered by CAs, but no in-depth study reporting the use of BCTs in these interventions has been published to date.

OBJECTIVE

This review aims to describe behavior change interventions delivered by CAs and to identify the BCTs and theories guiding their design.

METHODS

We searched PubMed, Embase, Cochrane's Central Register of Controlled Trials, and the first 10 pages of Google and Google Scholar in April 2021. We included primary, experimental studies evaluating a behavior change intervention delivered by a CA. BCTs coding followed the BCTTv1. Two independent reviewers selected the studies and extracted the data. Descriptive analysis and frequent itemset mining to identify BCT clusters were performed.

RESULTS

We included 47 studies reporting on mental health (n=19, 40%), chronic disorders (n=14, 30%), and lifestyle change (n=14, 30%) interventions. There were 20/47 embodied CAs (43%) and 27/47 CAs (57%) represented a female character. Most CAs were rule based (34/47, 72%). Experimental interventions included 63 BCTs, (mean 9 BCTs; range 2-21 BCTs), while comparisons included 32 BCTs (mean 2 BCTs; range 2-17 BCTs). Most interventions included BCTs 4.1 "Instruction on how to perform a behavior" (34/47, 72%), 3.3 "Social support" (emotional; 27/47, 57%), and 1.2 "Problem solving" (24/47, 51%). A total of 12/47 studies (26%) were informed by a behavior change theory, mainly the Transtheoretical Model and the Social Cognitive Theory. Studies using the same behavior change theory included different BCTs.

CONCLUSIONS

There is a need for the more explicit use of behavior change theories and improved reporting of BCTs in CA interventions to enhance the analysis of intervention effectiveness and improve the reproducibility of research.

Answering hospital caregivers' questions at any time: proof of concept of an artificial intelligence-based chatbot in a French hospital

Background

Access to accurate information in health care is a key point for caregivers to avoid medication errors, especially with the reorganization of staff and drug circuits during health crises such as the COVID‑19 pandemic. It is, therefore, the role of the hospital pharmacy to answer caregivers’ questions. Some may require the expertise of a pharmacist, some should be answered by pharmacy technicians, but others are simple and redundant, and automated responses may be provided.

Objective

We aimed at developing and implementing a chatbot to answer questions from hospital caregivers about drugs and pharmacy organization 24 hours a day and to evaluate this tool.

Methods

The ADDIE (Analysis, Design, Development, Implementation, and Evaluation) model was used by a multiprofessional team composed of 3 hospital pharmacists, 2 members of the Innovation and Transformation Department, and the IT service provider. Based on an analysis of the caregivers’ needs about drugs and pharmacy organization, we designed and developed a chatbot. The tool was then evaluated before its implementation into the hospital intranet. Its relevance and conversations with testers were monitored via the IT provider’s back office.

Results

Needs analysis with 5 hospital pharmacists and 33 caregivers from 5 health services allowed us to identify 7 themes about drugs and pharmacy organization (such as opening hours and specific prescriptions). After a year of chatbot design and development, the test version obtained good evaluation scores: its speed was rated 8.2 out of 10, usability 8.1 out of 10, and appearance 7.5 out of 10. Testers were generally satisfied (70%) and were hoping for the content to be enhanced.

Conclusions

The chatbot seems to be a relevant tool for hospital caregivers, helping them obtain reliable and verified information they need on drugs and pharmacy organization. In the context of significant mobility of nursing staff during the health crisis due to the COVID-19 pandemic, the chatbot could be a suitable tool for transmitting relevant information related to drug circuits or specific procedures. To our knowledge, this is the first time that such a tool has been designed for caregivers. Its development further continued by means of tests conducted with other users such as pharmacy technicians and via the integration of additional data before the implementation on the 2 hospital sites.

Conversational Agents in Health Education: Protocol for a Scoping Review

BACKGROUND

Conversational agents have the ability to reach people through multiple mediums, including the online space, mobile phones, and hardware devices like Alexa and Google Home. Conversational agents provide an engaging method of interaction while making information easier to access. Their emergence into areas related to public health and health education is perhaps unsurprising. While the building of conversational agents is getting more simplified with time, there are still requirements of time and effort. There is also a lack of clarity and consistent terminology regarding what constitutes a conversational agent, how these agents are developed, and the kinds of resources that are needed to develop and sustain them. This lack of clarity creates a daunting task for those seeking to build conversational agents for health education initiatives.

OBJECTIVE

This scoping review aims to identify literature that reports on the design and implementation of conversational agents to promote and educate the public on matters related to health. We will categorize conversational agents in health education in alignment with current classifications and terminology emerging from the marketplace. We will clearly define the variety levels of conversational agents, categorize currently existing agents within these levels, and describe the development models, tools, and resources being used to build conversational agents for health care education purposes.

METHODS

This scoping review will be conducted by employing the Arksey and O'Malley framework. We will also be adhering to the enhancements and updates proposed by Levac et al and Peters et al. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) extension for scoping reviews will guide the reporting of this scoping review. A systematic search for published and grey literature will be undertaken from the following databases: (1) PubMed, (2) PsychINFO, (3) Embase, (4) Web of Science, (5) SCOPUS, (6) CINAHL, (7) ERIC, (8) MEDLINE, and (9) Google Scholar. Data charting will be done using a structured format.

RESULTS

Initial searches of the databases retrieved 1305 results. The results will be presented in the final scoping review in a narrative and illustrative manner.

CONCLUSIONS

This scoping review will report on conversational agents being used in health education today, and will include categorization of the levels of the agents and report on the kinds of tools, resources, and design and development methods used.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/31923.