1
|
Dhinagaran DA, Car LT. Public perceptions of a healthy lifestyle change conversational agent in Singapore: A qualitative study. Digit Health 2022; 8:20552076221131190. [PMID: 36267545 PMCID: PMC9578172 DOI: 10.1177/20552076221131190] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2022] [Accepted: 09/20/2022] [Indexed: 11/28/2022] Open
Abstract
OBJECTIVE Conversational agents (CAs) are increasingly used for the delivery of healthy lifestyle behaviour interventions. This qualitative study aimed to explore the barriers and facilitators to participants' usage of a healthy lifestyle change CA and collect their views on areas for its improvement. METHODS Twenty participants were recruited from a convenience sample of users interacting with a CA promoting healthy lifestyle changes to the general population in Singapore. This CA, Precilla, educated users on healthy living, specifically: diet, exercise, sleep and stress; for four weeks. The volunteers participated in semi-structured interviews where an interview guide was used, with questions on acceptability, satisfaction and critical appraisal of the CA. Interviews were transcribed and analysed in parallel by two researchers using thematic content analysis. RESULTS Four main themes were identified: (1) enjoyable and acceptable experiences, (2) suboptimal experience(s), (3) alterations to Precilla for enhanced interaction and (4) suggestions for the future. Enjoyable experiences referenced the CA's friendly personality and important content that motivated a positive change to their lifestyle. Some participants were less satisfied and found the content to be too simple or sometimes, the messages too lengthy. CONCLUSIONS Participants suggested that in the future, CAs should provide regularly updated content on healthy living, specifically pre-diabetes. Multiple answer options should also be provided for more personalisation along with links to external resources to help improve users' health literacy. Further recommendations include a necessity for a user-centered approach in CA development, employment of engagement strategies, use of a delivery platform most familiar to the target population and stratified message timings to suit the population and purpose of CA. Translating the health CAs to languages relevant to the target group could also enable wider reach and applicability.
Collapse
Affiliation(s)
| | - Lorainne Tudor Car
- Lee Kong Chian School of Medicine, Nanyang Technological University Singapore, Singapore,Department of Primary Care and Public Health, School of Public Health, Imperial College London, London, UK,Future Health Technologies, Singapore-ETH Centre, Campus for Research Excellence and Technological Enterprise (CREATE), Singapore,Lorainne Tudor Car, Family Medicine and Primary Care, Lee Kong Chian School of Medicine, Nanyang Technological University Singapore, 11 Mandalay Road, Level 18, Clinical Science Building, 308232, Singapore.
| |
Collapse
|
2
|
Dhinagaran DA, Martinengo L, Ho MHR, Joty S, Kowatsch T, Atun R, Tudor Car L. Designing, Developing, Evaluating, and Implementing a Smartphone-Delivered, Rule-Based Conversational Agent (DISCOVER): Development of a Conceptual Framework. JMIR Mhealth Uhealth 2022; 10:e38740. [PMID: 36194462 PMCID: PMC9579935 DOI: 10.2196/38740] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Revised: 08/02/2022] [Accepted: 08/26/2022] [Indexed: 11/17/2022] Open
Abstract
BACKGROUND Conversational agents (CAs), also known as chatbots, are computer programs that simulate human conversations by using predetermined rule-based responses or artificial intelligence algorithms. They are increasingly used in health care, particularly via smartphones. There is, at present, no conceptual framework guiding the development of smartphone-based, rule-based CAs in health care. To fill this gap, we propose structured and tailored guidance for their design, development, evaluation, and implementation. OBJECTIVE The aim of this study was to develop a conceptual framework for the design, evaluation, and implementation of smartphone-delivered, rule-based, goal-oriented, and text-based CAs for health care. METHODS We followed the approach by Jabareen, which was based on the grounded theory method, to develop this conceptual framework. We performed 2 literature reviews focusing on health care CAs and conceptual frameworks for the development of mobile health interventions. We identified, named, categorized, integrated, and synthesized the information retrieved from the literature reviews to develop the conceptual framework. We then applied this framework by developing a CA and testing it in a feasibility study. RESULTS The Designing, Developing, Evaluating, and Implementing a Smartphone-Delivered, Rule-Based Conversational Agent (DISCOVER) conceptual framework includes 8 iterative steps grouped into 3 stages, as follows: design, comprising defining the goal, creating an identity, assembling the team, and selecting the delivery interface; development, including developing the content and building the conversation flow; and the evaluation and implementation of the CA. They were complemented by 2 cross-cutting considerations-user-centered design and privacy and security-that were relevant at all stages. This conceptual framework was successfully applied in the development of a CA to support lifestyle changes and prevent type 2 diabetes. CONCLUSIONS Drawing on published evidence, the DISCOVER conceptual framework provides a step-by-step guide for developing rule-based, smartphone-delivered CAs. Further evaluation of this framework in diverse health care areas and settings and for a variety of users is needed to demonstrate its validity. Future research should aim to explore the use of CAs to deliver health care interventions, including behavior change and potential privacy and safety concerns.
Collapse
Affiliation(s)
| | - Laura Martinengo
- Lee Kong Chian School of Medicine, Nanyang Technological University Singapore, Singapore, Singapore
| | - Moon-Ho Ringo Ho
- School of Social Sciences, Nanyang Technological University Singapore, Singapore, Singapore
| | - Shafiq Joty
- School of Computer Sciences and Engineering, Nanyang Technological University Singapore, Singapore, Singapore
| | - Tobias Kowatsch
- Institute for Implementation Science in Health Care, University of Zurich, Zurich, Switzerland
- School of Medicine, University of St Gallen, St Gallen, Switzerland
- Centre for Digital Health Interventions, Department of Management, Technology, and Economics, ETH Zurich, Zurich, Switzerland
- Future Health Technologies Programme, Campus for Research Excellence and Technological Enterprise, Singapore-ETH Centre, Singapore, Singapore
| | - Rifat Atun
- Department of Global Health & Population, Department of Health Policy & Management, Harvard TH Chan School of Public Health, Harvard University, Cambridge, MA, United States
- Department of Global Health and Social Medicine, Harvard Medical School, Harvard University, Cambridge, MA, United States
- Health Systems Innovation Lab, Harvard TH Chan School of Public Health, Harvard University, Cambridge, MA, United States
| | - Lorainne Tudor Car
- Lee Kong Chian School of Medicine, Nanyang Technological University Singapore, Singapore, Singapore
- Department of Primary Care and Public Health, School of Public Health, Imperial College London, London, United Kingdom
| |
Collapse
|
3
|
Dhinagaran DA, Sathish T, Soong A, Theng YL, Best J, Tudor Car L. Conversational Agent for Healthy Lifestyle Behavior Change: Web-Based Feasibility Study. JMIR Form Res 2021; 5:e27956. [PMID: 34870611 PMCID: PMC8686401 DOI: 10.2196/27956] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2021] [Revised: 08/09/2021] [Accepted: 08/24/2021] [Indexed: 01/05/2023] Open
Abstract
BACKGROUND The rising incidence of chronic diseases is a growing concern, especially in Singapore, which is one of the high-income countries with the highest prevalence of diabetes. Interventions that promote healthy lifestyle behavior changes have been proven to be effective in reducing the progression of prediabetes to diabetes, but their in-person delivery may not be feasible on a large scale. Novel technologies such as conversational agents are a potential alternative for delivering behavioral interventions that promote healthy lifestyle behavior changes to the public. OBJECTIVE The aim of this study is to assess the feasibility and acceptability of using a conversational agent promoting healthy lifestyle behavior changes in the general population in Singapore. METHODS We performed a web-based, single-arm feasibility study. The participants were recruited through Facebook over 4 weeks. The Facebook Messenger conversational agent was used to deliver the intervention. The conversations focused on diet, exercise, sleep, and stress and aimed to promote healthy lifestyle behavior changes and improve the participants' knowledge of diabetes. Messages were sent to the participants four times a week (once for each of the 4 topics of focus) for 4 weeks. We assessed the feasibility of recruitment, defined as at least 75% (150/200) of our target sample of 200 participants in 4 weeks, as well as retention, defined as 33% (66/200) of the recruited sample completing the study. We also assessed the participants' satisfaction with, and usability of, the conversational agent. In addition, we performed baseline and follow-up assessments of quality of life, diabetes knowledge and risk perception, diet, exercise, sleep, and stress. RESULTS We recruited 37.5% (75/200) of the target sample size in 1 month. Of the 75 eligible participants, 60 (80%) provided digital informed consent and completed baseline assessments. Of these 60 participants, 56 (93%) followed the study through till completion. Retention was high at 93% (56/60), along with engagement, denoted by 50% (30/60) of the participants communicating with the conversational agent at each interaction. Acceptability, usability, and satisfaction were generally high. Preliminary efficacy of the intervention showed no definitive improvements in health-related behavior. CONCLUSIONS The delivery of a conversational agent for healthy lifestyle behavior change through Facebook Messenger was feasible and acceptable. We were unable to recruit our planned sample solely using the free options in Facebook. However, participant retention and conversational agent engagement rates were high. Our findings provide important insights to inform the design of a future randomized controlled trial.
Collapse
Affiliation(s)
| | - Thirunavukkarasu Sathish
- Population Health Research Institute, McMaster University, Hamilton, ON, Canada
- Centre for Population Health Sciences, Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore
| | - AiJia Soong
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore, Singapore
| | - Yin-Leng Theng
- Centre for Healthy and Sustainable Cities, Nanyang Technological University, Singapore, Singapore, Singapore
| | - James Best
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore, Singapore
| | - Lorainne Tudor Car
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore, Singapore
- Department of Primary Care and Public Health, School of Public Health, Imperial College London, London, United Kingdom
| |
Collapse
|
4
|
Dhinagaran DA, Sathish T, Kowatsch T, Griva K, Best JD, Tudor Car L. Public Perceptions of Diabetes, Healthy Living, and Conversational Agents in Singapore: Needs Assessment. JMIR Form Res 2021; 5:e30435. [PMID: 34762053 PMCID: PMC8663498 DOI: 10.2196/30435] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2021] [Revised: 09/09/2021] [Accepted: 09/16/2021] [Indexed: 01/22/2023] Open
Abstract
Background The incidence of chronic diseases such as type 2 diabetes is increasing in countries worldwide, including Singapore. Health professional–delivered healthy lifestyle interventions have been shown to prevent type 2 diabetes. However, ongoing personalized guidance from health professionals is not feasible or affordable at the population level. Novel digital interventions delivered using mobile technology, such as conversational agents, are a potential alternative for the delivery of healthy lifestyle change behavioral interventions to the public. Objective We explored perceptions and experiences of Singaporeans on healthy living, diabetes, and mobile health (mHealth) interventions (apps and conversational agents). This study was conducted to help inform the design and development of a conversational agent focusing on healthy lifestyle changes. Methods This qualitative study was conducted in August and September 2019. A total of 20 participants were recruited from relevant healthy living Facebook pages and groups. Semistructured interviews were conducted in person or over the telephone using an interview guide. Interviews were transcribed and analyzed in parallel by 2 researchers using Burnard’s method, a structured approach for thematic content analysis. Results The collected data were organized into 4 main themes: use of conversational agents, ubiquity of smartphone apps, understanding of diabetes, and barriers and facilitators to a healthy living in Singapore. Most participants used health-related mobile apps as well as conversational agents unrelated to health care. They provided diverse suggestions for future conversational agent-delivered interventions. Participants also highlighted several knowledge gaps in relation to diabetes and healthy living. Regarding barriers to healthy living, participants mentioned frequent dining out, high stress levels, lack of work-life balance, and lack of free time to engage in physical activity. In contrast, discipline, preplanning, and sticking to a routine were important for enabling a healthy lifestyle. Conclusions Participants in this study commonly used mHealth interventions and provided important insights into their knowledge gaps and needs in relation to changes in healthy lifestyle behaviors. Future digital interventions such as conversational agents focusing on healthy lifestyle and diabetes prevention should aim to address the barriers highlighted in our study and motivate individuals to adopt healthy lifestyle behavior.
Collapse
Affiliation(s)
| | - Thirunavukkarasu Sathish
- Population Health Research Institute, McMaster University, Hamilton, ON, Canada.,Centre for Population Health Sciences, Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore
| | - Tobias Kowatsch
- Future Health Technologies Programme, Campus for Research Excellence and Technological Enterprise, Singapore-ETH Centre, Singapore, Singapore.,Centre for Digital Health Interventions, Department of Management, Technology, and Economics, ETH Zurich, Zurich, Switzerland.,Centre for Digital Health Interventions, Institute of Technology Management, University of St Gallen, St Gallen, Switzerland
| | - Konstadina Griva
- Centre for Population Health Sciences, Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore
| | - James Donovan Best
- Lee Kong Chian School of Medicine, Nanyang Technological University Singapore, Singapore, Singapore
| | - Lorainne Tudor Car
- Lee Kong Chian School of Medicine, Nanyang Technological University Singapore, Singapore, Singapore.,Department of Primary Care and Public Health, School of Public Health, Imperial College London, London, United Kingdom
| |
Collapse
|
5
|
Tudor Car L, Dhinagaran DA, Kyaw BM, Kowatsch T, Joty S, Theng YL, Atun R. Conversational Agents in Health Care: Scoping Review and Conceptual Analysis. J Med Internet Res 2020; 22:e17158. [PMID: 32763886 PMCID: PMC7442948 DOI: 10.2196/17158] [Citation(s) in RCA: 131] [Impact Index Per Article: 32.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2019] [Revised: 04/11/2020] [Accepted: 06/13/2020] [Indexed: 12/23/2022] Open
Abstract
BACKGROUND Conversational agents, also known as chatbots, are computer programs designed to simulate human text or verbal conversations. They are increasingly used in a range of fields, including health care. By enabling better accessibility, personalization, and efficiency, conversational agents have the potential to improve patient care. OBJECTIVE This study aimed to review the current applications, gaps, and challenges in the literature on conversational agents in health care and provide recommendations for their future research, design, and application. METHODS We performed a scoping review. A broad literature search was performed in MEDLINE (Medical Literature Analysis and Retrieval System Online; Ovid), EMBASE (Excerpta Medica database; Ovid), PubMed, Scopus, and Cochrane Central with the search terms "conversational agents," "conversational AI," "chatbots," and associated synonyms. We also searched the gray literature using sources such as the OCLC (Online Computer Library Center) WorldCat database and ResearchGate in April 2019. Reference lists of relevant articles were checked for further articles. Screening and data extraction were performed in parallel by 2 reviewers. The included evidence was analyzed narratively by employing the principles of thematic analysis. RESULTS The literature search yielded 47 study reports (45 articles and 2 ongoing clinical trials) that matched the inclusion criteria. The identified conversational agents were largely delivered via smartphone apps (n=23) and used free text only as the main input (n=19) and output (n=30) modality. Case studies describing chatbot development (n=18) were the most prevalent, and only 11 randomized controlled trials were identified. The 3 most commonly reported conversational agent applications in the literature were treatment and monitoring, health care service support, and patient education. CONCLUSIONS The literature on conversational agents in health care is largely descriptive and aimed at treatment and monitoring and health service support. It mostly reports on text-based, artificial intelligence-driven, and smartphone app-delivered conversational agents. There is an urgent need for a robust evaluation of diverse health care conversational agents' formats, focusing on their acceptability, safety, and effectiveness.
Collapse
Affiliation(s)
- Lorainne Tudor Car
- Family Medicine and Primary Care, Lee Kong Chian School of Medicine, Nanyang Technological University Singapore, Singapore
- Department of Primary Care and Public Health, School of Public Health, Imperial College London, London, United Kingdom
| | - Dhakshenya Ardhithy Dhinagaran
- Family Medicine and Primary Care, Lee Kong Chian School of Medicine, Nanyang Technological University Singapore, Singapore
| | - Bhone Myint Kyaw
- Family Medicine and Primary Care, Lee Kong Chian School of Medicine, Nanyang Technological University Singapore, Singapore
| | - Tobias Kowatsch
- Future Health Technologies programme, Campus for Research Excellence and Technological Enterprise (CREATE), Singapore-ETH Centre, Singapore
- Center for Digital Health Interventions, Department of Management, Technology, and Economics, ETH Zurich, Zurich, Switzerland
- Center for Digital Health Interventions, Institute of Technology Management, University of St Gallen, St Gallen, Switzerland
| | - Shafiq Joty
- School of Computer Sciences and Engineering, Nanyang Technological University Singapore, Singapore
| | - Yin-Leng Theng
- Centre for Healthy and Sustainable Cities, Nanyang Technological University, Singapore
| | - Rifat Atun
- Department of Global Health and Population, Harvard T.H. Chan School of Public Health, Harvard University, Boston, MA, United States
| |
Collapse
|