1
|
Messner EM, Sturm N, Terhorst Y, Sander LB, Schultchen D, Portenhauser A, Schmidbaur S, Stach M, Klaus J, Baumeister H, Walter BM. Mobile Apps for the Management of Gastrointestinal Diseases: Systematic Search and Evaluation Within App Stores. J Med Internet Res 2022; 24:e37497. [PMID: 36197717 PMCID: PMC9582913 DOI: 10.2196/37497] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2022] [Revised: 05/30/2022] [Accepted: 07/29/2022] [Indexed: 11/29/2022] Open
Abstract
Background Gastrointestinal diseases are associated with substantial cost in health care. In times of the COVID-19 pandemic and further digitalization of gastrointestinal tract health care, mobile health apps could complement routine health care. Many gastrointestinal health care apps are already available in the app stores, but the quality, data protection, and reliability often remain unclear. Objective This systematic review aimed to evaluate the quality characteristics as well as the privacy and security measures of mobile health apps for the management of gastrointestinal diseases. Methods A web crawler systematically searched for mobile health apps with a focus on gastrointestinal diseases. The identified mobile health apps were evaluated using the Mobile Application Rating Scale (MARS). Furthermore, app characteristics, data protection, and security measures were collected. Classic user star rating was correlated with overall mobile health app quality. Results The overall quality of the mobile health apps (N=109) was moderate (mean 2.90, SD 0.52; on a scale ranging from 1 to 5). The quality of the subscales ranged from low (mean 1.89, SD 0.66) to good (mean 4.08, SD 0.57). The security of data transfer was ensured only by 11 (10.1%) mobile health apps. None of the mobile health apps had an evidence base. The user star rating did not correlate with the MARS overall score or with the individual subdimensions of the MARS (all P>.05). Conclusions Mobile health apps might have a positive impact on diagnosis, therapy, and patient guidance in gastroenterology in the future. We conclude that, to date, data security and proof of efficacy are not yet given in currently available mobile health apps.
Collapse
Affiliation(s)
- Eva-Maria Messner
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology and Education, University of Ulm, Ulm, Germany
| | - Niklas Sturm
- Department of Internal Medicine I, University Hospital Ulm, Ulm, Germany
| | - Yannik Terhorst
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology and Education, University of Ulm, Ulm, Germany.,Department of Research Methods, Institute of Psychology and Education, University of Ulm, Ulm, Germany
| | - Lasse B Sander
- Department of Rehabilitation Psychology and Psychotherapy, Institute of Psychology, Albert-Ludwigs-University Freiburg, Freiburg at Breisgau, Germany
| | - Dana Schultchen
- Department of Clinical and Health Psychology, Institute of Psychology and Education, University of Ulm, Ulm, Germany
| | - Alexandra Portenhauser
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology and Education, University of Ulm, Ulm, Germany
| | - Simone Schmidbaur
- Department of Internal Medicine I, University Hospital Ulm, Ulm, Germany
| | - Michael Stach
- Institute of Databases and Information Systems, University of Ulm, Ulm, Germany
| | - Jochen Klaus
- Department of Internal Medicine I, University Hospital Ulm, Ulm, Germany
| | - Harald Baumeister
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology and Education, University of Ulm, Ulm, Germany
| | - Benjamin M Walter
- Department of Internal Medicine I, University Hospital Ulm, Ulm, Germany
| |
Collapse
|
2
|
Terhorst Y, Messner EM, Schultchen D, Paganini S, Portenhauser A, Eder AS, Bauer M, Papenhoff M, Baumeister H, Sander LB. Systematic evaluation of content and quality of English and German pain apps in European app stores. Internet Interv 2021; 24:100376. [PMID: 33718002 PMCID: PMC7933737 DOI: 10.1016/j.invent.2021.100376] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/31/2020] [Revised: 01/05/2021] [Accepted: 02/17/2021] [Indexed: 12/14/2022] Open
Abstract
BACKGROUND AND OBJECTIVE Pain spans a broad spectrum of diseases and types that are highly prevalent and cause substantial disease burden for individuals and society. Up to 40% of people affected by pain receive no or inadequate treatment. Providing a scalable, time-, and location-independent way for pain diagnostic, management, prevention and treatment mobile health applications (MHA) might be a promising approach to improve health care for pain. However, the commercial app market is rapidly growing and unregulated, resulting in an opaque market. Studies investigating the content, privacy and security features, quality and scientific evidence of the available apps are highly needed, to guide patients and clinicians to high quality MHA.Contributing to this challenge, the present study investigates the content, quality, and privacy features of pain apps available in the European app stores. METHODS An automated search engine was used to identify pain apps in the European Google Play and Apple App store. Pain apps were screened and checked for systematic criteria (pain-relatedness, functionality, availability, independent usability, English or German). Content, quality and privacy features were assessed by two independent reviewers using the German Mobile Application Rating Scale (MARS-G). The MARS-G assesses quality on four objectives (engagement, functionality, aesthetics, information quality) and two subjective scales (perceived impact, subjective quality). RESULTS Out of 1034 identified pain apps 218 were included. Pain apps covered eight different pain types. Content included basic information, advice, assessment and tracking, and stand-alone interventions. The overall quality of the pain apps was average M = 3.13 (SD = 0.56, min = 1, max = 4.69). The effectiveness of less than 1% of the included pain apps was evaluated in a randomized controlled trial. Major problems with data privacy were present: 59% provided no imprint, 70% had no visible privacy policy. CONCLUSION A multitude of pain apps is available. Most MHA lack scientific evaluation and have serious privacy issues, posing a potential threat to users. Further research on evidence and improvements privacy and security are needed. Overall, the potential of pain apps is not exploited.
Collapse
Affiliation(s)
- Yannik Terhorst
- Department of Research Methods, Institute of Psychology and Education, Ulm University, Albert-Einstein-Allee 47, 89069 Ulm, Germany
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology and Education, Ulm University, Lise-Meitner-Str. 16, 89081 Ulm, Germany
| | - Eva-Maria Messner
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology and Education, Ulm University, Lise-Meitner-Str. 16, 89081 Ulm, Germany
| | - Dana Schultchen
- Department of Clinical and Health Psychology, Institute of Psychology and Education, Ulm University, Albert-Einstein-Allee 47, 89069 Ulm, Germany
| | - Sarah Paganini
- Department of Sport Psychology, University of Freiburg, Schwarzwaldstraße 175, 79117 Freiburg, Germany
| | - Alexandra Portenhauser
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology and Education, Ulm University, Lise-Meitner-Str. 16, 89081 Ulm, Germany
| | - Anna-Sophia Eder
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology and Education, Ulm University, Lise-Meitner-Str. 16, 89081 Ulm, Germany
| | - Melanie Bauer
- Department of Clinical and Health Psychology, Institute of Psychology and Education, Ulm University, Albert-Einstein-Allee 47, 89069 Ulm, Germany
| | - Mike Papenhoff
- Pain Medicine Clinic, BG Klinikum Duisburg, Grossenbaumer Allee 250, D-47249 Duisburg, Germany
| | - Harald Baumeister
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology and Education, Ulm University, Lise-Meitner-Str. 16, 89081 Ulm, Germany
| | - Lasse Bosse Sander
- Department of Rehabilitation Psychology and Psychotherapy, Institute of Psychology, Albert-Ludwigs-University Freiburg, Engelberger Str. 41, 79106 Freiburg im Breisgau, Germany
| |
Collapse
|
3
|
Terhorst Y, Philippi P, Sander LB, Schultchen D, Paganini S, Bardus M, Santo K, Knitza J, Machado GC, Schoeppe S, Bauereiß N, Portenhauser A, Domhardt M, Walter B, Krusche M, Baumeister H, Messner EM. Validation of the Mobile Application Rating Scale (MARS). PLoS One 2020; 15:e0241480. [PMID: 33137123 PMCID: PMC7605637 DOI: 10.1371/journal.pone.0241480] [Citation(s) in RCA: 82] [Impact Index Per Article: 20.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2020] [Accepted: 10/15/2020] [Indexed: 12/31/2022] Open
Abstract
BACKGROUND Mobile health apps (MHA) have the potential to improve health care. The commercial MHA market is rapidly growing, but the content and quality of available MHA are unknown. Instruments for the assessment of the quality and content of MHA are highly needed. The Mobile Application Rating Scale (MARS) is one of the most widely used tools to evaluate the quality of MHA. Only few validation studies investigated its metric quality. No study has evaluated the construct validity and concurrent validity. OBJECTIVE This study evaluates the construct validity, concurrent validity, reliability, and objectivity, of the MARS. METHODS Data was pooled from 15 international app quality reviews to evaluate the metric properties of the MARS. The MARS measures app quality across four dimensions: engagement, functionality, aesthetics and information quality. Construct validity was evaluated by assessing related competing confirmatory models by confirmatory factor analysis (CFA). Non-centrality (RMSEA), incremental (CFI, TLI) and residual (SRMR) fit indices were used to evaluate the goodness of fit. As a measure of concurrent validity, the correlations to another quality assessment tool (ENLIGHT) were investigated. Reliability was determined using Omega. Objectivity was assessed by intra-class correlation. RESULTS In total, MARS ratings from 1,299 MHA covering 15 different health domains were included. Confirmatory factor analysis confirmed a bifactor model with a general factor and a factor for each dimension (RMSEA = 0.074, TLI = 0.922, CFI = 0.940, SRMR = 0.059). Reliability was good to excellent (Omega 0.79 to 0.93). Objectivity was high (ICC = 0.82). MARS correlated with ENLIGHT (ps<.05). CONCLUSION The metric evaluation of the MARS demonstrated its suitability for the quality assessment. As such, the MARS could be used to make the quality of MHA transparent to health care stakeholders and patients. Future studies could extend the present findings by investigating the re-test reliability and predictive validity of the MARS.
Collapse
Affiliation(s)
- Yannik Terhorst
- Department of Research Methods, Institute of Psychology and Education, University Ulm, Ulm, Germany
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology and Education, University Ulm, Ulm, Germany
| | - Paula Philippi
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology and Education, University Ulm, Ulm, Germany
| | - Lasse B. Sander
- Department of Rehabilitation Psychology and Psychotherapy, Institute of Psychology, Albert-Ludwigs-University Freiburg, Freiburg im Breisgau, Germany
| | - Dana Schultchen
- Department of Clinical and Health Psychology, Institute of Psychology and Education, University Ulm, Ulm, Germany
| | - Sarah Paganini
- Department of Sport Psychology, Institute of Sports and Sport Science, University of Freiburg, Freiburg, Germany
| | - Marco Bardus
- Department of Health Promotion and Community Health, Faculty of Health Sciences, American University of Beirut, Beirut, Lebanon
| | - Karla Santo
- Academic Research Organization, Hospital Israelita Albert Einstein, São Paulo, Brazil
- Westmead Applied Research Centre, Westmead Clinical School, Faculty of Medicine and Health, The University of Sydney, Sydney, Australia
- Cardiovascular Division, The George Institute for Global Health, Sydney, Australia
| | - Johannes Knitza
- Department of Internal Medicine 3 – Rheumatology and Immunology, University Hospital Erlangen, Friedrich-Alexander University Erlangen-Nuremberg, Erlangen, Germany
| | - Gustavo C. Machado
- Institute for Musculoskeletal Health, Sydney, New South Wales, Australia
- Sydney School of Public Health, Faculty of Medicine and Health, The University of Sydney, Sydney, New South Wales, Australia
| | - Stephanie Schoeppe
- School of Health, Medical and Applied Sciences, Appleton Institute, Physical Activity Research Group, Central Queensland University, Rockhampton, Queensland, Australia
| | - Natalie Bauereiß
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology and Education, University Ulm, Ulm, Germany
| | - Alexandra Portenhauser
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology and Education, University Ulm, Ulm, Germany
| | - Matthias Domhardt
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology and Education, University Ulm, Ulm, Germany
| | - Benjamin Walter
- Department of Internal Medicine I, Gastroenterology, University Hospital Ulm, Ulm, Germany
| | - Martin Krusche
- Department of Rheumatology and Clinical Immunology, Charité – Universitätsmedizin Berlin, Berlin, Germany
| | - Harald Baumeister
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology and Education, University Ulm, Ulm, Germany
| | - Eva-Maria Messner
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology and Education, University Ulm, Ulm, Germany
| |
Collapse
|