1
|
Jiang X, Timmons M, Boroda E, Onakomaiya M. Impact of Platform Design and Usability on Adherence and Retention: Randomized Web- and Mobile-Based Longitudinal Study. J Particip Med 2025; 17:e50225. [PMID: 40152343 PMCID: PMC11967695 DOI: 10.2196/50225] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Revised: 02/04/2025] [Accepted: 02/06/2025] [Indexed: 03/29/2025] Open
Abstract
Background Low retention and adherence increase clinical trial costs and timelines. Burdens associated with participating in a clinical trial contribute to early study termination. Electronic patient-reported outcome (ePRO) tools reduce participant burden by allowing remote participation, and facilitate communication between researchers and participants. The Datacubed Health (DCH) mobile app is unique among ePRO platforms in its application of behavioral science principles (reward, motivation, identity, etc) in clinical trials to promote engagement, adherence, and retention. Objective We evaluated the impact of platform design and usability on adherence and retention with a longitudinal study involving repeated patient-facing study instruments. We expected participants assigned to complete instruments in the DCH mobile app to stay in this study longer (increased retention) and complete more surveys while in this study (increased adherence) due to the enhanced motivational elements unique to the participant experience in the DCH app group, and this group's overall lower burden of participation. Methods A total of 284 adult participants completed 24 weekly surveys via 1 of 4 modalities (DCH app vs DCH website vs third-party website vs paper) in a web-based and mobile longitudinal study. Participants were recruited from open access websites (eg, Craigslist or Facebook [Meta]), and a closed web-based user group. All participation occurred remotely. Study staff deliberately limited communications with participants to directly assess the main effects of survey administration modality; enrollment and study administration were largely automated. Participants assigned to the DCH app group experienced behavioral science-driven motivational elements related to reward and identity formation throughout their study journey. There was no homolog to this feature in any other tested platform. Participants assigned to the DCH app group accessed study measures using passcodes or smartphone biometrics (face or touch ID). Participants in the DCH website group logged into a website using a username and password. Participants in the third-party website group accessed web-based surveys via personalized emailed links with no need for password authentication. Paper arm participants received paper surveys in the mail. Results Mode of survey administration (DCH app vs DCH website vs third-party website vs paper) predicted study retention (F9,255=4.22, P<.001) and adherence (F9,162=5.5, P<.001). The DCH app group had greater retention than the paper arm (t=-3.80, P<.001), and comparable retention to the DCH website group. The DCH app group had greater adherence than all other arms (DCH web: t=-2.42, P=.02; third-party web: t=-3.56, P<.001; and paper arm: t=-4.53, P<.001). Conclusions Using an ePRO platform in a longitudinal study increased retention and adherence in comparison to paper instruments. Incorporating behavioral science design in an ePRO platform resulted in further increase in adherence in a longitudinal study.
Collapse
Affiliation(s)
| | - Michelle Timmons
- Hackensack Meridian Health, Hackensack Meridian School of Medicine, Nutley, NJ, United States
| | - Elias Boroda
- Datacubed Health, 630 Freedom Business Center Dr, 3rd Floor, King of Prussia, PA, 19406, United States, 1 (302) 6350830
| | | |
Collapse
|
2
|
Sauer C, Zschäbitz S, Krauss J, Walle T, Haag GM, Jäger D, Hiller K, Bugaj TJ, Friederich HC, Maatouk I. Electronic health intervention to manage symptoms of immunotherapy in patients with cancer (SOFIA): Results from a randomized controlled pilot trial. Cancer 2024; 130:2503-2514. [PMID: 38564338 DOI: 10.1002/cncr.35300] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2023] [Revised: 02/19/2024] [Accepted: 03/04/2024] [Indexed: 04/04/2024]
Abstract
BACKGROUND For patients receiving immune checkpoint inhibitors, early detection of immune-related adverse events (irAEs) is critical for one's safety. To this end, a smartphone app (SOFIA) was developed that featured the assessment of electronic patient-reported outcomes (ePROs) focusing on irAEs as well as a set of comprehensive supportive information. Its feasibility and preliminary efficacy were evaluated in a randomized controlled trial (RCT). METHODS Patients who received immune checkpoint inhibition therapy were randomly assigned to an intervention group (IG) or a control group (CG; care as usual). During the 12-week intervention period, IG patients used SOFIA to report twice weekly ePROs and receive cancer- and immunotherapy-relevant contents. Before a patient's next clinical visit, the physician in charge was given the ePRO reports. The primary objective was to test the feasibility of SOFIA. Furthermore, the preliminary efficacy of SOFIA for health-related quality of life (HRQOL), psychosocial outcomes, and medical data was examined. Clinical outcomes were assessed at baseline (T0), post-intervention (T1), and a 3-month follow-up (T2). RESULTS Seventy-one patients were randomized to the IG (n = 34) or the CG (n = 37). SOFIA showed high feasibility and acceptance. At T1, patients in the IG reported significantly better HRQOL and role functioning and less depression, distress, and appetite loss. No significant differences were revealed regarding medical data, the utilization of supportive care services, or survival. CONCLUSIONS SOFIA showed high feasibility and acceptance and improved HRQOL and psychosocial outcomes. These results suggest further evaluation of efficacy in a large-scale confirmatory multicenter RCT.
Collapse
Affiliation(s)
- Christina Sauer
- Department of General Internal Medicine and Psychosomatics, University Hospital Heidelberg, Heidelberg, Germany
- National Center for Tumor Diseases (NCT), University Hospital Heidelberg, Heidelberg, Germany
| | - Stefanie Zschäbitz
- Department of Medical Oncology, National Center for Tumor Diseases (NCT), University Hospital Heidelberg, Heidelberg, Germany
| | - Jürgen Krauss
- Department of Medical Oncology, National Center for Tumor Diseases (NCT), University Hospital Heidelberg, Heidelberg, Germany
- Vanudis GmbH, Heidelberg, Germany
| | - Thomas Walle
- Department of Medical Oncology, National Center for Tumor Diseases (NCT), University Hospital Heidelberg, Heidelberg, Germany
- Clinical Cooperation Unit Virotherapy, German Cancer Research Center (DKFZ), Heidelberg, Germany
- German Cancer Consortium (DKTK), Heidelberg, Germany
| | - Georg Martin Haag
- Department of Medical Oncology, National Center for Tumor Diseases (NCT), University Hospital Heidelberg, Heidelberg, Germany
- Clinical Cooperation Unit Applied Tumor-Immunity, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Dirk Jäger
- Department of Medical Oncology, National Center for Tumor Diseases (NCT), University Hospital Heidelberg, Heidelberg, Germany
- Clinical Cooperation Unit Applied Tumor-Immunity, German Cancer Research Center (DKFZ), Heidelberg, Germany
| | - Kiriaki Hiller
- Department of Medical Oncology, National Center for Tumor Diseases (NCT), University Hospital Heidelberg, Heidelberg, Germany
| | - Till Johannes Bugaj
- Department of General Internal Medicine and Psychosomatics, University Hospital Heidelberg, Heidelberg, Germany
- National Center for Tumor Diseases (NCT), University Hospital Heidelberg, Heidelberg, Germany
| | - Hans-Christoph Friederich
- Department of General Internal Medicine and Psychosomatics, University Hospital Heidelberg, Heidelberg, Germany
| | - Imad Maatouk
- Department of General Internal Medicine and Psychosomatics, University Hospital Heidelberg, Heidelberg, Germany
- Section of Psychosomatic Medicine, Psychotherapy and Psycho-Oncology, Department of Internal Medicine II, Julius-Maximilian University Würzburg, Würzburg, Germany
| |
Collapse
|
3
|
Janssen S, El Shafie RA, Ruder AM, Buergy D, Scafa D, Giordano FA, Nicolay NH, Vogel MME, Combs SE, Fahlbusch FB, Rades D, Käsmann L. Mobile applications in radiation oncology-current choices and future potentials. Strahlenther Onkol 2023; 199:337-349. [PMID: 36810957 PMCID: PMC9943039 DOI: 10.1007/s00066-023-02048-y] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2022] [Accepted: 01/15/2023] [Indexed: 02/24/2023]
Abstract
PURPOSE To review existing scientific literature on mobile applications (apps) in the field of radiation oncology and to evaluate characteristics of commercially available apps across different platforms. METHODS A systematic review of the literature for publications presenting apps in the field of radiation oncology was carried out using the PubMed database, Cochrane library, Google Scholar, and annual meetings of major radiation oncology societies. Additionally, the two major marketplaces for apps, App Store and Play Store, were searched for available radiation oncology apps for patients and health care professionals (HCP). RESULTS A total of 38 original publications which met the inclusion criteria were identified. Within those publications, 32 apps were developed for patients and 6 for HCP. The vast majority of patient apps focused on documenting electronic patient-reported outcomes (ePROs). In the two major marketplaces, 26 apps were found, mainly supporting HCP with dose calculations. CONCLUSION Apps used in (and for) scientific research in radiation oncology are rarely available for patients and HCP in common marketplaces.
Collapse
Affiliation(s)
- Stefan Janssen
- Department of Radiation Oncology, University of Lübeck, Lübeck, Germany.
- Private Practice of Radiation Oncology, Hannover, Germany.
| | - Rami A El Shafie
- Clinic of Radiotherapy and Radiation Oncology, University Medical Center Göttingen, Göttingen, Germany
| | - Arne M Ruder
- Department of Radiation Oncology, Heidelberg University Hospital, Heidelberg, Germany
| | - Daniel Buergy
- Department of Radiation Oncology, University Medical Center Mannheim, University of Heidelberg, Mannheim, Germany
| | - Davide Scafa
- Department of Radiation Oncology, University Medical Center Bonn (UKB), Bonn, Germany
| | - Frank A Giordano
- Department of Radiation Oncology, University Medical Center Mannheim, University of Heidelberg, Mannheim, Germany
| | - Nils H Nicolay
- Department of Radiation Oncology, University of Leipzig Medical Center, Leipzig, Germany
| | - Marco M E Vogel
- Department of Radiation Oncology, University Hospital Klinikum rechts der Isar, Technical University of Munich (TUM), Ismaninger Str. 22, 81675, Munich, Germany
- Institute for Radiation Medicine (IRM), Department of Radiation Sciences (DRS), Helmholtz Zentrum München, Neuherberg, Germany
| | - Stephanie E Combs
- Department of Radiation Oncology, University Hospital Klinikum rechts der Isar, Technical University of Munich (TUM), Ismaninger Str. 22, 81675, Munich, Germany
- Institute for Radiation Medicine (IRM), Department of Radiation Sciences (DRS), Helmholtz Zentrum München, Neuherberg, Germany
| | - Fabian B Fahlbusch
- Department of Pediatrics and Adolescent Medicine, Neonatology and Pediatric Intensive Care, Friedrich-Alexander-University of Erlangen-Nürnberg, Erlangen, Germany
| | - Dirk Rades
- Department of Radiation Oncology, University of Lübeck, Lübeck, Germany
| | - Lukas Käsmann
- Department of Radiation Oncology, University Hospital, LMU Munich, Marchioninistr. 15, 81377, Munich, Germany
- Partner Site Munich, German Cancer Consortium (DKTK), Munich, Germany
| |
Collapse
|
4
|
Feasibility of Using Wearables for Home Monitoring during Radiotherapy for Head and Neck Cancer-Results from the OncoWatch 1.0 Study. Cancers (Basel) 2023; 15:cancers15020422. [PMID: 36672370 PMCID: PMC9857313 DOI: 10.3390/cancers15020422] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2022] [Revised: 01/02/2023] [Accepted: 01/04/2023] [Indexed: 01/11/2023] Open
Abstract
Background: Consumer wearables allow objective health data monitoring, e.g., of physical activity and heart rate, which might change over a cancer treatment course. Patients with head and neck cancer (HNC) receiving radiotherapy (RT) with curative intent typically experience side effects such as pain, decreased appetite, and dehydration, which may lead to hospitalizations. Therefore, health data monitoring could be important to understand a patient’s condition outside the hospital. The OncoWatch 1.0 study investigated the feasibility of using smartwatches for patients with HNC receiving RT. Methods: This study was a prospective, single-cohort feasibility study. The inclusion criteria were patients ≥ 18 years of age who planned to receive curatively intended radiotherapy for HNC. Consenting patients were asked to wear a smartwatch during RT and until two weeks after the end of RT. The primary endpoint was adherence. The secondary endpoints were data acquisition and variations in heart rate and physical activity. Results: Ten patients were included, with a median age of 62 years and eight males. The adherence rate for wearing the watch >12 h/d over the study period was 31%. The data acquisition rate was 61%. Conclusions: Although the primary endpoint was not reached, new knowledge has been established, including the secure data setup and key points that need to be addressed in future studies.
Collapse
|
5
|
Underwood J, McCloskey S, Raldow A, Kishan A, Zalkin C, Navarro D, Holt LS, Webb A, Lynch KA, Atkinson TM. Developing a Mobile Patient-Reported Outcomes Version of the Common Terminology Criteria for Adverse Events Administration System to Capture Postradiation Toxicity in Oncology: Usability and Feasibility Study. JMIR Form Res 2022; 6:e27775. [PMID: 35412466 PMCID: PMC9044154 DOI: 10.2196/27775] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2021] [Revised: 05/13/2021] [Accepted: 01/20/2022] [Indexed: 11/13/2022] Open
Abstract
Background Accurate self-reported symptomatic toxicity documentation via the Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE) is essential throughout cancer treatment to ensure safety and understand therapeutic efficacy. However, the capture of accurate toxicities from patients undergoing radiation therapy is challenging because this is generally provided only at the time of scheduled visits. Objective This study seeks to establish the usability and feasibility of a mobile PRO-CTCAE Administration System (mPROS) to capture toxicities related to radiation therapy. Methods English-speaking adult patients who were undergoing radiation therapy for cancer were enrolled and given a brief demonstration of the Say All Your Symptoms (SAYS) and Symptom Tracking Entry Program (STEP) interfaces of the mPROS app, followed by a patient-use phase where patient actions were observed as they navigated mPROS to enter toxicities. Patient feedback was captured via a semistructured interview and brief questionnaire. Results We enrolled 25 patients (age: mean 60.7 years; females: n=13, 52%; White patients: n=13; 52%; non-Hispanic patients: n=19, 76%; college graduates: n=17, 68%). Patients almost equally preferred the SAYS (n=14, 56%) or STEP (n=11, 44%) interfaces, with 21 patients (84%) agreeing that they would use mPROS to report their symptoms to their health care team and 19 patients (76%) agreeing that they would recommend mPROS to others. Conclusions The mPROS app is usable and feasible for facilitating the patient reporting of radiation therapy–related symptomatic toxicities. A revised version of mPROS that incorporates patient input and includes electronic health record integration is being developed and validated as part of a multicenter trial.
Collapse
Affiliation(s)
- Jody Underwood
- Intelligent Automation, Inc, Rockville, MD, United States
| | - Susan McCloskey
- Department of Radiation Oncology, David Geffen School of Medicine at UCLA, Los Angeles, CA, United States
| | - Ann Raldow
- Department of Radiation Oncology, David Geffen School of Medicine at UCLA, Los Angeles, CA, United States
| | - Amar Kishan
- Department of Radiation Oncology, David Geffen School of Medicine at UCLA, Los Angeles, CA, United States
| | - Chad Zalkin
- Intelligent Automation, Inc, Rockville, MD, United States
| | - Daniel Navarro
- Intelligent Automation, Inc, Rockville, MD, United States
| | | | - Andrew Webb
- Department of Psychiatry and Behavioral Sciences, Memorial Sloan Kettering Cancer Center, New York, NY, United States
| | - Kathleen A Lynch
- Department of Psychiatry and Behavioral Sciences, Memorial Sloan Kettering Cancer Center, New York, NY, United States
| | - Thomas M Atkinson
- Department of Psychiatry and Behavioral Sciences, Memorial Sloan Kettering Cancer Center, New York, NY, United States
| |
Collapse
|