Engagement with Manage My Pain mobile health application among patients at the Transitional Pain Service

Predicting Clinical Outcomes at the Toronto General Hospital Transitional Pain Service via the Manage My Pain App: Machine Learning Approach

Background

Chronic pain is a complex condition that affects more than a quarter of people worldwide. The development and progression of chronic pain are unique to each individual due to the contribution of interacting biological, psychological, and social factors. The subjective nature of the experience of chronic pain can make its clinical assessment and prognosis challenging. Personalized digital health apps, such as Manage My Pain (MMP), are popular pain self-tracking tools that can also be leveraged by clinicians to support patients. Recent advances in machine learning technologies open an opportunity to use data collected in pain apps to make predictions about a patient's prognosis.

Objective

This study applies machine learning methods using real-world user data from the MMP app to predict clinically significant improvements in pain-related outcomes among patients at the Toronto General Hospital Transitional Pain Service.

Methods

Information entered into the MMP app by 160 Transitional Pain Service patients over a 1-month period, including profile information, pain records, daily reflections, and clinical questionnaire responses, was used to extract 245 relevant variables, referred to as features, for use in a machine learning model. The machine learning model was developed using logistic regression with recursive feature elimination to predict clinically significant improvements in pain-related pain interference, assessed by the PROMIS Pain Interference 8a v1.0 questionnaire. The model was tuned and the important features were selected using the 10-fold cross-validation method. Leave-one-out cross-validation was used to test the model's performance.

Results

The model predicted patient improvement in pain interference with 79% accuracy and an area under the receiver operating characteristic curve of 0.82. It showed balanced class accuracies between improved and nonimproved patients, with a sensitivity of 0.76 and a specificity of 0.82. Feature importance analysis indicated that all MMP app data, not just clinical questionnaire responses, were key to classifying patient improvement.

Conclusions

This study demonstrates that data from a digital health app can be integrated with clinical questionnaire responses in a machine learning model to effectively predict which chronic pain patients will show clinically significant improvement. The findings emphasize the potential of machine learning methods in real-world clinical settings to improve personalized treatment plans and patient outcomes.

Ten years of transitional pain service research and practice: where are we and where do we go from here?

Chronic postsurgical pain (CPSP) is a prevalent yet unintended consequence of surgery with substantial burdens to the individual and their family, the healthcare system, and society at large. The present article briefly reviews the evidence for transitional pain services (TPSs) that have arisen in an effort to prevent and mange CPSP and persistent opioid use, and provides an update on recent novel risk factors for CPSP. Available evidence from one randomized controlled trial (RCT) and three non-randomized cohort studies suggests that TPS treatment is associated with better opioid use outcomes, including fewer opioid tablets prescribed at discharge, better opioid weaning results, a lower incidence of new-onset chronic opioid use, and lower consumption of opioids even at later time points up to 1 year after surgery. Another RCT indicates TPS treatment can be enhanced by provision of perioperative clinical hypnosis. While these preliminary studies are generally positive, large-scale, RCTs are needed to provide a more definitive picture of whether TPSs are effective in reducing opioid consumption and improving pain and mental health outcomes in the short and long term. With the expansion of TPSs across North America and globally, perioperative care focused on reducing the transition to pain chronicity has the potential to help millions of patients. With additional evidence from well-controlled RCTs, TPSs are well poised to continue to evolve and strengthen the role of multidisciplinary care teams in the immediate postdischarge period and beyond.

Knowledge translation initiatives at the Transitional Pain Service: insights from healthcare provider outreach and patient education

Evidence-based treatment of chronic pain requires a multidisciplinary approach grounded in the biopsychosocial model. Implementing this approach within health systems relies on its acceptance by both healthcare providers and patients. While pioneering multidisciplinary pain clinics can serve as a model for implementation, a systematic effort is needed to share knowledge effectively and broadly. In the current paper we provide an overview of the knowledge translation initiatives undertaken at our Transitional Pain Service (TPS) at Toronto General Hospital, a state-of-the-art multidisciplinary pain program established in 2014 for patients at risk of developing chronic pain after surgery. The TPS team strives to enhance acceptance of this model of care among patients and providers, facilitate the establishment of similar clinics, and promote patient understanding of the integrated multidisciplinary pain care approach. Guided by the Knowledge to Action (KTA) framework, knowledge translation activities undertaken by our TPS team include clinician training, resources and outreach activities for providers, and patient education. Resource development was preceded by consultation and needs assessment among patients and providers and feedback from both groups was incorporated as part of the development process. The tailored resources were disseminated via the TPS clinic website and monitoring of online usage enables continuous evaluation of engagement. Barriers to engagement with the resources were examined through patient surveys and staff interviews. Based on these activities, we offer insights gained by our team throughout the knowledge translation process and provide recommendations for other clinical teams who wish to undertake similar initiatives.

User Engagement With mHealth Interventions to Promote Treatment Adherence and Self-Management in People With Chronic Health Conditions: Systematic Review

BACKGROUND

There are numerous mobile health (mHealth) interventions for treatment adherence and self-management; yet, little is known about user engagement or interaction with these technologies.

OBJECTIVE

This systematic review aimed to answer the following questions: (1) How is user engagement defined and measured in studies of mHealth interventions to promote adherence to prescribed medical or health regimens or self-management among people living with a health condition? (2) To what degree are patients engaging with these mHealth interventions? (3) What is the association between user engagement with mHealth interventions and adherence or self-management outcomes? (4) How often is user engagement a research end point?

METHODS

Scientific database (Ovid MEDLINE, Embase, Web of Science, PsycINFO, and CINAHL) search results (2016-2021) were screened for inclusion and exclusion criteria. Data were extracted in a standardized electronic form. No risk-of-bias assessment was conducted because this review aimed to characterize user engagement measurement rather than certainty in primary study results. The results were synthesized descriptively and thematically.

RESULTS

A total of 292 studies were included for data extraction. The median number of participants per study was 77 (IQR 34-164). Most of the mHealth interventions were evaluated in nonrandomized studies (157/292, 53.8%), involved people with diabetes (51/292, 17.5%), targeted medication adherence (98/292, 33.6%), and comprised apps (220/292, 75.3%). The principal findings were as follows: (1) >60 unique terms were used to define user engagement; "use" (102/292, 34.9%) and "engagement" (94/292, 32.2%) were the most common; (2) a total of 11 distinct user engagement measurement approaches were identified; the use of objective user log-in data from an app or web portal (160/292, 54.8%) was the most common; (3) although engagement was inconsistently evaluated, most of the studies (99/195, 50.8%) reported >1 level of engagement due to the use of multiple measurement methods or analyses, decreased engagement across time (76/99, 77%), and results and conclusions suggesting that higher engagement was associated with positive adherence or self-management (60/103, 58.3%); and (4) user engagement was a research end point in only 19.2% (56/292) of the studies.

CONCLUSIONS

The results revealed major limitations in the literature reviewed, including significant variability in how user engagement is defined, a tendency to rely on user log-in data over other measurements, and critical gaps in how user engagement is evaluated (infrequently evaluated over time or in relation to adherence or self-management outcomes and rarely considered a research end point). Recommendations are outlined in response to our findings with the goal of improving research rigor in this area.

TRIAL REGISTRATION

PROSPERO International Prospective Register of Systematic Reviews CRD42022289693; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42022289693.

Transitional Pain Service: An Update

PURPOSE OF REVIEW

Chronic Postsurgical Pain (CPSP) and the risk for long-term opioid dependency are known complications following major surgery. The idea of Transitional Pain Service (TPS) has been introduced as an interdisciplinary setting to manage pain in the perioperative continuum. We expand on the basic framework and principles of TPS and summarize the current evidence of the TPS and possible interventions to adress postoperative pain. Areas of future work in TPS-related research are discussed.

RECENT FINDINGS

Several studies support the effectiveness of TPS in reducing opioid consumption in the perioperative period and following discharge. Some studies also show an improvement in functional outcome with TPS with patients reporting lower pain severity and pain interference. The TPS aims to halt the progress of acute postoperative pain to CPSP by providing longitudinal support with patient-centered care. While some studies suggest a positive impact of TPS implementation in terms of reduction in postoperative opioid consumption and improvement of some functional outcomes, direct evidence in terms of reduction in the incidence of CPSP is still missing. The cost-effectiveness of TPS and the expansion of TPS through e-health services and digital applications also need to be evaluated.

Virtual transitional pain service delivered via telehealth is effective in preventing new and persistent opioid use amongst post-surgical spine patients

Opioid dependence is a national crisis, with 30 million patients annually at risk of becoming persistent opioid users after receiving opioids for post-surgical pain management. Translational Pain Services (TPS) demonstrate effectiveness for behavioral health improvements but its effectiveness in preventing persistent opioid use is less established, especially amongst opioid exposed patients. Prohibitive costs and accessibility challenges have hindered TPS program adoption. To address these limitations, we designed and implemented a remote telehealth TPS protocol focusing on preventing continued opioid use while improving behavioral health. Licensed therapists trained in the opioid-tapering CBT protocol delivered sessions reimbursed through standard payer reimbursement. Our prospective study evaluated the protocol's effectiveness on preventing persistent opioid use and behavioral health outcomes amongst both opioid naïve and exposed patients. In an opioid-naive patient cohort (n=67), 100% completely tapered off opioids, while in an opioid-exposed cohort (n =19) 52% completely tapered off opioids, demonstrating promising results. In both cohorts, we observed significant improvements in behavioral health scores, including pain. This opioid-tapering digital TPS is effective, adoptable, and incurs no out-of-pocket cost for healthcare systems. We provide the opioid-tapering CBT protocol in the supplement to facilitate adoption. Trial Registration Impact of Daily, Digital and Behavioral Tele-health Tapering Program for Perioperative Surgical Patients Exposed to Opioids and Benzodiazepines registered at clinicaltrials.gov, NCT04787692. https://clinicaltrials.gov/ct2/show/NCT04787692?term=NCT04787692&draw=2&rank=1.

Toward a digital citizen lab for capturing data about alternative ways of self-managing chronic pain: An attitudinal user study

Background

Myriad psychosocial and cultural factors influence personal ways of coping with chronic pain (CP). Mobile health (mHealth) apps facilitate creation of citizen laboratories outside clinical frameworks. However, issues of safety, privacy and technostress must be addressed. This attitudinal user study aimed to assess whether persons with persistent pain (PwPP) would be open to sharing qualitative and quantitative data about their self-management of CP via mHealth platforms.

Methods

In March 2020, we invited PwPPs, their personal or medical caregivers, or those interested in the development of an app for researching alternative ways of self-managing CP to complete an anonymous survey. We formulated an attitudinal survey within the theoretical framework of stress to estimate whether the novelty, unpredictability, and risks of data-sharing via mHealth apps concerned users. Descriptive statistics (% Part/Group) were used to interpret the survey, and open comments were reflectively analyzed to identify emerging themes.

Results

Of 202 responses (June 2021), 127 identified as PwPPs (average age 43.86 ± 14.97; 100/127 female), and listed several primary and secondary CP diagnoses. In almost 90% of PwPPs, physical and emotional wellbeing were affected by CP. More than 90% of PwPPs used alternative therapies (acupuncture, homeopathy, massage therapy, etc.). Attitude toward mHealth apps were positive even though nearly half of PwPPs were unfamiliar with them. More than 72% of respondents were open to using a health-related app as a research tool for data collection in real life situations. Comprehensive data collection (especially about psychosocial factors) was the most important requirement. More respondents (especially medical professionals) were concerned about health hazards of misinformation communicated via health-related information and communication systems (maximum 80%) than about privacy (maximum 40%). Qualitative analyses revealed several promises and impediments to creation of data-sharing platforms for CP.

Conclusions

This study shows a general willingness among PwPPs to become partners in studying alternative pain management. Despite a generally positive attitude toward the concept of sharing complex personal data to advance research, heterogeneity of attitudes shaped by personal experiences must be considered. Our study underlines the need for any digital strategy for CP research to be person-centered and flexible.

Review and Analysis of German Mobile Apps for Inflammatory Bowel Disease Management Using the Mobile Application Rating Scale: Systematic Search in App Stores and Content Analysis

Background

Patients suffering from inflammatory bowel disease (IBD) frequently need long-term medical treatment. Mobile apps promise to complement and improve IBD management, but so far there has been no scientific analysis of their quality.

Objective

This study evaluated the quality of German mobile apps targeting IBD patients and physicians treating IBD patients using the Mobile Application Rating Scale (MARS).

Methods

The German Apple App Store and Google Play Store were systematically searched to identify German IBD mobile apps for patient and physician use. MARS was used by 6 physicians (3 using Android smartphones and 3 using iPhones) to independently assess app quality. Apps were randomly assigned so that the 4 apps with the most downloads were rated by all raters and the remaining apps were rated by 1 Android and 1 iOS user.

Results

In total, we identified 1764 apps in the Apple App Store and Google Play Store. After removing apps that were not related to IBD (n=1386) or not available in German (n=317), 61 apps remained. After removing duplicates (n=3) and apps for congresses (n=7), journals (n=4), and clinical studies (n=6), as well as excluding apps that were available in only 1 of the 2 app stores (n=20) and apps that could only be used with an additional device (n=7), we included a total of 14 apps. The app “CED Dokumentation und Tipps” had the highest overall median MARS score at 4.11/5. On the whole, the median MARS scores of the 14 apps ranged between 2.38/5 and 4.11/5. As there was no significant difference between iPhone and Android raters, we used the Wilcoxon comparison test to calculate P values.

Conclusions

The MARS ratings showed that the quality of German IBD apps varied. We also discovered a discrepancy between app store ratings and MARS ratings, highlighting the difficulty of assessing perceived app quality. Despite promising results from international studies, there is little evidence for the clinical benefits of German IBD apps. Clinical studies and patient inclusion in the app development process are needed to effectively implement mobile apps in routine care.

Improved User Engagement and Assessment of Treatment Effectiveness in Patients Utilizing a Novel Digital Mobile Health Application During Spinal Cord Stimulation Screening Trials (Preprint)

Background

Patient outcomes and experience during a Spinal Cord Stimulation (SCS) screening trial can have a significant effect on whether to proceed with long-term, permanent implantation of an SCS device for the treatment of chronic pain. Enhancing the ability to track and assess patients during this initial trial evaluation offers the potential for improved understanding regarding the suitability of permanent device implantation as well as identification of the SCS-based neurostimulative modalities and parameters that may provide substantial analgesia in a patient-specific manner.

Objective

In this report, we aimed to describe a preliminary, real-world assessment of a new, real time tracking, smart, device-based digital app used by patients with chronic pain undergoing trial screening for SCS therapy.

Methods

This is a real-world, retrospective evaluation of 13,331 patients diagnosed with chronic pain who used the new “mySCS” mobile app during an SCS screening trial. The app design is health insurance portability and accountability act (HIPAA)-compliant and compatible with most commercially available smartphones (eg, Apple, iPhone, and Android). The app enables tracking of user-inputted health-related responses (ie, pain relief, activity level, and sleep quality) in addition to personal trial goals and a summary of overall experience during the SCS trial. A deidentified, aggregate analysis of user engagement, user-submitted responses, and overall trial success was conducted.

Results

When provided the opportunity, the percentage of users who engaged with the tracking app for ≥50% of the time during their trial was found to be 64.43% (n=8589). Among the 13,331 patients who used the app, 58.24% (n=7764) entered a trial goal. Most patients underwent SCS screening with a trial duration of at least 7 days (n=7739, 58.05%). Of those patients who undertook a 7-day SCS trial, 62.30% (n=3456) engaged the app for 4 days or more. In addition, among all who submitted descriptive responses using the app, health-related improvements were reported by 77.84% (n=10,377) of patients who reached day 3 of the screening phase assessment and by 83.04% (n=11,070) of those who reached trial completion. A trial success rate of 91% was determined for those who used the app (versus 85% success rate for nonusers).

Conclusions

Data from this initial, real-world examination of a mobile, digital-health–based tracking app (“mySCS”), as used during the SCS screening phase, demonstrate that substantial patient engagement can be achieved while also providing for the acquisition of more real time patient-outcome measures that may help facilitate improved SCS trial success.

The GoodHope Ehlers Danlos Syndrome Clinic: development and implementation of the first interdisciplinary program for multi-system issues in connective tissue disorders at the Toronto General Hospital

Ehlers-Danlos Syndrome (EDS) are a heterogeneous group of genetic connective tissue disorders, and typically manifests as weak joints that subluxate/dislocate, stretchy and/or fragile skin, organ/systems dysfunction, and significant widespread pain. Historically, this syndrome has been poorly understood and often overlooked. As a result, people living with EDS had difficulty obtaining an accurate diagnosis and appropriate treatment, leading to untold personal suffering as well as ineffective health care utilization. The GoodHope EDS clinic addresses systemic gaps in the diagnosis and treatment of EDS. This paper describes a leap forward—from lack of awareness, diagnosis, and treatment—to expert care that is tailored to meet the specific needs of patients with EDS. The GoodHope EDS clinic consists of experts from various medical specialties who work together to provide comprehensive care that addresses the multi-systemic nature of the syndrome. In addition, EDS-specific self-management programs have been developed that draw on exercise science, rehabilitation, and health psychology to improve physical and psychosocial wellbeing and overall quality of life. Embedded into the program are research initiatives to shed light on the clinical presentation, underlying mechanisms of pathophysiology, and syndrome management. We also lead regular educational activities for community health care providers to increase awareness and competence in the interprofessional management of EDS beyond our doors and throughout the province and country.

The expanding role of chronic pain interventions in multimodal perioperative pain management: a narrative review

Surgery is a risk factor for chronic pain and long-term opioid use. As perioperative pain management continues to evolve, treatment modalities traditionally used for chronic pain therapy may provide additional benefit to patients undergoing surgery. Interventions such as radiofrequency ablation, cryoneurolysis, and neuromodulation may potentially be used in conjunction with acute pain procedures such as nerve blocks and multimodal analgesia. Pharmacological agents associated with chronic pain medicine, including gabapentinoids, ketamine, and selective serotonin reuptake inhibitors, may be useful adjuncts in perioperative pain management when indicated. There may also be a role for acupuncture, music therapy, and other integrative medicine therapies. A transitional pain service can help coordinate outpatient care with inpatient perioperative pain management and promote a more personalized and comprehensive approach that can improve postoperative outcomes.

User Engagement and Clinical Impact of the Manage My Pain App in Patients With Chronic Pain: A Real-World, Multi-site Trial

Background

Chronic pain imposes a large burden on individuals and society. A patient-centric digital chronic pain management app called Manage My Pain (MMP) can be used to enhance communication between providers and patients and promote self-management.

Objective

The purpose of this study was to evaluate the real-world engagement of patients in urban and rural settings in Ontario, Canada with the MMP app alongside their standard of care and assess the impact of its usage on clinical outcomes of pain and related mental health.

Methods

A total of 246 participants with chronic pain at a rural and 2 urban pain clinics were recruited into this prospective, open-label, exploratory study that compared the use of MMP, a digital health app for pain that incorporates validated questionnaires and provides patients with summarized reports of their progress in combination with standard care (app group), against data entered on paper-based questionnaires (nonapp group). Participants completed validated questionnaires on anxiety, depression, pain catastrophizing, satisfaction, and daily opioid consumption up to 4.5 months after the initial visit (short-term follow-up) and between 4.5 and 7 months after the initial visit (long-term follow-up). Engagement and clinical outcomes were compared between participants in the two groups.

Results

A total of 73.6% (181/246) of the participants agreed to use the app, with 63.4% (111/175) of them using it for at least one month. Individuals who used the app rated lower anxiety (reduction in Generalized Anxiety Disorder 7-item questionnaire score by 2.10 points, 95% CI –3.96 to –0.24) at short-term follow-up and had a greater reduction in pain catastrophizing (reduction in Pain Catastrophizing Scale score by 5.23 points, 95% CI –9.55 to –0.91) at long-term follow-up relative to patients with pain who did not engage with the MMP app.

Conclusions

The use of MMP by patients with chronic pain is associated with engagement and improvements in self-reported anxiety and pain catastrophizing. Further research is required to understand factors that impact continued engagement and clinical outcomes in patients with chronic pain.

Trial Registration

ClinicalTrials.gov NCT04762329; https://clinicaltrials.gov/ct2/show/NCT04762329