The Implementation Effectiveness of a Freely Available Pediatric Cancer Pain Assessment App: A Pilot Implementation Study

Commentary: Pediatric Pain Measurement, Assessment, and Evaluation

PEDIATRIC PAIN MEASUREMENT, ASSESSMENT, AND EVALUATION

Renee C.B. Manworren, Jennifer Stinson Seminars in Pediatric Neurology Volume 23, Issue 3, August 2016, Pages 189-200 Assessment provides the foundation for diagnosis, selection of treatments, and evaluation of treatment effectiveness for pediatric patients with acute, recurrent, and chronic pain. Extensive research has resulted in the availability of a number of valid, reliable, and recommended tools for assessing children's pain. Yet, evidence suggests children's pain is still not optimally measured or treated. In this article, we provide an overview of pain evaluation for premature neonates to adolescents. The difference between pain assessment and measurement is highlighted; and the key steps to follow are identified. Information about self report and behavioral pain assessment tools appropriate for children are provided; and fac tors to be considered when choosing a specific 1 are outlined. Finally, we preview future approaches to personalized pain medicine in pediatrics that include harnessing the use of potential digital health technologies and genomics.

Development of an App for Tracking Family Engagement With Early Intervention Services: Focus Groups and Pilot Evaluation Study

BACKGROUND

Expedient access to early intervention (EI) systems has been identified as a priority for children with developmental delays, identified disabilities, and other special health care needs. Despite the mandated availability of EI, it remains challenging for families to navigate referral processes and establish appropriate services. Such challenges disproportionately affect families from traditionally underserved communities. Mobile health apps can improve clinical outcomes, increase accessibility to health services, and promote adherence to health-related interventions. Though promising, the implementation of apps within routine care is in its infancy, with limited research examining the components of what makes an effective app or how to reach families most impacted by inequities in health care delivery.

OBJECTIVE

In study 1, we conducted focus groups to access a broad range of perspectives on the process of navigating the EI system, with the dual goals of identifying ways in which a patient-facing app might facilitate this process and identifying barriers to use with traditionally underrepresented and underserved groups. In study 2, focus group findings informed the development of a patient-facing app, which was subsequently tested with a pilot sample of 5 families.

METHODS

In study 1, the focus groups included 29 participants from 4 shareholder groups. Targeted sampling was used to recruit participants from traditionally underrepresented groups. Focus group questions sought information about barriers families experience as they navigate the EI system, ideal features of a patient-facing app designed to track family engagement with the EI system, and potential barriers. Focus group procedures were informed by the Consolidated Framework for Implementation Research framework. In study 2, a pilot app was developed. The app was tested with a sample of 5 families of young children involved in the EI system. Families provided information on app functionality and usability.

RESULTS

Qualitative analysis revealed a desire for increased communication and information about the process of accessing EI services, potential utility of an app for communication purposes, and clear recommendations for app features. Insights from focus groups were used to inform the development of the Family on Track app and related implementation supports. App features included survey customization, timing and delivery of prompts, and questions related to barriers and service satisfaction. Implementation supports include a visual guide for app installation, resources related to common family questions, and availability of study personnel to guide families through installation and provide ongoing support. Field testing provided preliminary information about app usability, including identifying future directions.

CONCLUSIONS

The results of this study could support the development of a new way for the EI system to communicate and connect with families, provide families with a means to communicate satisfaction and frustration, and access the supports they need to be active participants in their child's care.

Improvement Opportunities for PAINReportIt® Delivered on a Wireless Tablet: Rated by Black Older Men With Low Back Pain

Health care professionals and researchers can implement technology to improve older adults' acceptability of providing health information and to better include older adults in sharing information with health providers. However, older adults' engagement with technology remains low. This study focused on 60 Black older men (mean age = 70 years, SD = 6 years) with low back pain who completed the 13-item Computer Acceptability Scale after using the PAINReportIt® software on an Apple iPad®. On average, the sample found it acceptable to use PAINReportIt® software to share their pain or discomfort but that this was no replacement for oral dialogue with their health care provider. These findings contribute valuable information about the acceptability of using technology and indicate potential opportunities to improve PAINReportIt® software. Community interventions with acceptable tablet devices can offer new insight into collecting pain or discomfort data in populations with low presence in clinical research studies. [Research in Gerontological Nursing, 16(3), 108-114.].

The influence of contextual factors on children's communication of pain during pediatric Haematopoietic Stem Cell Transplantation: A qualitative case study

PURPOSE

The aim of this study was to describe how contextual factors related to the clinical setting of a pediatric HSCT unit influenced children's communication of pain to their health-care providers and parents during hospitalization.

DESIGN AND METHODS

A qualitative case study design was conducted in two-phases in a tertiary level pediatric HSCT unit. The Social Communication Model of Pain provided the conceptual framework for the study. In phase one participants were parents and phase two participants were health-care providers and children in a pediatric HSCT unit. Parents participated in semi-structured interviews at 30- and 90-days post-transplantation regarding their child's communication of pain. Naturalistic observations of children receiving clinical care were conducted and health-care providers participated in semi-structured interviews.

RESULTS

Children extensively denied pain to their parents and health-care providers. When children did communicate pain, they were motivated by a need to seek interventions for their pain. Children's willingness to communicate pain was influenced by the physiological impact of HSCT therapy, their previous experiences of pain, their relationship with parents and health-care providers and parents and an environment of fear and uncertainty.

CONCLUSIONS

There is a pressing need for child-centric approaches to support children to communicate their pain experiences to overcome the limitations imposed by the complexity of their medical treatment and the clinical environment in which they receive healthcare.

PRACTICE IMPLICATIONS

In the context of HSCT therapy children may not communicate pain until pain is severe, and no longer bearable, or outright deny the presence of pain.

Physiological responses to pain in cancer patients: A systematic review

BACKGROUND AND OBJECTIVE

Pain is one of the most debilitating symptoms in persons with cancer. Still, its assessment is often neglected both by patients and healthcare professionals. There is increasing interest in conducting pain assessment and monitoring via physiological signals that promise to overcome the limitations of state-of-the-art pain assessment tools. This systematic review aims to evaluate existing experimental studies to identify the most promising methods and results for objectively quantifying cancer patients' pain experience.

METHODS

Four electronic databases (Pubmed, Compendex, Scopus, Web of Science) were systematically searched for articles published up to October 2020.

RESULTS

Fourteen studies (528 participants) were included in the review. The selected studies analyzed seven physiological signals. Blood pressure and ECG were the most used signals. Sixteen physiological parameters showed significant changes in association with pain. The studies were fairly consistent in stating that heart rate, the low-frequency to high-frequency component ratio (LF/HF), and systolic blood pressure positively correlate with the pain.

CONCLUSIONS

Current evidence supports the hypothesis that physiological signals can help objectively quantify, at least in part, cancer patients' pain experience. While there is much more to be done to obtain a reliable pain assessment method, this review takes an essential first step by highlighting issues that should be taken into account in future research: use of a wearable device for pervasive recording in a real-world context, implementation of a big-data approach possibly supported by AI, including multiple stratification factors (e.g., cancer site and stage, source of pain, demographic and psychosocial data), and better-defined recording procedures. Improved methods and algorithms could then become valuable add-ons in taking charge of cancer patients.

Reducing pain in children with cancer at home: a feasibility study of the KLIK pain monitor app

PURPOSE

This study assessed adherence to, feasibility of, and barriers and facilitators of implementation of an app developed to monitor and follow-up with pain in children with cancer at home.

METHODS

Children (8-18 years) receiving cancer treatment (all diagnoses) or their parents (of children aged 0-7 years) used the KLIK Pain Monitor app for 3 weeks. Pain was assessed twice daily using an 11-point numeric rating scale (NRS-11) (ranging from 0 to 10). Healthcare professionals (HCP's) from the hospital's Pediatric Pain Service were instructed to follow-up with clinically significant pain scores (≥ 4) within 120 min (scores 4-6) or 30 min (scores 7-10). Adherence, feasibility, and implementation outcomes were assessed using questionnaires, app log data, and interviews.

RESULTS

Twenty-seven children (M age = 7.3 years, 51.8% male) and six HCP's participated. Sixty-three percent (N = 17) of families used the app on a daily basis during three weeks, and 18.5% (N = 5) reported pain scores twice daily during that time (family adherence). Twelve out of 27 children (44.4%) reported a clinically significant pain score at least once. In 70% (14/20) of clinically significant pain scores, HCP's followed-up with families within the set timeframe (HCP adherence). Outcomes reveal feasibility for the majority of app functions (i.e., positive evaluation by ≥ 70% families/HCP's), and non-feasible aspects could be resolved. Identified barriers and facilitators were used to improve future implementation efforts.

CONCLUSION

Use of the KLIK Pain Monitor app seems feasible. Future research will determine its effectiveness in reducing pain in children with cancer at home.

Negligible Effects of the Survey Modes for Patient-Reported Outcomes: A Report From the Childhood Cancer Survivor Study

PURPOSE

This study compared the measurement properties for multiple modes of survey administration, including postal mail, telephone interview, and Web-based completion of patient-reported outcomes (PROs) among survivors of childhood cancer.

METHODS

The population included 6,974 adult survivors of childhood cancer in the Childhood Cancer Survivor Study who completed the Brief Symptom Inventory-18 (BSI-18), which measured anxiety, depression, and somatization symptoms. Scale reliability, construct validity, and known-groups validity related to health status were tested for each mode of completion. The multiple indicators and multiple causes technique was used to identify differential item functioning (DIF) for the BSI-18 items that responded through a specific survey mode. The impact of the administration mode was tested by comparing differences in BSI-18 scores between the modes accounting for DIF effects.

RESULTS

Of the respondents, 58%, 27%, and 15% completed postal mail, Web-based, and telephone surveys, respectively. Survivors who were male; had lower education, lower household income, or poorer health status; or were treated with cranial radiotherapy were more likely to complete a telephone-based survey compared with either a postal mail or Web-based survey (all P < .05). Scale reliability and validity were equivalent across the 3 survey options. One, 2, and 5 items from the anxiety, depression, and somatization domains, respectively, were identified as having significant DIF among survivors who responded by telephone (P < .05). However, estimated BSI-18 domain scores, especially depression and anxiety, between modes did not differ after accounting for DIF effects.

CONCLUSION

Certain survivor characteristics were associated with choosing a specific mode for PRO survey completion. However, measurement properties among these modes were equivalent, and the impact of using a specific mode on scores was minimal.

A Web-Based Mobile App (INTERACCT App) for Adolescents Undergoing Cancer and Hematopoietic Stem Cell Transplantation Aftercare to Improve the Quality of Medical Information for Clinicians: Observational Study

Background

A growing number of cancer and hematopoietic stem cell transplant (HSCT) survivors require long-term follow-up with optimal communication schemes, and patients' compliance is crucial. Adolescents have various unmet needs. Regarding self-report of symptoms and health status, users of mobile apps showed enhanced compliance. Currently, HSCT aftercare at the HSCT outpatient clinic of the St. Anna Children’s Hospital in Vienna, Austria, is based on handwritten diaries, carrying various disadvantages. Recently, we developed the prototype of a web-based, self-monitoring gamified mobile app tailored for adolescents: the INTERACCT (Integrating Entertainment and Reaction Assessment into Child Cancer Therapy) app.

Objective

This observational, prospective study evaluated the usability of the INTERACCT app for tracking real-time self-reported symptoms and health status data in adolescent HSCT patients and a healthy matched control group. The primary outcome of the study was the quality of the self-reported medical information. We hypothesized that the mobile app would provide superior medical information for the clinicians than would the handwritten diaries.

Methods

Health data were reported via paper diary and mobile app for 5 consecutive days each. The quality of medical information was rated on a 5-point scale independently and blinded by two HSCT clinicians, and the duration of use was evaluated. A total of 52 participant questionnaires were assessed for gaming patterns and device preferences, self-efficacy, users’ satisfaction, acceptability, and suggestions for improvement of the mobile app. Interrater reliability was calculated with the intraclass correlation coefficient, based on a two-way mixed model; one-way repeated-measures analysis of variance and t tests were conducted post hoc. Descriptive methods were used for correlation with participants’ demographics. For users’ satisfaction and acceptability of the mobile app, the median and the IQR were calculated.

Results

Data from 42 participants—15 patients and 27 healthy students—with comparable demographics were evaluated. The results of our study indicated a superiority of the quality of self-reported medical data in the INTERACCT app over traditional paper-and-pencil assessment (mobile app: 4.14 points, vs paper-based diary: 3.77 points, P=.02). The mobile app outperformed paper-and-pencil assessments mainly among the patients, in particular among patients with treatment-associated complications (mobile app: 4.43 points, vs paper-based diary: 3.73 points, P=.01). The mobile app was used significantly longer by adolescents (≥14 years: 4.57 days, vs ≤13 years: 3.14 days, P=.03) and females (4.76 days for females vs 2.95 days for males, P=.004). This corresponds with a longer duration of use among impaired patients with comorbidities. User satisfaction and acceptability ratings for the mobile app were high across all groups, but adherence to entering a large amount of data decreased over time. Based on our results, we developed a case vignette of the target group.

Conclusions

Our study was the first to show that the quality of patient-reported medical information submitted via the INTERACCT app embedded in a serious game is superior to that submitted via a handwritten diary. In light of these results, a refinement of the mobile app supported by a machine learning approach is planned within an international research project.