Construct validity and reliability of a real-time multidimensional smartphone app to assess pain in children and adolescents with cancer

A parent-science partnership to improve postsurgical pain management in young children: Co-development and usability testing of the Achy Penguin smartphone-based app

BACKGROUND

Young children are at risk for poorly managed pain after surgery, with significant negative consequence to their quality of life and health outcomes. Mobile applications offer a highly accessible, engaging, and interactive medium to improve pain assessment and management; however, they generally lack scientific foundation or support.

AIMS

The aims of this study were to describe a successful parent-science partnership in the development and testing of Achy Penguin, a parent-developed iOS app to help assess and manage acute pain in young children, and to evaluate and refine the usability of Achy Penguin in young children with acute postoperative pain.

METHODS

Three cycles of iterative usability testing were conducted with 20 4- to 7-year-old children (M = 5.8 years) in hospital who had recently undergone surgery (n = 6-7 children/cycle). Semistructured qualitative interviews were analyzed using simple content analysis.

RESULTS

Feedback from children and further integration of evidence-based pediatric pain knowledge led to refinements in app pain assessment and management content, as well as app flow and functionality. Changes improved children's ease of use and understanding and satisfaction by simplifying language in app instructions and content, adding audio and pictorial instructions, and increasing the engagement, interactiveness, immersiveness, and general appeal of pain management strategies.

CONCLUSIONS

This article showcases the value of collaborative partnerships between various stakeholders (parents, app developers, and researcher/health care providers) to address gaps in pediatric pain care. The Achy Penguin app shows promise for improving pain assessment and management in young children, although further evaluation of app effectiveness and implementation is warranted.

A Cloud-Based Virtual Outpatient Clinic for Patient-Centered Care: Proof-of-Concept Study

BACKGROUND

Most electronic health (eHealth) interventions offered to patients serve a single purpose and lack integration with other tools or systems. This is problematic because the majority of patients experience comorbidity and chronic disease, see multiple specialists, and therefore have different needs regarding access to patient data, communication with peers or providers, and self-monitoring of vital signs. A multicomponent digital health cloud service that integrates data sharing, collection, and communication could facilitate patient-centered care in combination with a hospital patient portal and care professionals.

OBJECTIVE

This study aimed to assess the feasibility and functionality of a new cloud-based and multicomponent outpatient clinic, the "Virtual Outpatient Clinic" (VOC).

METHODS

The VOC consists of 6 digital tools that facilitate self-monitoring (blood pressure, weight, and pain) and communication with peers and providers (chat and videoconferencing) connected to a cloud-based platform and the hospital patient portal to facilitate access to (self-collected) medical data. In this proof-of-concept study, 10 patients from both Departments of Internal Medicine and Dermatology (N=20) used all options of the VOC for 6 weeks. An eNurse offered support to participants during the study. We assessed the feasibility, usage statistics, content, adherence, and identified technical issues. Moreover, we conducted qualitative interviews with all participants by following a standard interview guide to identify user experiences, including barriers, facilitators, and potential effects.

RESULTS

Most participants successfully used all options of the VOC and were positive about different tools and apps and the integral availability of their information. The adherence was 37% (7/19) for weight scale, 58% (11/19) for blood pressure monitor, and 70% (14/20) and 85% (17/20) for pain score and daily questions, respectively. The adherence for personal health record was 65% (13/20) and 60% (12/20) for the patient portal system. Qualitative data showed that performance and effort expectancy scored high among participants, indicating that using the VOC is convenient, easy, and time-saving.

CONCLUSIONS

The VOC is a promising integrated Web-based technology that combines self-management, data sharing, and communication between patients and professionals. The system can be personalized by connecting various numbers of components, which could make it a relevant tool for other patient groups. Before a system, such as the VOC, can be implemented in daily practice, prospective studies focused on evaluating outcomes, costs, and patient-centeredness are needed.

Availability of researcher-led eHealth tools for pain assessment and management: barriers, facilitators, costs, and design

INTRODUCTION

Numerous eHealth tools for pain assessment and management have been developed and evaluated with promising results regarding psychometric properties, efficacy, and effectiveness. Although considerable resources are spent on developing and evaluating these tools with the aim of increasing access to care, current evidence suggests they are not made available to end users, reducing their impact and creating potential research waste.

METHODS

This study consisted of 2 components: (1) a systematic review of eHealth tools for pediatric pain assessment and/or management published in the past 10 years, and (2) an online survey, completed by the authors of identified tools, of tool availability, perceived barriers or facilitators to availability, grant funding used, and a validated measure of user-centeredness of the design process (UCD-11).

RESULTS

Ninety articles (0.86% of citations screened) describing 53 tools met inclusion criteria. Twenty-six survey responses were completed (49.06%), 13 of which (50.00%) described available tools. Commonly endorsed facilitators of tool availability included researchers' beliefs in tool benefits to the target population and research community; barriers included lack of infrastructure and time. The average cost of each unavailable tool was $314,425.31 USD ($3,144,253.06 USD total, n = 10). Authors of available tools were more likely to have followed user-centered design principles and reported higher total funding.

CONCLUSION

Systemic changes to academic and funding structures could better support eHealth tool availability and may reduce potential for research waste. User-centered design and implementation science methods could improve the availability of eHealth tools and should be further explored in future studies.

Using the MEDiPORT humanoid robot to reduce procedural pain and distress in children with cancer: A pilot randomized controlled trial

BACKGROUND

Subcutaneous port needle insertions are painful and distressing for children with cancer. The interactive MEDiPORT robot has been programmed to implement psychological strategies to decrease pain and distress during this procedure. This study assessed the feasibility of a future MEDiPORT trial. The secondary aim was to determine the preliminary effectiveness of MEDiPORT in reducing child pain and distress during subcutaneous port accesses.

METHODS

This 5-month pilot randomized controlled trial used a web-based service to randomize 4- to 9-year-olds with cancer to the MEDiPORT cognitive-behavioral arm (robot using evidence-based cognitive-behavioral interventions) or active distraction arm (robot dancing and singing) while a nurse conducted a needle insertion. We assessed accrual and retention; technical difficulties; outcome measure completion by children, parents, and nurses; time taken to complete the study and clinical procedure; and child-, parent-, and nurse-rated acceptability. Descriptive analyses, with exploratory inferential testing of child pain and distress data, were used to address study aims.

RESULTS

Forty children were randomized across study arms. Most (85%) eligible children participated and no children withdrew. Technical difficulties were more common in the cognitive-behavioral arm. Completion times for the study and needle insertion were acceptable and >96% of outcome measure items were completed. Overall, MEDiPORT and the study were acceptable to participants. There was no difference in pain between arms, but distress during the procedure was less pronounced in the active distraction arm.

CONCLUSION

The MEDiPORT study appears feasible to implement as an adequately-powered effectiveness-assessing trial following modifications to the intervention and study protocol. ClinicalTrials.gov NCT02611739.

Effects of a home care mobile app on the outcomes of discharged patients with a stoma: A randomised controlled trial

AIMS AND OBJECTIVES

To explore the effects of a home care mobile app on the outcomes of stoma patients who discharged from hospital.

BACKGROUND

Patients with a newly formed stoma experience many difficulties after surgery. Mobile application (app) has the potential to help patients self-manage their diseases and adjust to the changes in their lives and is a convenient way to ensure the continuity of care. However, there is a lack of studies about the effects of a mobile app on the transitional care for improving discharged stoma-related health outcomes.

DESIGN

A randomised controlled trial.

METHODS

A total of 203 patients with a permanent stoma in tertiary hospitals in China were randomly assigned into two groups. Patients in the control group (n = 103) received routine discharge care. Patients in the intervention group (n = 100) received home care via a mobile app besides routine care. The psychosocial adjustment level, self-efficacy scale and stoma complications incidence were measured in the follow-up period and compared between the two groups. Data were collected at four time points: before intervention (baseline), at 1, 3 and 6 months after discharge.

RESULTS

The psychosocial adjustment level and stoma self-efficacy score of the intervention group were significantly higher than those of the control group, respectively, at 1-, 3- and 6-month follow-up (all p < 0.05). The incidence of stoma complications in the intervention group was tending to reduce at 1, 3 and 6 months after discharge.

CONCLUSION

The findings indicated that follow-up care at home via a mobile app can effectively improve the psychosocial adjustment level, self-efficacy scale and other related outcomes of stoma patients.

RELEVANCE TO CLINICAL PRACTICE

The home care mobile app is an effective intervention to support the psychosocial adjustment and self-efficacy of stoma patients after discharge. It ensures the continuity of care and provides nursing guidance for the patients timely.

Perceptions of Adolescents With Cancer Related to a Pain Management App and Its Evaluation: Qualitative Study Nested Within a Multicenter Pilot Feasibility Study

BACKGROUND

Pain in adolescents with cancer is common and negatively impacts health-related quality of life. The Pain Squad+ smartphone app, capable of providing adolescents with real-time pain management support, was developed to enhance pain management using a phased approach (ie, systematic review, consensus conference and vetting, iterative usability testing cycles). A 28-day Pain Squad+ pilot was conducted with 40 adolescents with cancer to evaluate the feasibility of implementing the app in a future clinical trial and to obtain estimates of treatment effect.

OBJECTIVE

The objective of our nested qualitative study was to elucidate the perceptions of adolescents with cancer to determine the acceptability and perceived helpfulness of Pain Squad+, suggestions for app improvement, and satisfaction with the pilot study protocol.

METHODS

Post pilot study participation, telephone-based, semistructured, and audio-recorded exit interviews were conducted with 20 adolescents with cancer (12-18 years). All interviews were transcribed and independently coded by 2 study team members. Content analysis was conducted to identify data categories and overarching themes.

RESULTS

Five major themes comprising multiple categories and codes emerged. These themes focused on the acceptability of the intervention, acceptability of the study, the perceived active ingredients of the intervention, the suitability of the intervention to adolescents' lives, and recommendations for intervention improvement.

CONCLUSIONS

Overall, Pain Squad+ and the pilot study protocol were acceptable to adolescents with cancer. Suggestions for intervention and study improvements will be incorporated into the design of a future randomized clinical trial (RCT) aimed at assessing the effectiveness of Pain Squad+ on adolescents with cancer health outcomes.

Symptom Monitoring in Pediatric Oncology Using Patient-Reported Outcomes: Why, How, and Where Next

Symptom monitoring using patient-reported outcomes (PROs) is not common in pediatric oncology, despite interest from stakeholders-including patients, families, clinicians, and regulatory organizations-and proven clinical benefit in adult oncology. This article examines the foundational data for patient-reported symptom reporting in this population and posits the next investigative steps toward the implementation of patient-reported symptom monitoring in the care and research of pediatric oncology patients. The reasoning behind, and feasibility of, monitoring symptoms in pediatric oncology patients using PRO measures are discussed, as well as specific tools that have been developed to track symptoms in this population, including innovative electronic self-reporting platforms built to engage children in the symptom reporting process. Aspects of engaging both patients and clinicians in the symptom self-report process are reviewed, as are the experiences of "early adopters" of this process in pediatric oncology and across pediatrics. It is clear that there are key issues that remain regarding the use of PROs for symptom monitoring, including selection of specific outcomes to monitor, how to resolve discrepant reports, and determination of benefit. The next steps for investigation of these issues are discussed. Unanswered questions notwithstanding, work should continue to make patient-reported symptom monitoring an established, evidence-based part of routine and research practice in pediatric oncology.

Clinical trial designs and models for analgesic medications for acute pain in neonates, infants, toddlers, children, and adolescents: ACTTION recommendations

Clinical trials to test the safety and efficacy of analgesics across all pediatric age cohorts are needed to avoid inappropriate extrapolation of adult data to children. However, the selection of acute pain models and trial design attributes to maximize assay sensitivity, by pediatric age cohort, remains problematic. Acute pain models used for drug treatment trials in adults are not directly applicable to the pediatric age cohorts-neonates, infants, toddlers, children, and adolescents. Developmental maturation of metabolic enzymes in infants and children must be taken into consideration when designing trials to test analgesic treatments for acute pain. Assessment tools based on the levels of cognitive maturation and behavioral repertoire must be selected as outcome measures. Models and designs of clinical trials of analgesic medications used in the treatment of acute pain in neonates, infants, toddlers, children, and adolescents were reviewed and discussed at an Analgesic, Anesthetic, and Addiction Clinical Trial Translations, Innovations, Opportunities, and Networks (ACTTION) Pediatric Pain Research Consortium consensus meeting. Based on extensive reviews and continuing discussions, the authors recommend a number of acute pain clinical trial models and design attributes that have the potential to improve the study of analgesic medications in pediatric populations. Recommendations are also provided regarding additional research needed to support the use of other acute pain models across pediatric age cohorts.

Commercially Available Smartphone Apps to Support Postoperative Pain Self-Management: Scoping Review

BACKGROUND

Recently, the use of smartphones to deliver health-related content has experienced rapid growth, with more than 165,000 mobile health (mHealth) apps currently available in the digital marketplace. With 3 out of 4 Canadians currently owning a smartphone, mHealth apps offer opportunities to deliver accessible health-related knowledge and support. Many individuals experience pain after surgery, which can negatively impact their health-related quality of life, including sleep, emotional, and social functioning. Smartphone apps that provide remote real-time monitoring and symptom management have the potential to improve self-management skills in patients experiencing postoperative pain. Increased confidence and practice of self-management skills could contribute to decreased postoperative pain and reduce risk of developing persistent pain. Published reviews of general pain self-management apps demonstrate a lack of evidence-based content, theoretical grounding, and health care professional involvement. However, no review to date has focused on the app marketplace specific for individuals with postoperative pain.

OBJECTIVE

The aim of this study was to characterize and critically appraise the content and functionality of commercially available postoperative pain self-management apps.

METHODS

An electronic search and extraction was conducted between December 2016 and March 2017 of the official Canadian app stores for the three major smartphone operating systems (iPhone operating system [iOS], Android, and Windows). Stores were searched separately using predetermined search terms. Two authors screened apps based on information provided in the public app description. Metadata from all included apps were abstracted into a standard spreadsheet. Two authors verified the data with reference to the apps and downloaded apps themselves. The content and functionality of each app as it pertained to postoperative pain self-management was rated.

RESULTS

A total of 10 apps met the inclusion criteria. All included apps were designed exclusively for the Android platform. Education was the most common self-management feature offered (8/10, 80%), with none of the apps offering features related to goal setting or social support. Overall, no single app was comprehensive in terms of pain self-management content. Five (50%) apps reported the involvement of a health care provider in their development. However, not a single app involved end users in their development, and none of the apps underwent scientific evaluation. Additionally, none of the apps were designed for use in pediatric patients.

CONCLUSIONS

Currently available postoperative pain apps for patients lack evidence-based content, goal setting, and social support functions. There is a need to develop and test comprehensive theory-based apps to support patients with pain self-management care following surgery.

Implementation and preliminary effectiveness of a real-time pain management smartphone app for adolescents with cancer: A multicenter pilot clinical study

BACKGROUND

Pain in adolescents with cancer (12-18 years) is common and negatively impacts health-related quality of life (HRQL). The Pain Squad+ smartphone app, which provides adolescents with real-time pain self-management support, was developed to address this issue. This study evaluated the implementation of the app to inform a future randomized controlled trial (RCT) and obtain treatment effect estimates for pain intensity, pain interference, HRQL, and self-efficacy.

PROCEDURE

A one-group baseline/poststudy design with 40 adolescents recruited from two pediatric tertiary care centers was used. Baseline questionnaires were completed and adolescents used the app at least twice daily for 28 days, receiving algorithm-informed self-management advice depending on their reported pain. A nurse received alerts in response to sustained pain and contacted adolescents to assist in pain care. Poststudy questionnaires were completed. Descriptive analyses, with exploratory inferential testing conducted on health outcome data, were used to address study aims.

RESULTS

Most (40/52; 77%) eligible adolescents participated. Two participants withdrew participation. Intervention fidelity was impacted by technical difficulties (occurring for 15% of participants) and a prolonged time for nurse contact in the event of sustained pain. Adherence to pain reporting was 68.8 ± 38.1%. Outcome measure completion rates were high and the intervention was acceptable to participants. Trends in improvements in pain intensity, pain interference, and HRQL were significant, with effect sizes of 0.23-0.67.

CONCLUSIONS

Implementation of Pain Squad+ is feasible and the app appears to improve pain-related outcomes for adolescents with cancer. A multicenter RCT will be undertaken to examine app effectiveness.

Child and adolescent self-report symptom measurement in pediatric oncology research: a systematic literature review

OBJECTIVE

Previous work in pediatric oncology has found that clinicians and parents tend to under-report the frequency and severity of treatment-related symptoms compared to child self-report. As such, there is a need to identify high-quality self-report instruments to be used in pediatric oncology research studies. This study's objective was to conduct a systematic literature review of existing English language instruments used to measure self-reported symptoms in children and adolescents undergoing cancer treatment.

METHODS

A comprehensive literature search was conducted in MEDLINE/PubMed, EMBASE, CINAHL, and PsycINFO to identify relevant articles published through November 10, 2016. Using pre-specified inclusion/exclusion criteria, six trained reviewers carefully screened abstracts and full-text articles for eligibility.

RESULTS

There were 7738 non-duplicate articles identified in the literature search. Forty articles met our eligibility criteria, and within these articles, there were 38 self-report English symptom instruments. Most studies evaluated only cross-sectional psychometric properties, such as reliability or validity. Ten studies assessed an instrument's responsiveness or ability to detect changes in symptoms over time. Eight instruments met our criteria for use in future longitudinal pediatric oncology studies.

CONCLUSIONS

This systematic review aids pediatric oncology researchers in identifying and selecting appropriate symptom measures with strong psychometric evidence for their studies. Enhancing the child's voice in pediatric oncology research studies allows us to better understand the impact of cancer and its treatment on the lives of children.

Patterns of User Engagement With the Mobile App, Manage My Pain: Results of a Data Mining Investigation

BACKGROUND

Pain is one of the most prevalent health-related concerns and is among the top 3 most common reasons for seeking medical help. Scientific publications of data collected from pain tracking and monitoring apps are important to help consumers and healthcare professionals select the right app for their use.

OBJECTIVE

The main objectives of this paper were to (1) discover user engagement patterns of the pain management app, Manage My Pain, using data mining methods; and (2) identify the association between several attributes characterizing individual users and their levels of engagement.

METHODS

User engagement was defined by 2 key features of the app: longevity (number of days between the first and last pain record) and number of records. Users were divided into 5 user engagement clusters employing the k-means clustering algorithm. Each cluster was characterized by 6 attributes: gender, age, number of pain conditions, number of medications, pain severity, and opioid use. Z tests and chi-square tests were used for analyzing categorical attributes. Effects of gender and cluster on numerical attributes were analyzed using 2-way analysis of variances (ANOVAs) followed up by pairwise comparisons using Tukey honest significant difference (HSD).

RESULTS

The clustering process produced 5 clusters representing different levels of user engagement. The proportion of males and females was significantly different in 4 of the 5 clusters (all P ≤.03). The proportion of males was higher than females in users with relatively high longevity. Mean ages of users in 2 clusters with high longevity were higher than users from other 3 clusters (all P <.001). Overall, males were significantly older than females (P <.001). Across clusters, females reported more pain conditions than males (all P <.001). Users from highly engaged clusters reported taking more medication than less engaged users (all P <.001). Females reported taking a greater number of medications than males (P =.04). In 4 of 5 clusters, the percentage of males taking an opioid was significantly greater (all P ≤.05) than that of females. The proportion of males with mild pain was significantly higher than that of females in 3 clusters (all P ≤.008).

CONCLUSIONS

Although most users of the app reported being female, male users were more likely to be highly engaged in the app. Users in the most engaged clusters self-reported a higher number of pain conditions, a higher number of current medications, and a higher incidence of opioid usage. The high engagement by males in these clusters does not appear to be driven by pain severity which may, in part, be the case for females. Use of a mobile pain app may be relatively more attractive to highly-engaged males than highly-engaged females, and to those with relatively more complex chronic pain problems.

Harnessing interactive technologies to improve health outcomes in juvenile idiopathic arthritis

BACKGROUND

Children and adolescents with Juvenile Idiopathic Arthritis (JIA) typically have reduced physical activity level and impaired aerobic and anaerobic exercise capacity when compared to their non-JIA counterparts. Low intensity exercise regimens appear to be safe in children with JIA and may results in improvements in overall physical function. Poor adherence to paediatric rheumatology treatment may lead to negative clinical outcomes and possibly increased disease activity. This includes symptoms such as pain, fatigue, quality of life, longer term outcomes including joint damage, as well as increase of healthcare associated costs. Low adherence to medications such as methotrexate and biological-drugs remains a significant issue for paediatric rheumatologists, with alarming reports that less than half of the children with JIA are compliant to drug-therapy.

MAIN BODY

The recent advances in interactive technology resulting in a variety of wearable user-friendly smart devices may become a key solution to address important questions in JIA clinical management. Fully understanding the impact that arthritis and treatment complications have upon individual children and their families has long been a challenge for clinicians. Modern interactive technologies can be customised and accessed directly in the hands or wrists of children with JIA. These secured networks could be accessible 'live' at anytime and anywhere by the child, parents and clinicians. Multidisciplinary teams in paediatric rheumatology may benefit from adopting these technologies to better understand domains such as patient biological parameters, symptoms progression, adherence to drug-therapy, quality of life, and participation in physical activities. Most importantly the use of smart devices technologies may also facilitate more timely clinical decisions, improve self-management and parents awareness in the progression of their child's disease. Paediatric rheumatology research could also benefit from the use of these smart devices, as they would allow real-time access to meaningful data to thoroughly understand the disease-patterns of JIA, such as pain and physical activity outcomes. Data collection that typically occurs once every 1 or 3 months in the clinical setting could instead be gathered every week, day, minute or virtually live online. Arguably, few limitations in wearing such interactive technologies still exist and require further developments.

CONCLUSION

Finally, by embracing and adapting these new and now highly accessible interactive technologies, clinical management and research in paediatric rheumatology may be greatly advanced.

Development of a mHealth Real-Time Pain Self-Management App for Adolescents With Cancer: An Iterative Usability Testing Study [Formula: see text]

PURPOSE

A user-centered design approach was used to refine the mHealth Pain Squad+ real-time pain self-management app for adolescents with cancer for its usability (defined as being easy to use, easy to understand, efficient to complete, and acceptable).

METHOD

Three iterative usability testing cycles involving adolescent observation and interview were used to achieve this objective. During each cycle, adolescents used the app while "thinking aloud" about issues encountered. Observed difficulties and errors were recorded and a semistructured interview about the experience was conducted. Using a qualitative conventional content analysis approach, themes related to app usability were identified.

RESULTS

Participants required an average of 4.3 minutes to complete the pain assessment component of Pain Squad+. Overall, the app was acceptable. Problematic issues related to software malfunction, interface design flaws, and confusing text. Software revisions were made to address each issue.

CONCLUSION

The multifaceted usability approach used provided insight into how a real-time app can be made acceptable to adolescents with cancer and succeeded in developing a Pain Squad+ app that is fit for future effectiveness testing.

Reliability and refinement of a pain location tool for children's abdominal surgery

AIM

To determine the 'inter-rater' and test-retest reliability of a pain location tool for children.

MATERIALS & METHODS

In children aged 5-14 years who had undergone a laparoscopic operation, pain scores at each of seven abdominal locations, and at the shoulder tip, were recorded at baseline and after a 5- and 30-min interval.

RESULTS

Intraclass correlation coefficients were predominantly in the 'moderate' to 'substantial' range for both 'inter-rater' and test-retest reliability. Three quarters of children would prefer an electronic version of the tool. Thematic analysis showed accuracy, usability, utility and usefulness were areas for future development.

CONCLUSION

Children can reliably indicate where they hurt after laparoscopic surgery. An electronic version could increase acceptability to children and usability by professionals.