First experience with electronic feedback of the Psychosocial Assessment Tool in pediatric cancer care

Implementation of child-centred outcome measures in routine paediatric healthcare practice: a systematic review

BACKGROUND

Person-centred outcome measures (PCOMs) are commonly used in routine adult healthcare to measure and improve outcomes, but less attention has been paid to PCOMs in children's services. The aim of this systematic review is to identify and synthesise existing evidence of the determinants, strategies, and mechanisms that influence the implementation of PCOMs into paediatric healthcare practice.

METHODS

The review was conducted and reported in accordance with PRISMA guidelines. Databased searched included CINAHL, Embase, Medline, and PsycInfo. Google scholar was also searched for grey literature on 25^th March 2022. Studies were included if the setting was a children's healthcare service, investigating the implementation or use of an outcome measure or screening tool in healthcare practice, and reported outcomes relating to use of a measure. Data were tabulated and thematically analysed through deductive coding to the constructs of the adapted-Consolidated Framework for Implementation Research (CFIR). Results were presented as a narrative synthesis, and a logic model developed.

RESULTS

We retained 69 studies, conducted across primary (n = 14), secondary (n = 13), tertiary (n = 37), and community (n = 8) healthcare settings, including both child self-report (n = 46) and parent-proxy (n = 47) measures. The most frequently reported barriers to measure implementation included staff lack of knowledge about how the measure may improve care and outcomes; the complexity of using and implementing the measure; and a lack of resources to support implementation and its continued use including funding and staff. The most frequently reported facilitators of implementation and continued use include educating and training staff and families on: how to implement and use the measure; the advantages of using PCOMs over current practice; and the benefit their use has on patient care and outcomes. The resulting logic model presents the mechanisms through which strategies can reduce the barriers to implementation and support the use of PCOMs in practice.

CONCLUSIONS

These findings can be used to support the development of context-specific implementation plans through a combination of existing strategies. This will enable the implementation of PCOMs into routine paediatric healthcare practice to empower settings to better identify and improve child-centred outcomes.

TRIAL REGISTRATION

Prospero CRD 42022330013.

Assessing the feasibility of a web-based outcome measurement system in child and adolescent mental health services - myHealthE a randomised controlled feasibility pilot study

BACKGROUND

Interest in internet-based patient reported outcome measure (PROM) collection is increasing. The NHS myHealthE (MHE) web-based monitoring system was developed to address the limitations of paper-based PROM completion. MHE provides a simple and secure way for families accessing Child and Adolescent Mental Health Services to report clinical information and track their child's progress. This study aimed to assess whether MHE improves the completion of the Strengths and Difficulties Questionnaire (SDQ) compared with paper collection. Secondary objectives were to explore caregiver satisfaction and application acceptability.

METHODS

A 12-week single-blinded randomised controlled feasibility pilot trial of MHE was conducted with 196 families accessing neurodevelopmental services in south London to examine whether electronic questionnaires are completed more readily than paper-based questionnaires over a 3-month period. Follow up process evaluation phone calls with a subset (n = 8) of caregivers explored system satisfaction and usability.

RESULTS

MHE group assignment was significantly associated with an increased probability of completing an SDQ-P in the study period (adjusted hazard ratio (HR) 12.1, 95% CI 4.7-31.0; p = <.001). Of those caregivers' who received the MHE invitation (n = 68) 69.1% completed an SDQ using the platform compared to 8.8% in the control group (n = 68). The system was well received by caregivers, who cited numerous benefits of using MHE, for example, real-time feedback and ease of completion.

CONCLUSIONS

MHE holds promise for improving PROM completion rates. Research is needed to refine MHE, evaluate large-scale MHE implementation, cost effectiveness and explore factors associated with differences in electronic questionnaire uptake.

Moving from development to implementation of digital innovations within the NHS: myHealthE, a remote monitoring system for tracking patient outcomes in child and adolescent mental health services

Objective

This paper aims to report our experience of developing, implementing, and evaluating myHealthE (MHE), a digital innovation for Child and Adolescents Mental Health Services (CAMHS), which automates the remote collection and reporting of Patient-Reported Outcome Measures (PROMs) into National Health Services (NHS) electronic healthcare records.

Methods

We describe the logistical and governance issues encountered in developing the MHE interface with patient-identifiable information, and the steps taken to overcome these development barriers. We describe the application's architecture and hosting environment to enable its operability within the NHS, as well as the capabilities needed within the technical team to bridge the gap between academic development and NHS operational teams.

Results

We present evidence on the feasibility and acceptability of this system within clinical services and the process of iterative development, highlighting additional functions that were incorporated to increase system utility.

Conclusion

This article provides a framework with which to plan, develop, and implement automated PROM collection from remote devices back to NHS infrastructure. The challenges and solutions described in this paper will be pertinent to other digital health innovation researchers aspiring to deploy interoperable systems within NHS clinical systems.

Implementation of Electronic Psychosocial Screening Among Caregivers in Pediatric Oncology

PURPOSE:

This study aimed to evaluate the reach and implementation of an electronic psychosocial screening program among caregivers of pediatric oncology patients, as well as characterize caregiver distress.

METHODS:

Participants (N = 2,013) included caregivers of patients age 0-17.99 years presenting across 9,280 outpatient oncology visits (median = 2; range = 1-52) from September 2018 to June 2019. At check-ins, caregivers electronically completed the pediatric distress thermometer via a patient-facing electronic health record (EHR) application. Caregiver distress ratings ≥ 8 triggered electronic alerts to medical teams to refer for social work support at point of care. Patient clinical and demographic differences in reach and fidelity were evaluated using univariate chi-square and t-tests. Caregivers reporting high distress were compared with caregivers without reports of high distress using univariate and multivariable logistic regression.

RESULTS:

The e-screening program was able to reach a caregiver for nearly all children seen during the study period, with 95.5% (1,923/2,013) of patients having a caregiver-completed pediatric distress thermometer. On screeners where caregivers reported high distress, medical teams made appropriate referrals to social work 95.5% (471/493) of the time. Overall, 16.9% (325/1,923) of caregivers ever indicated high distress (score ≥ 8), with caregivers of newly diagnosed (odds ratio = 3.16; 95% CI, 2.12 to 4.71) and on-therapy (odds ratio = 2.81; 95% CI, 2.11 to 3.76) patients being more likely to report high distress, compared with those who were off-treatment for the entire study.

CONCLUSION:

Leveraging EHR technology to provide evidence-based psychosocial screening can aid in successfully reaching a significant proportion of caregivers of pediatric oncology patients to identify and respond to ongoing psychosocial distress.

Families following pediatric traumatic medical events: identifying psychosocial risk profiles using latent profile analysis

BACKGROUND

Post-traumatic stress symptoms (PTSS) are often experienced by children and family members after pediatric traumatic medical events (PTMEs). Assessing families' psychosocial risk factors is a crucial part of trauma-informed practice as it helps identify risk for PTSS in the aftermath of PTME.

OBJECTIVES

Using the Psychosocial Assessment Tool 2.0 (PAT2.0), this study describes the psychosocial risk of families following PTMEs in two ways: 1. Describing the psychosocial risk defined by the PAT2.0 based on three-tiered risk levels; 2. Using latent profile analysis (LPA); identifying psychosocial risk profiles and examining how child- and injury-related factors can affect profile membership.

METHODS

Caregivers of 374 children following PTMEs admitted to a pediatric rehabilitation department in Israel completed the PAT2.0. Total PAT2.0 score and the seven PAT2.0 subscales (family structure/resources, social support, child problems, sibling problems, family problems, caregiver stress reactions, and family beliefs) were included in the first analysis. Mean PAT2.0 scores of three risk categories (universal, targeted, clinical) were calculated; LPA, which allows for cross-sectional latent variable mixture models to identify heterogeneity within a population, and multinomial logistic regressions using six out of the seven PAT2.0 subscales, were used to determine distinct profile differences and predictors of profile membership.

RESULTS

The three-tiered risk levels revealed were relatively high, as compared to levels in families of children with other clinical diagnoses. LPA yielded a three-profile solution: low family risk (63.53%); high caregiver stress, above-average levels of family risk (22.5%); and sibling problems, above-average levels of family risk (13.94%). Ethnicity and type of injury predicted group membership.

CONCLUSION

Families of children following PTMEs are at increased psychosocial risk. A clinically useful approach to identifying and preventing PTSS may be to evaluate specific domain patterns rather than just the total PAT2.0 risk level alone, based on the PAT2.0 subscales.

Evaluation of an electronic psycho-oncological adaptive screening program (EPAS) with immediate patient feedback: findings from a German cluster intervention study

PURPOSE

Distress screening has become mandatory and essential in comprehensive cancer care. We evaluated an electronic psycho-oncological adaptive screening (EPAS) which assesses objective indicators of care needs and subjectively perceived care needs and subsequently provides patient feedback with individualized recommendations about psychosocial care services.

METHODS

Patients were assessed within clusters, i.e., different oncological facilities of the competence network of the University Cancer Center Hamburg (UCCH). Patients in the intervention arm underwent the screening, controls received standard care. Patients were assessed at baseline (t0), 3-month (t1), and 6-month (t2) follow-up. Outcomes included information level and use of/access to nine psychosocial services at UCCH, well-being (GAD-7, PHQ-9, SF-8), and treatment satisfaction (SCCC). Conditional linear and logistic regressions were used to identify screening effects at t1 and t2.

RESULTS

Of 1320 eligible patients across 11 clusters, 660 were included (50%). The average age was 60 years; 46% were female. The intervention was associated with increased information level for all psychosocial services at t1 and t2 (all p < .001), increased use in some of these services at t1 and t2, respectively (p ≤ .02), and better evaluation of access (e.g., more recommendations for services provided by physicians, p < .01). At t2, the intervention was associated with a lower level of satisfaction with disease-related information (p = .02).

CONCLUSIONS

EPAS may improve information about psychosocial services as well as utilization of and access to these services. The effect on information level seems not to be generalizable to other aspects of oncological care. Future studies should incorporate novel technologies and condense the procedure to its core factors.

IMPLICATIONS FOR CANCER SURVIVORS

The screening may help to enhance self-management competencies among cancer survivors.

TRIAL REGISTRATION

The trial was retrospectively registered (2/2021) at ClinicalTrials.gov (number: NCT04749056).

Uptake of an Integrated Electronic Questionnaire System in Community Pediatric Clinics

OBJECTIVE

The study aimed to evaluate an integrated electronic questionnaire system implementation in outpatient community pediatric practices on workflow, completion rates, and recorded scores.

METHODS

We evaluated the implementation and outcomes of an integrated electronic questionnaire system at 45 community pediatric practices that used standardized questionnaires to screen for autism, depression, and substance use and to measure asthma control. Electronic health record (EHR) data for all well child visits were extracted for the 3 months before and after implementation. We used statistical process control charts to evaluate questionnaire completion rates and Chi-square tests to evaluate screening completion and positive screening rates. The collection and entry of questionnaire information was observed and timed.

RESULTS

EHR data included 107,120 encounters across 45 practices that showed significant and sustained improvement in completion rates for all questionnaires. The rate of recorded concerning questionnaires decreased for asthma control (19.3 vs. 12.8%, p < 0.001), stayed the same for autism (96.6 vs. 96.2%, p = 0.38), decreased for depression (9.5 vs. 6.7%, p ≤ 0.001), and increased for any substance use (9.8 vs. 12.8%, p < 0.001). Twelve practices were observed, and patient time and staff time managing questionnaires were decreased after implementation.

DISCUSSION

Electronic questionnaire administration saved staff time and patient time. We report overall improvement in questionnaire completion rates, with notable variation in improvement in completion across practices and in change in concerning recorded result rates across measures.

CONCLUSION

Conversion of four standard paper questionnaires to an integrated electronic system reduces patient and staff time while increasing completion rates when well integrated into routine care.

Patient-Reported and Parent Proxy-Reported Outcomes in Pediatric Medical Specialty Clinical Settings: A Systematic Review of Implementation

OBJECTIVE

Youth with chronic illness are at higher risk for psychosocial difficulties, leading to a call for screening via patient-reported outcomes (PROs). The purpose of the current review is to summarize PRO implementation in pediatric medical specialty settings. A literature review of PRO implementation in these settings, conceptual issues, value and approach, legal and ethical concerns, as well as a case example of PROA in type 1 diabetes are presented.

METHODS

A systematic review was conducted to identify relevant articles published since the most recent Journal of Pediatric Psychology Special Issue on Evidence-Based Assessment in Pediatric Psychology (2008).

RESULTS

Thirty-two articles were identified and reviewed. The majority of studies reported that PROA was feasible, did not disrupt clinic flow, identified psychosocial issues warranting intervention, and was acceptable to families and providers. Response to elevated scores and impact on behavioral health referrals varied.

CONCLUSION

While many evidenced-based assessment measures are well-validated within pediatric chronic illness groups, the literature regarding implementation of PROs is still emerging. Research findings are promising, with PROs being feasible, acceptable, and leading to increased discussion of psychosocial issues when integrated into pediatric medical settings. Additional research is needed to evaluate the longitudinal impact of PROs and the optimal manner of responding to assessment data, particularly when clinically-elevated. Ultimately, identifying psychosocial issues in pediatric medical settings can promote optimal health and well-being of youth with chronic illness and their families.

Quality of life in pediatric oncology patients, caregivers and siblings after psychosocial screening: a randomized controlled trial

OBJECTIVE

We evaluated whether conducting psychosocial screening using a validated measure (the Psychosocial Assessment Tool, PAT) and providing a summary of PAT results to the patient's treating team improves quality of life (QOL) in newly diagnosed patients with cancer, their caregivers and siblings, in general, and in relation to the initial family psychosocial risk.

METHODS

Families were randomly allocated to an intervention (IG, treating team received PAT summary describing low, medium, or high psychosocial risk) or control group (CG, no summary provided to treating team) in two Canadian pediatric cancer centers. Caregivers (N = 122) of children newly diagnosed with cancer, patients (n = 36), and siblings (n = 25) completed QOL assessments at 2-4 weeks (T1) and 6 months post-diagnosis (T2). Caregivers also completed PAT and proxy QOL for patient and sibling.

RESULTS

In general, patient-proxy total QOL improved in IG compared to CG over time but only for high psychosocial risk patients (p < .05). Patient proxy cancer-related QOL improved over time regardless of group allocation; caregiver QOL also improved over time (ps < .05).

CONCLUSION

This study demonstrated the benefits of psychosocial screening results only on proxy patient QOL outcomes with high psychosocial risk near diagnosis. Evaluating QOL benefits in pediatric oncology patients is critical for establishing the clinical value of psychosocial screening.

CLINICAL TRIAL REGISTRATION NUMBER

NCT02788604 (REGISTERED WITH HTTPS://CLINICALTRIALS.GOV/CT2/SHOW/NCT02788604 ).

Healthcare provider utility ratings of a psychosocial screening summary: from diagnosis to 6 months

BACKGROUND

Psychosocial screening has been proposed as a core standard of care in pediatric oncology. However, there has been limited application of this standard thus far. Understanding healthcare provider (HCP) attitudes towards psychosocial screening is an important element towards furthering implementation initiatives of standard screening practices in pediatric oncology.

OBJECTIVE

To compare HCP perceptions of the utility of a psychosocial risk summary by discipline (oncologist, nurse, social worker), risk level (Universal, Targeted, Clinical) derived from the Psychosocial Assessment Tool (PAT), and time (shortly after a child's diagnosis [T1] and 6 months later [T2]).

METHOD

All participating HCPs (oncologists, nurses, social workers) were asked to rate how useful they found the psychosocial risk summary using a visual analogue scale (VAS).

RESULTS

The psychosocial risk summary was perceived as equally useful across providers (oncologists, nurses, social workers) and PAT risk levels at T1. At T2, the psychosocial risk summary was perceived as more useful by oncologists and nurses than social workers, and summaries indicating elevated risk were perceived as more useful than those indicating low risk. Overall, healthcare providers reported greater utility of psychosocial risk summary near diagnosis compared with 6 months later, largely driven by lower utility ratings reported by social workers at T2.

CONCLUSION

Understanding perceived utility and factors affecting perceived utility is a key component to designing effective implementation strategies for systematic psychosocial screening. Active engagement of HCPs in the screening process is critical in improving implementation of psychosocial screening throughout pediatric cancer treatment.

Screening for Family Psychosocial Risk in Pediatric Hematopoietic Stem Cell Transplantation with the Psychosocial Assessment Tool

Family psychosocial risk screening is an important initial step in delivering evidence-based care in hematopoietic stem cell transplantation (HCT). Establishing an evidence-based screening approach that is acceptable, reliable, and valid is an essential step in psychosocial care delivery. This is a 3-institution multimethod study. In part 1, caregivers of children about to undergo HCT (n = 140) completed the Psychosocial Assessment Tool-Hematopoietic Cell Transplantation (PAT-HCT), a brief parent report screener adapted for HCT, and validating questionnaires. Families received feedback on their risks identified on the PAT-HCT. In part 2, 12 caregivers completed a semistructured interview about their perceptions of the PAT and the feedback process. The reliability and validity of the PAT-HCT total and subscale scores were tested using Kuder-Richardson-20 (KR-20) and Pearson correlations. Thematic content analysis was used to analyze the qualitative interview data. Internal consistency for the total score (KR-20 = .88) and the Child Problems, Sibling Problems, Family Problems, and Stress Reactions subscales were strong (KR-20 >.70). Family Structure, Social Support, and Family Beliefs subscales were adequate (KR-20 = .55 to .63). Moderate to strong correlations with the criteria measures provided validation for the total and subscale scores. Feedback was provided to 97.14% of the families who completed the PAT-HCT, and the mean rating of acceptability was >4.00 (on a 5-point scale). The qualitative data indicate that families appreciate the effort to provide screening and feedback. The PAT-HCT is a psychometrically sound screener for use in HCT. Feedback can be given to families. Both the screener and the feedback process are acceptable to caregivers.