Development and validation of the Liverpool infant bronchiolitis severity score: a research protocol

Development of a decision support tool to prevent community acquired pressure injuries for use in the spinal cord injury clinic using the delphi technique

STUDY DESIGN

Delphi Technique.

OBJECTIVES

Describe the development of a decision support tool to prevent community-acquired pressure injuries (CAPrIs) in individuals with spinal cord injury (SCI) for use in SCI clinics, called the Community-Acquired Pressure Injury Prevention-Field Implementation Tool (CAPP-FIT).

SETTING

Veteran Health Administration Hospital, Chicago, Illinois, USA.

METHODS

Concept mapping of current pressure injury (PrI) guidelines and qualitative research describing risks, actions, and resources needed to prevent CAPrIs associated with SCI were used to develop 40 veteran checklist items (Items) along with 37 associated provider actions (Actions) for the tool. The Delphi technique was used to refine Items and Actions with a panel of interprofessional SCI providers (n = 15), veterans with SCI (n = 4), and caregivers (n = 3) to determine consensus on a 4-point Likert scale (strongly agree-strongly disagree) for each Item and Action. A 75% agreement was set for responses rated as strongly agree or agree.

RESULTS

Panelists were 60% female, 62% White, 33% veterans with SCI or caregivers, 33% wound care certified with a mean age of 59 years. Two survey rounds were required for consensus for 41 Item and 38 Action CAPP-FIT. Response rate was 95% for both rounds. Delphi round 1 showed all but two Actions affirming agreement above 75%. Substantive comments from panelists required revision to 5 Items and 9 Actions and one additional Item/Actions related to coping, meeting threshold percent agreement in Round 2.

CONCLUSIONS

The CAPP-FIT could become a useful tool for Veterans living with SCI, caregivers, and SCI providers.

Wisconsin Upper Respiratory Symptom Survey for Kids: Validation of an Illness-specific Quality of Life Instrument

BACKGROUND

Acute respiratory infections (ARIs) are the most common illness seen in the pediatric ambulatory setting. Research in this area is hampered by the lack of validated ARI measures. The aim of this study was to assess the reliability and validity of the Wisconsin Upper Respiratory Symptom Survey for Kids (WURSS-K), a 15-item instrument, which measures illness-specific symptoms and impact on quality of life during an ARI.

METHODS

WURSS-K was administered to two populations: (1) children aged 4-10 years recruited from the local community and (2) 9- and 10-year-old children from an ongoing study, the Urban Environment and Childhood Asthma.

RESULTS

Overall, 163 children with 249 ARI episodes completed WURSS-K. WURSS-K was analyzed using multiple models to evaluate reliability and validity for a two-factor structure (symptom and functionality) and a single global structure. These models provided evidence of reliability and validity with omega of 0.72 and 0.91 for symptoms and functionality along with the single structure with omega of 0.90.

CONCLUSIONS

WURSS-K shows strong psychometric properties for validity and reliability as either a single global factor or a two-factor structure. This instrument will be useful in both therapeutic trials and observational studies among children with ARI in ambulatory settings.

IMPACT

WURSS-K is a valid and reliable illness-specific quality of life instrument that evaluates the impacts of ARIs on children. WURSS-K is designed for children 4-10 years of age, for whom there is a lack of validated assessment tools. This now validated instrument will be useful for future observational studies and therapeutic trials among children with ARIs in ambulatory settings.

Developing a decision support tool to prevent community-acquired pressure injuries in spinal cord injury in ambulatory care: A nurse-led protocol for mix methods research

BACKGROUND

There is a lack of formal guidelines and decision support tools to prevent community-acquired pressure injuries (CAPrIs) in Veterans with spinal cord injury (SCI).

PURPOSE

In this article we present our research protocol that describes our plans to create and test a decision support tool to prevent CAPrIs in SCI.

METHODS

In Aim 1, we identified mental-models of CAPrI prevention from the perspectives of Veterans (using photovoice, guided tours), and Veterans Health Administration SCI providers (using interviews), and triangulation to compare the two mental-models. This led to a decision support tool developed and validated using Delphi approaches in Aim 2 and will be followed by tool automation and system redesign for pilot implementation in Aim 3.

FINDINGS

The nurse-led research protocol provides a map to systematically explore, address and translate research into evidence-based practice.

DISCUSSION

Refinement of the protocol will guide future research and implementation.

Validation of a Clinical Instrument for Measuring the Severity of Acute Bronchitis in Children - The BSS-ped

Background:

There are no validated standardised clinical procedures for severity measurement of acute bronchitis in children. The “BSS-ped”, a short version of the physician-rated assessment scale BSS (Bronchitis Severity Scale), can fill this gap, if it is valid.

Objective:

To examine the scale´s validity.

Methods:

Investigations were planned according to classical clinical-psychometric validity criteria including a formal competence evaluation of the scale´s authors and statistical analyses of data from 78 patients aged 1-6 and diagnosed with “acute bronchitis”. Cross-validation was provided by analysis of data from 70 children with matching age, sex and diagnosis. All children were examined three times (day 0, 3-5 and 7) using the BSS-ped in addition to other clinical and psychometric monitoring procedures.

Results:

The evidently high level of expertise of the scale’s authors substantiates pronounced content validity and relevance of the BSS-ped and its items. The validity criterion, i.e. to reflect the unidimensional severity of acute bronchitis and its change using the BSS-ped score, was fulfilled. There were substantial correlations with other scales measuring the current health-related quality of life, as well as satisfaction and success of treatment. Severity change prognoses for acute bronchitis under placebo and an active substance were correct. The BSS-ped was found to be a feasible instrument because it can be repeated at short intervals (minute range) without any special technical aids or extended training.

Conclusion:

The BSS-ped is a valid procedure for measuring the severity of acute bronchitis in children.

Systematic review of instruments aimed at evaluating the severity of bronchiolitis

OBJECTIVE

No recent studies have performed a systematic review of all available instruments aimed at evaluating the severity of bronchiolitis. The objective of the present study was to perform a systematic review of instruments aimed at evaluating the severity of bronchiolitis and to evaluate their measurement properties.

METHODS

A systematic search of the literature was performed in order to identify studies in which an instrument for evaluating the severity of bronchiolitis was described. Instruments were evaluated based on their reliability, validity, utility, endorsement frequency, restrictions in range, comprehension, and lack of ambiguity.

RESULTS

A total of 77 articles, describing a total of 32 different instruments were included in the review. The number of items included in the instruments ranged from 2 to 26. Upon analyzing their content, respiratory rate turned out to be the most frequently used item (in 26/32, 81.3% of the instruments), followed by wheezing (in 25/32, 78.1% of the instruments). In 18 (56.3%) instruments, there was a report of at least one of their measurement properties, mainly reliability and utility. Taking into consideration the information contained in the instruments, as well as their measurement properties, one was considered to be the best one available.

CONCLUSIONS

Among the 32 instruments aimed at evaluating the severity of bronchiolitis that were identified and systematically examined, one was considered to be the best one available. However, there is an urgent need to develop better instruments and to validate them in a more comprehensive and proper way.

Clinical respiratory scales: which one should we use?

INTRODUCTION

There are countless clinical respiratory scales for acute dyspnoea. Most healthcare professionals choose one based on previous personal experience or following local practice, unaware of the implications of their choice. The lack of critical comparisons between those different tools has been a widespread problem that only recently has begun to be addressed via score validation studies. Here we try to assess and compare the quality criteria of measurement properties of acute dyspnoea scores. Areas covered: A literature review was conducted by searching the PubMed database. Forty-five documents were deemed eligible as they reported the use or building of clinical scales, using at least two parameters, and applied these to an acute episode of respiratory dyspnoea. Our primary focus was the description of the validity, reliability and utility of 41 suitable scoring instruments. Differences in sample selection, study design, rater profiles and potential methodological shortcomings were also addressed. Expert commentary: All acute dyspnoea scores lack complete validation. In particular, the areas of measurement error and interpretability have not been addressed correctly by any of the tools reviewed. Frequent modification of pre-existing scores (in items composition and/or name), differences in study design and discrepancies in reviewed sources also hinder the search for an adequate tool.

Clinical Examination Does Not Predict Response to Albuterol in Ventilated Infants With Bronchiolitis

OBJECTIVE

Bronchiolitis is a common respiratory infection in infants that is sometimes treated with albuterol. Response to albuterol is determined by clinical assessment, but this subjective determination is potentially unreliable. In this study, we compared providers' clinical assessment of response to albuterol with the measurement of response by pulmonary mechanics in intubated, sedated, and ventilated infants.

DESIGN

Before and 20 minutes following racemic albuterol therapy, a nurse, respiratory therapist, and physician performed simultaneous examinations and assessed response to albuterol in a population of intubated infants with bronchiolitis. Measurements of ventilator-derived pulmonary mechanics were obtained at these same times.

SETTING

This study was conducted in a PICU of a children's hospital.

PATIENTS

Seventy-five paired clinical assessments were made in 25 infants who were intubated and mechanically ventilated for severe bronchiolitis.

INTERVENTIONS

Pulmonary function measurements and clinical assessments before and after administration of albuterol.

MEASUREMENTS AND MAIN RESULTS

Response to albuterol was defined using a threshold of improvement in respiratory system resistance from baseline. Nine children (36%) had greater than 20% change and were deemed responders. Providers' discrimination of response was poor. The positive predictive values of nurses, respiratory therapists, and physicians were 38%, 25%, and 25%, respectively, and the negative predictive values were 67%, 54%, and 59%, respectively. Overall accuracy was 44% for nurses, 40% for respiratory therapists, and 48% for physicians. When comparing separate assessments of wheezing, aeration, and expiratory time, there was poor agreement between groups of providers in all variables (κ < 0.4 for each).

CONCLUSIONS

A provider's clinical assessment was not a reliable method for determining response to albuterol in children with bronchiolitis. Without assessment of pulmonary mechanics, caution should be used in classifying children with bronchiolitis as responders to albuterol.

Saline in acute bronchiolitis RCT and economic evaluation: hypertonic saline in acute bronchiolitis - randomised controlled trial and systematic review

BACKGROUND

Acute bronchiolitis is the most common cause of hospitalisation in infancy. Supportive care and oxygen are the cornerstones of management. A Cochrane review concluded that the use of nebulised 3% hypertonic saline (HS) may significantly reduce the duration of hospitalisation.

OBJECTIVE

To test the hypothesis that HS reduces the time to when infants were assessed as being fit for discharge, defined as in air with saturations of > 92% for 6 hours, by 25%.

DESIGN

Parallel-group, pragmatic randomised controlled trial, cost-utility analysis and systematic review.

SETTING

Ten UK hospitals.

PARTICIPANTS

Infants with acute bronchiolitis requiring oxygen therapy were allocated within 4 hours of admission.

INTERVENTIONS

Supportive care with oxygen as required, minimal handling and fluid administration as appropriate to the severity of the disease, 3% nebulised HS every ± 6 hours.

MAIN OUTCOME MEASURES

The trial primary outcome was time until the infant met objective discharge criteria. Secondary end points included time to discharge and adverse events. The costs analysed related to length of stay (LoS), readmissions, nebulised saline and other NHS resource use. Quality-adjusted life-years (QALYs) were estimated using an existing utility decrement derived for hospitalisation in children, together with the time spent in hospital in the trial.

DATA SOURCES

We searched MEDLINE, EMBASE, the Cochrane Central Register of Controlled Trials and other databases from inception or from 2010 onwards, searched ClinicalTrials.gov and other registries and hand-searched Chest, Paediatrics and Journal of Paediatrics to January 2015.

REVIEW METHODS

We included randomised/quasi-randomised trials which compared HS versus saline (± adjunct treatment) or no treatment. We used a fixed-effects model to combine mean differences for LoS and assessed statistical heterogeneity using the I (2) statistic.

RESULTS

The trial randomised 158 infants to HS (n = 141 analysed) and 159 to standard care (n = 149 analysed). There was no difference between the two arms in the time to being declared fit for discharge [median 76.6 vs. 75.9 hours, hazard ratio (HR) 0.95, 95% confidence interval (CI) 0.75 to 1.20] or to actual discharge (median 88.5 vs. 88.7 hours, HR 0.97, 95% CI 0.76 to 1.23). There was no difference in adverse events. One infant developed bradycardia with desaturation associated with HS. Mean hospital costs were £2595 and £2727 for the control and intervention groups, respectively (p = 0.657). Incremental QALYs were 0.0000175 (p = 0.757). An incremental cost-effectiveness ratio of £7.6M per QALY gained was not appreciably altered by sensitivity analyses. The systematic review comprised 15 trials (n = 1922) including our own. HS reduced the mean LoS by -0.36 days (95% CI -0.50 to -0.22 days). High levels of heterogeneity (I (2) = 78%) indicate that the result should be treated cautiously.

CONCLUSIONS

In this trial, HS had no clinical benefit on LoS or readiness for discharge and was not a cost-effective treatment for acute bronchiolitis. Claims that HS achieves small reductions in LoS must be treated with scepticism.

FUTURE WORK

Well-powered randomised controlled trials of high-flow oxygen are needed.

STUDY REGISTRATION

This study is registered as NCT01469845 and CRD42014007569.

FUNDING DETAILS

This project was funded by the NIHR Health Technology Assessment (HTA) programme and will be published in full in Health Technology Assessment; Vol. 19, No. 66. See the HTA programme website for further project information.