Development and validation of study filters for identifying controlled non-randomized studies in PubMed and Ovid MEDLINE

Development of a search filter to retrieve reports of interrupted time series studies from MEDLINE and PubMed

BACKGROUND

Interrupted time series (ITS) studies contribute importantly to systematic reviews of population-level interventions. We aimed to develop and validate search filters to retrieve ITS studies in MEDLINE and PubMed.

METHODS

A total of 1017 known ITS studies (published 2013-2017) were analysed using text mining to generate candidate terms. A control set of 1398 time-series studies were used to select differentiating terms. Various combinations of candidate terms were iteratively tested to generate three search filters. An independent set of 700 ITS studies was used to validate the filters' sensitivities. The filters were test-run in Ovid MEDLINE and the records randomly screened for ITS studies to determine their precision. Finally, all MEDLINE filters were translated to PubMed format and their sensitivities in PubMed were estimated.

RESULTS

Three search filters were created in MEDLINE: a precision-maximising filter with high precision (78%; 95% CI 74%-82%) but moderate sensitivity (63%; 59%-66%), most appropriate when there are limited resources to screen studies; a sensitivity-and-precision-maximising filter with higher sensitivity (81%; 77%-83%) but lower precision (32%; 28%-36%), providing a balance between expediency and comprehensiveness; and a sensitivity-maximising filter with high sensitivity (88%; 85%-90%) but likely very low precision, useful when combined with specific content terms. Similar sensitivity estimates were found for PubMed versions.

CONCLUSION

Our filters strike different balances between comprehensiveness and screening workload and suit different research needs. Retrieval of ITS studies would be improved if authors identified the ITS design in the titles.

A mixed methods systematic review on the effects of arts interventions for children and young people at-risk of offending, or who have offended on behavioural, psychosocial, cognitive and offending outcomes: A systematic review

Background

Young people who enter the justice system experience complex health and social needs, and offending behaviour is increasingly recognised as a public health problem. Arts interventions can be used with the aim of preventing or reducing offending or reoffending.

Objectives

1. To evaluate evidence on the effectiveness and impact of arts interventions on keeping children and young people safe from involvement in violence and crime. 2. To explore factors impacting the implementation of arts interventions, and barriers and facilitators to participation and achievement of intended outcomes. 3. To develop a logic model of the processes by which arts interventions might work in preventing offending behaviours.

Search Methods

We searched AMED, Academic Search Complete; APA PsycInfo; CINAHL Plus; ERIC; SocIndex; SportDiscus, Medline, CENTRAL, Web of Science, Scopus, PTSDPubs and Performing Arts Periodicals Database, Sage, the US National Criminal Justice Reference Service, the Global Policing and British Library EThOS databases, and the National Police Library from inception to January 2023 without language restrictions.

Selection Criteria

We included randomised and non-randomised controlled trials and quasi-experimental study designs. We included qualitative studies conducted alongside intervention trials investigating experiences and perceptions of participants, and offering insight into the barriers and facilitators to delivering and receiving arts interventions. We included qualitative and mixed methods studies focused on delivery of arts interventions. We included studies from any global setting. We included studies with CYP (8-25 years) who were identified as at-risk of offending behaviour (secondary populations) or already in the criminal justice system (tertiary populations). We included studies of interventions involving arts participation as an intervention on its own or alongside other interventions. Primary outcomes were: (i) offending behaviour and (ii) anti-pro-social behaviours. Secondary outcomes were: participation/attendance at arts interventions, educational attainment, school attendance and engagement and exclusions, workplace engagement, wellbeing, costs and associated economic outcomes and adverse events.

Data Collection and Analysis

We included 43 studies (3 quantitative, 38 qualitative and 2 mixed methods). We used standard methodological procedures expected by The Campbell Collaboration. We used GRADE and GRADE CERQual to assess the certainty of and confidence in the evidence for quantitative and qualitative data respectively.

Main Results

We found insufficient evidence from quantitative studies to support or refute the effectiveness of arts interventions for CYP at-risk of or who have offended for any outcome. Qualitative evidence suggested that arts interventions may lead to positive emotions, the development of a sense of self, successful engagement in creative practices, and development of positive personal relationships. Arts interventions may need accessible and flexible delivery and are likely to be engaging if they have support from staff, family and community members, are delivered by professional artists, involve culturally relevant activity, a youth focus, regularity and a sustainable strategy. We found limited evidence that a lack of advocacy, low funding, insufficient wider support from key personnel in adjacent services could act as barriers to success. Methodological limitations resulted in a judgement of very low confidence in these findings.

Authors' Conclusions

We found insufficient evidence from quantitative studies to support or refute the effectiveness of arts interventions for CYP at-risk of offending or who have offended for any outcome. We report very low confidence about the evidence for understanding the processes influencing the successful design and delivery of arts interventions in this population of CYP and their impact on behavioural, psychosocial, cognitive and offending outcomes.

Unpacking nudge sensu lato: insights from a scoping review

Nudges may play an important role in improving infection prevention and control (IPC) in hospitals. However, despite the novelty of the framework, their objectives, strategies and implementation approaches are not new. This review aims to provide an overview of the methods typically used by nudge interventions in IPC in hospitals targeting healthcare workers (HCWs). The initial search in PubMed yielded nine hits. Consequently, the search criteria were broadened and a second search was conducted, introducing 'nudge sensu lato' which incorporates insights from sources beyond the traditional nudge framework while maintaining the same objectives, strategies and approaches. During the second search, PubMed, Epistemonikos, Web of Science and PsycInfo were searched in accordance with the PRISMA guidelines. Abstracts were screened, and reviewers from an interdisciplinary team read the full text of selected papers. In total, 5706 unique primary studies were identified. Of these, 67 were included in the review, and only four were listed as nudge sensu stricto, focusing on changing HCWs' hand hygiene. All articles reported positive intervention outcomes. Of the 56 articles focused on improving hand hygiene compliance, 71.4% had positive outcomes. For healthcare equipment disinfection, 50% of studies showed significant results. Guideline adherence interventions had a 66.7% significant outcome rate. The concept of nudge sensu lato was introduced, encompassing interventions that employ strategies, methods and implementation approaches found in the nudge framework. The findings demonstrate that this concept can enhance the scientific development of more impactful nudges. This may help clinicians, researchers and policy makers to develop and implement effective nudging interventions.

Effectiveness of endodontic tissue engineering in treatment of apical periodontitis: A systematic review

BACKGROUND

Regenerative endodontics has evolved in recent years with tissue engineering concepts in particular appearing promising. Endodontic tissue engineering (ETE) describes the various approaches based on the orthograde introduction of scaffolds or biomaterials (with or without cells) into the root canal to achieve pulp tissue regeneration. There are currently no systematic reviews investigating whether ETE is a suitable method for the treatment of endodontic disease in both mature and immature permanent teeth.

OBJECTIVES

The purpose of this systematic review was to determine the effectiveness of ETE in permanent teeth with pulp necrosis in comparison with conventional endodontic treatment.

METHODS

We searched MEDLINE, Embase and the Cochrane Library for published reports as well as Google Scholar for grey literature up to November 2021. Included were studies of patients with permanent immature or mature teeth and pulp necrosis with or without signs of apical periodontitis (P) comparing ETE (I) with calcium hydroxide apexification, apical plug and root canal treatment (C) in terms of tooth survival, pain, tenderness, swelling, need for medication (analgesics and antibiotics), radiographic evidence of reduction in apical lesion size, radiographic evidence of normal periodontal ligament space, function (fracture and restoration longevity), the need for further intervention, adverse effects (including exacerbation, restoration integrity, allergy and discolouration), oral health-related quality of life (OHRQoL), presence of sinus tract and response to sensibility testing (O). An observation period of at least 12 months was mandatory (T) and the number of patients in human experimental studies or longitudinal observational studies had to be at least 20 (10 in each arm) at the end (S). Risk of bias was appraised using the Cochrane risk-of-bias (RoB 2) tool. Two authors independently screened the records, assessed full texts for eligibility and evaluated risk of bias. Heterogeneity of outcomes and limited body of evidence did not allow for meta-analysis.

RESULTS

Two randomized clinical trials investigating cell transplantation approaches with a total of 76 participants (40 treated immature teeth and 36 treated mature teeth) were included for qualitative analysis. Both studies had moderate concerns in terms of risk of bias. Due to the lack of homogeneity a meta-analysis was not possible. Tooth survival for ETE, root canal treatment and apexification was 100% after 12 months. Teeth treated with ETE showed a higher number of cases with positive pulpal responses to sensitivity tests and with blood perfusion compared with root canal treatment or apexification.

DISCUSSION

This systematic review highlights that there is limited evidence for ETE approaches. Even though the results of this review suggest a high survival with ETE in mature and immature teeth, there is a moderate risk of bias due to methodological limitations in the included studies, so the overall results should be interpreted with caution. Lack of a robust control group was a common problem during literature screening, and outcomes besides dental survival were reported inconsistently. Future clinical trials need to address methodical as well as assessment concerns and report long-term results.

CONCLUSION

The benefits and high survival rates reported for ETE techniques suggest that this procedure might be an alternative to conventional procedures for permanent teeth with pulpal necrosis. However, more appropriate studies are needed to derive clinical recommendations.

REGISTRATION

PROSPERO (CRD42021266350).

Adherence enhancing interventions for pharmacological and oxygen therapy in patients with COPD: protocol for a systematic review and component network meta-analyses

BACKGROUND

Chronic obstructive pulmonary disease (COPD) is characterised by hyperinflation and expiratory airflow limitation due to long-term exposure to irritants. The variety and complexity of COPD treatment and the possible added comorbidities may make the patients find it difficult to cope with the required medications. That is why supporting patients' adherence is critical because not taking medications correctly increases the risk of complications and creates an additional financial burden. A range of interventions aiming to improve patient adherence were used, and most of them are complex since they involve a mix of elements. Furthermore, despite the variety of available tools, assessing adherence is challenging because clinicians usually do not get a concrete judgement if their patients followed their treatment plan reliably. We aim to evaluate the effectiveness of adherence-enhancing interventions for COPD patients, explore which intervention (component) works for which patients and check the factors influencing the implementation and participant responses.

METHODS

We will perform a comprehensive literature search (Medline, Embase, Cochrane Library, trial registries) without restrictions on language and publication status, and we will include all controlled studies investigating the effect of adherence-enhancing intervention on patients with COPD. We plan to involve COPD patients in the systematic review development through two patient interviews (one before and one after the systematic review). Two reviewers will perform the screening, data extraction and risk of bias (ROB) assessment. For ROB, we will use ROB 2.0 to assess randomised controlled trials, and ROBINS-I to assess non-randomised studies. We will perform pair-wise random-effects meta-analyses and component network meta-analyses to identify the most effective components and combinations of components. We will use the Grading of Recommendations, Assessment, Development and Evaluation (GRADE) approach to assess the quality of evidence. To determine the degree of complexity, we will use the iCAT_SR checklist, and then, following a logical model, we will group the interventions according to prespecified criteria.

DISCUSSION

This systematic review aims to point out the most effective and implementable adherence-enhancing interventions by using methods for synthesising evidence on complex interventions and involving COPD patients all along with the review process.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42022353977.

PROTOCOL: Group-based interventions for posttraumatic stress disorder: A systematic review and meta-analysis of the role of trauma type

This is the protocol for a Campbell systematic review. The primary objective is to assess the effects of group-based treatments on posttraumatic stress disorder (PTSD) symptomology in people diagnosed with PTSD (by a clinician or screening instrument) or referred to a PTSD treatment group for their symptoms by a medical professional. We will also examine a range of moderators that may affect the efficacy of group-based treatments, including the nature of the trauma (interpersonal, stigmatized) and the group fit (in terms of gender and shared vs. unshared trauma). Further, we will also explore what, if any, group-based and social identity factors are recorded and how they relate to PTSD outcomes.

PROTOCOL: A mixed methods systematic review on the effects of arts interventions for at-risk and offending children and young people on behavioural, psychosocial, cognitive and offending outcomes

This is the protocol for a Campbell systematic review. The proposed systematic review question is: What is the effectiveness of arts interventions for at-risk and offending children and young people (8-25 years)? There are three objectives: (1) To evaluate evidence on the effectiveness and impact of arts interventions on keeping children safe from involvement in violence and crime; (2) To synthesise evidence on factors impacting the implementation of arts interventions, and barriers and facilitators to participation and achievement of intended outcomes; (3) To develop a theory-of-change approach to ensure the development of an evidence-led framework of the processes by which arts interventions might work in preventing offending behaviours.

A critical analysis of clinical research methods to study regenerative endodontics

Regenerative endodontic treatment such as revitalization provides a treatment option for immature teeth with pulp necrosis. The main difference to the alternative procedure, the apical plug, is the induction of a blood clot inside the canal as a scaffold for healing and new tissue formation. Due to the biology-based and minimally-invasive nature of the treatment, revitalization has raised considerable interest in recent years. Whereas the procedure is fairly new and recommendations from endodontic societies have been in place only for a few years, the treatment protocol has evolved over the past two decades. Evidence has been created, not only from laboratory and animal work, but also from clinical studies including case reports, cohort studies and eventually prospective randomized controlled clinical trials, systematic reviews and meta-analyses. However, the research methods and clinical studies with subsequent reports oftentimes present with methodical limitations, which makes it difficult to objectively assess the value of this treatment modality. Several open questions remain, including the need for a more differentiated indication of revitalization after different traumatic injuries, the long-term prognosis of treated teeth and the true benefits for the patient. Therefore, this review aims to identify and reflect on such limitations, scrutinizing study design, diagnostic tools, procedural details and outcome parameters. A core outcome set is also proposed in this context, which can be considered in future clinical investigations. These considerations may lead to a more detailed and stringent planning and execution of future studies in order to create high-quality evidence for the treatment modality of revitalization and thus provide more robust data, create a larger body of knowledge for clinicians and further specify current recommendations.

Applying machine classifiers to update searches: Analysis from two case studies

Manual screening of citation records could be reduced by using machine classifiers to remove records of very low relevance. This seems particularly feasible for update searches, where a machine classifier can be trained from past screening decisions. However, feasibility is unclear for broad topics. We evaluate the performance and implementation of machine classifiers for update searches of public health research using two case studies. The first study evaluates the impact of using different sets of training data on classifier performance, comparing recall and screening reduction with a manual screening ‘gold standard’. The second study uses screening decisions from a review to train a classifier that is applied to rank the update search results. A stopping threshold was applied in the absence of a gold standard. Time spent screening titles and abstracts of different relevancy‐ranked records was measured. Results: Study one: Classifier performance varies according to the training data used; all custom‐built classifiers had a recall above 93% at the same threshold, achieving screening reductions between 41% and 74%. Study two: applying a classifier provided a solution for tackling a large volume of search results from the update search, and screening volume was reduced by 61%. A tentative estimate indicates over 25 h screening time was saved. In conclusion, custom‐built machine classifiers are feasible for reducing screening workload from update searches across a range of public health interventions, with some limitation on recall. Key considerations include selecting a training dataset, agreeing stopping thresholds and processes to ensure smooth workflows.

Translation and validation of PubMed and Embase search filters for identification of systematic reviews, intervention studies, and observational studies in the field of first aid

Objective

The aim of this project was to validate search filters for systematic reviews, intervention studies, and observational studies translated from Ovid MEDLINE and Embase syntax and used for searches in PubMed and Embase.com during the development of evidence summaries supporting first aid guidelines. We aimed to achieve a balance among recall, specificity, precision, and number needed to read (NNR).

Methods

Reference gold standards were constructed per study type derived from existing evidence summaries. Search filter performance was assessed through retrospective searches and measurement of relative recall, specificity, precision, and NNR when using the translated search filters. Where necessary, search filters were optimized. Adapted filters were validated in separate validation gold standards.

Results

Search filters for systematic reviews and observational studies reached recall of ≥85% in both PubMed and Embase. Corresponding specificities for systematic review filters were ≥96% in both databases, with a precision of 9.7% (NNR 10) in PubMed and 5.4% (NNR 19) in Embase. For observational study filters, specificity, precision, and NNR were 68%, 2%, and 51 in PubMed and 47%, 0.8%, and 123 in Embase, respectively. These filters were considered sufficiently effective. Search filters for intervention studies reached a recall of 85% and 83% in PubMed and Embase, respectively. Optimization led to recall of ≥95% with specificity, precision, and NNR of 49%, 1.3%, and 79 in PubMed and 56%, 0.74%, and 136 in Embase, respectively.

Conclusions

We report validated filters to search for systematic reviews, observational studies, and intervention studies in guideline projects in PubMed and Embase.com.

Whole-cell pertussis vaccine in early infancy for the prevention of allergy in children

BACKGROUND

Atopic diseases are the most common chronic conditions of childhood. The apparent rise in food anaphylaxis in young children over the past three decades is of particular concern, owing to the lack of proven prevention strategies other than the timely introduction of peanut and egg. Due to reported in vitro differences in the immune response of young infants primed with whole-cell pertussis (wP) versus acellular pertussis (aP) vaccine, we systematically appraised and synthesised evidence on the safety and the potential allergy preventive benefits of wP, to inform recommendation for future practice and research.

OBJECTIVES

To assess the efficacy and safety of wP vaccinations in comparison to aP vaccinations in early infancy for the prevention of atopic diseases in children.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials, Ovid MEDLINE, Embase, and grey literature. The date of the search was 7 September 2020.

SELECTION CRITERIA

We included randomised controlled trials (RCTs) and non-randomised studies of interventions (NRSIs) that reported the occurrence of atopic diseases, and RCTs only to assess safety outcomes. To be included studies had to have at least six months follow-up, and involve children under 18 years old, who received a first dose of either wP (experimental intervention) or aP (comparator) before six months of age.

DATA COLLECTION AND ANALYSIS

Two review authors independently screened studies for eligibility, extracted the data, and assessed risk of bias using standard Cochrane methods. We assessed the certainty of the evidence using GRADE. Our primary outcomes were diagnosis of IgE-mediated food allergy and all-cause serious adverse events (SAEs). Secondary outcomes included: diagnosis of not vaccine-associated anaphylaxis or urticaria, diagnosis of asthma, diagnosis of allergic rhinitis, diagnosis of atopic dermatitis and diagnosis of encephalopathy. Due to paucity of RCTs reporting on the atopic outcomes of interest, we assessed a broader outcome domain (cumulative incidence of atopic disease) as specified in our protocol. We summarised effect estimates as risk ratios (RR) and 95% confidence intervals (CI). Where appropriate, we pooled safety data in meta-analyses using fixed-effect Mantel-Haenszel methods, without zero-cell corrections for dichotomous outcomes.

MAIN RESULTS

We identified four eligible studies reporting on atopic outcomes, representing 7333 children. Based on a single trial, there was uncertain evidence on whether wP vaccines affected the risk of overall atopic disease (RR 0.85, 95% CI 0.62 to 1.17) or asthma only (RR 1.04, 95% CI 0.59 to 1.82; 497 children) by 2.5 years old.Three NRSIs were judged to be at serious or critical risk of bias due to confounding, missing data, or both, and were ineligible for inclusion in a narrative synthesis.  We identified 21 eligible studies (137,281 children) that reported the safety outcomes of interest. We judged seven studies to be at high risk of bias and those remaining, at unclear risk.  The pooled RR was 0.94 for all-cause SAEs (95% CI 0.78 to 1.15; I² = 0%; 15 studies, 38,072 children). For every 1000 children primed with a first dose of wP, 11 had an SAE. The corresponding risk with aP was 12 children (95% CI 9 to 13). The 95% CI around the risk difference ranged from three fewer to two more events per 1000 children, and the certainty of the evidence was judged as moderate (downgraded one level for imprecision). No diagnoses of encephalopathy following vaccination were reported (95% CI around the risk difference - 5 to 12 per 100,000 children; seven primary series studies; 115,271 children). The certainty of the evidence was judged as low, since this is a serious condition, and we could not exclude a clinically meaningful difference.

AUTHORS' CONCLUSIONS

There is very low-certainty evidence that a first dose of wP given early in infancy, compared to a first dose of aP, affects the risk of atopic diseases in children. The incidence of all-cause SAEs in wP and aP vaccinees was low, and no cases of encephalopathy were reported. The certainty of the evidence was judged as moderate for all-cause SAEs, and low for encephalopathy. Future studies should use sensitive and specific endpoints of clinical relevance, and should be conducted in settings with high prevalence of IgE-mediated food allergy. Safety endpoints should prioritise common vaccine reactions, parental acceptability, SAEs and their potential relatedness to the dose administered.