The quest for trials on the efficacy of human vaccines. Results of the handsearch of Vaccine

Vaccines for women for preventing neonatal tetanus

BACKGROUND

Tetanus is an acute, often fatal, disease caused by an exotoxin produced by Clostridium tetani. It occurs in newborn infants born to mothers who do not have sufficient circulating antibodies to protect the infant passively, by transplacental transfer. Prevention may be possible by the vaccination of pregnant or non-pregnant women, or both, with tetanus toxoid, and the provision of clean delivery services. Tetanus toxoid consists of a formaldehyde-treated toxin that stimulates the production of antitoxin.

OBJECTIVES

To assess the effectiveness of tetanus toxoid, administered to women of reproductive age or pregnant women, to prevent cases of, and deaths from, neonatal tetanus.

SEARCH METHODS

We searched the Cochrane Pregnancy and Childbirth Group's Trials Register (31 January 2015), CENTRAL (The Cochrane Library 2015, Issue 1), PubMed (1966 to 28 January 2015), EMBASE (1974 to 28 January 2015) and reference lists of retrieved studies.

SELECTION CRITERIA

Randomised or quasi-randomised trials evaluating the effects of tetanus toxoid in pregnant women or women of reproductive age on numbers of neonatal tetanus cases and deaths.

DATA COLLECTION AND ANALYSIS

Two review authors independently assessed trials for inclusion and risk of bias, extracted data and checked them for accuracy.

MAIN RESULTS

Two effectiveness trials (9823 infants) and one safety trial (48 mothers) were included. The main outcomes were measured on infants born to a subset of those randomised women who became pregnant during the course of the studies. For our primary outcomes, there was no high-quality evidence according to GRADE assessments.One study (1182 infants) assessed the effectiveness of tetanus toxoid in comparison with influenza vaccine in preventing neonatal tetanus deaths. A single dose did not provide significant protection against neonatal tetanus deaths, (risk ratio (RR) 0.57, 95% confidence interval (CI) 0.26 to 1.24; 494 infants; GRADE: low-quality evidence). However, a two- or three-dose course did provide protection against neonatal deaths, (RR 0.02, 95% CI 0.00 to 0.30; 688 infants; GRADE: moderate-quality evidence). Administration of a two- or three-dose course resulted in significant protection when all causes of death are considered as an outcome (RR 0.31, 95% CI 0.17 to 0.55; 688 infants; GRADE: moderate-quality evidence). No effect was detected on causes of death other than tetanus. Cases of neonatal tetanus after at least one dose of tetanus toxoid were reduced in the tetanus toxoid group, (RR 0.20, 95% CI 0.10 to 0.40; 1182 infants; GRADE: moderate-quality evidence).Another study, involving 8641 children, assessed the effectiveness of tetanus-diphtheria toxoid in comparison with cholera toxoid in preventing neonatal mortality after one or two doses. Neonatal mortality was reduced in the tetanus-diphtheria toxoid group (RR 0.68, 95% CI 0.56 to 0.82). In preventing deaths at four to 14 days, neonatal mortality was reduced again in the tetanus-diphtheria toxoid group (RR 0.38, 95% CI 0.27 to 0.55). The quality of evidence as assessed using GRADE was found to be low.The third small trial assessed that pain at injection site was reported more frequently among pregnant women who received tetanus diphtheria acellular pertussis than placebo (RR 5.68, 95% CI 1.54 to 20.94; GRADE: moderate-quality evidence).

AUTHORS' CONCLUSIONS

Available evidence supports the implementation of immunisation practices on women of reproductive age or pregnant women in communities with similar, or higher, levels of risk of neonatal tetanus, to the two study sites.

Vaccines for women to prevent neonatal tetanus

BACKGROUND

Tetanus is an acute, often fatal, disease caused by an exotoxin produced by Clostridium tetani. It occurs in newborn infants born to mothers who do not have sufficient circulating antibodies to protect the infant passively, by transplacental transfer. Prevention may be possible by the vaccination of pregnant or non-pregnant women, or both, with tetanus toxoid, and the provision of clean delivery services. Tetanus toxoid consists of a formaldehyde-treated toxin which stimulates the production of antitoxin.

OBJECTIVES

To assess the effectiveness of tetanus toxoid, administered to women of childbearing age or pregnant women, to prevent cases of, and deaths from, neonatal tetanus.

SEARCH METHODS

We searched the Cochrane Pregnancy and Childbirth Group's Trials Register (31 October 2012), The Cochrane Library (2012, Issue 10), PubMed (1966 to 31 October 2012), EMBASE (1974 to 31 October 2012). We also used the results from handsearching and consultations with manufacturers and authors.

SELECTION CRITERIA

Randomised or quasi-randomised trials evaluating the effects of tetanus toxoid in pregnant women or women of childbearing age on numbers of neonatal tetanus cases and deaths.

DATA COLLECTION AND ANALYSIS

Three review authors independently assessed trials for inclusion and trial quality, and extracted data.

MAIN RESULTS

Two trials (10,560 infants) were included. It should be noted that these trials are very old,1966 and 1980 respectively, and one trial randomised exclusively non-pregnant women. The main outcomes were measured on infants born to a subset of those randomised women who became pregnant during the course of the studies. One study (1919 infants) assessed the effectiveness of tetanus toxoid in comparison with influenza vaccine in preventing neonatal tetanus deaths. After a single dose, the risk ratio (RR) was 0.57 (95% confidence interval (CI) 0.26 to 1.24), and the vaccine effectiveness was 43%. With a two- or three-dose course, the RR was 0.02 (95% CI 0.00 to 0.30); vaccine effectiveness was 98%. No effect was detected on causes of death other than tetanus. The RR of cases of neonatal tetanus after at least one dose of tetanus toxoid was 0.20 (95% CI 0.10 to 0.40); vaccine effectiveness was 80%. Another study, involving 8641 children, assessed the effectiveness of tetanus-diptheria toxoid in comparison with cholera toxoid in preventing neonatal mortality after one or two doses. The RR was 0.68 (95% CI 0.56 to 0.82); vaccine effectiveness was 32%. In preventing deaths at four to 14 days, the RR was 0.38 (95% CI 0.27 to 0.55), and vaccine effectiveness 62% (95% CI 45% to 73%).

AUTHORS' CONCLUSIONS

Available evidence supports the implementation of immunisation practices on women of childbearing age or pregnant women in communities with similar, or higher, levels of risk of neonatal tetanus, to the two study sites. More information is needed on possible interference of vaccination by malaria chemoprophylaxis on the roles of malnutrition and vitamin A deficiency, and on the quality of tetanus toxoid production and storage.

Vaccines for preventing cholera: killed whole cell or other subunit vaccines (injected)

BACKGROUND

Injected cholera vaccines are rarely used today, although they may have some benefit. It is valuable to summarize the evidence for effectiveness of injected cholera vaccines for comparison with newer oral vaccines (subject of a separate Cochrane Review).

OBJECTIVES

To evaluate killed whole cell (KWC) cholera vaccines and other inactive subunit vaccines (administered by injection) for preventing cholera and death, and to evaluate the adverse effects.

SEARCH STRATEGY

In September 2008, we searched the Cochrane Infectious Diseases Group Specialized Register, CENTRAL (The Cochrane Library 2008, Issue 3), EMBASE, and LILACS. We also searched reference lists and handsearched the journal Vaccine up to 1997.

SELECTION CRITERIA

Randomized and quasi-randomized controlled trials comparing injected cholera vaccines (KWC or other inactive subunit) with placebo, control vaccines, or no intervention in adults and children irrespective of immune status or special risk category.

DATA COLLECTION AND ANALYSIS

Two authors extracted data and assessed trial methodological quality independently. Dichotomous data were reported using the risk ratio (RR) with 95% confidence intervals (CI). Vaccine efficacies were also calculated (% vaccine efficacy = (1-RR) x 100%).

MAIN RESULTS

Sixteen trials, involving over one million adults, children and infants, fulfilled the inclusion criteria. Twenty-four comparisons reported on vaccine efficacy (cholera cases and/or deaths) and 11 comparisons considered adverse effects (nine reported on both). Compared to placebo, vaccinees had a reduced risk of death from cholera (RR 0.49, 95% CI 0.25 to 0.93; 837,442 participants) and a reduced risk of contracting cholera at 12 months (RR 0.52, 95% CI 0.42 to 0.65, random-effects model; 1,512,573 participants). This translates to an efficacy of 48%, 95% confidence interval 35% to 58%. Significant protection lasted for two years, even after only a single dose, and for three years with an annual booster. Children over five years and adults were protected for up to three years, while children under five years were protected for up to a year. Injected cholera vaccines were associated with more systemic and local adverse effects compared to placebo, but these were not severe or life-threatening.

AUTHORS' CONCLUSIONS

Injected cholera vaccines appear to be safe and relatively more effective than usually realized. Protection against cholera persists for up to two years following a single dose of vaccine, and for three years with an annual booster. However, they have been superseded by oral vaccines.

Handsearching versus electronic searching to identify reports of randomized trials

BACKGROUND

Systematic reviewers need to decide how best to reduce bias in identifying studies for their review. Even when journals are indexed in electronic databases, it can still be difficult to identify all relevant studies reported in these journals. Over 1700 journals have been or are being handsearched within The Cochrane Collaboration to identify reports of controlled trials in order to help address these problems.

OBJECTIVES

To review systematically empirical studies, which have compared the results of handsearching with the results of searching one or more electronic databases to identify reports of randomized trials.

SEARCH STRATEGY

Studies were sought from The Cochrane Methodology Register (The Cochrane Library, Issue 2, 2002), MEDLINE (1966 to Week 1 July 2002), EMBASE (1980 to Week 25 2002), AMED (1985 to June 2002), BIOSIS (1985 to June 2002), CINAHL (1982 to June 2002), LISA (1969 to July 2002) and PsycINFO (1972 to May 2002). Researchers who may have carried out relevant studies were contacted.

SELECTION CRITERIA

A research study was considered eligible for this review if it compared handsearching with searching one or more electronic databases to identify reports of randomized trials.

DATA COLLECTION AND ANALYSIS

The main outcome measure was the number of reports of randomized trials identified by handsearching as compared to electronic searching. Data were extracted on the electronic database searched, the complexity of electronic search strategy used, the characteristics of the journal reports identified, and the type of trial report identified.

MAIN RESULTS

Thirty-four studies were included. Handsearching identified between 92% to 100% of the total number of reports of randomized trials found in the various comparisons in this review. Searching MEDLINE retrieved 55%, EMBASE 49% and PyscINFO 67%. The retrieval rate of the electronic database varied depending on the complexity of the search. The Cochrane Highly Sensitive Search Strategy (HSSS) identified 80% of the total number of reports of randomized trials found, searches categorised as 'complex' (including the Cochrane HSSS) found 65% and 'simple' found 42%. The retrieval rate for an electronic search was higher when the search was restricted to English language journals; 62% versus 39% for journals published in languages other than English. When the search was restricted to full reports of randomized trials, the retrieval rate for an electronic search improved: a complex search strategy (including the Cochrane HSSS) retrieved 82% of the total number of such reports of randomized trials.

AUTHORS' CONCLUSIONS

Handsearching still has a valuable role to play in identifying reports of randomized trials for inclusion in systematic reviews of health care interventions, particularly in identifying trials reported as abstracts, letters and those published in languages other than English, together with all reports published in journals not indexed in electronic databases. However, where time and resources are limited, searching an electronic database using a complex search (or the Cochrane HSSS) will identify the majority of trials published as full reports in English language journals, provided, of course, that the relevant journals have been indexed in the database.

Vaccines for women to prevent neonatal tetanus

BACKGROUND

Tetanus is an acute, often fatal, disease caused by an exotoxin produced by Clostridium tetani. It occurs in newborn infants born to mothers who do not have sufficient circulating antibodies to protect the infant passively, by transplacental transfer. Prevention may be possible by the vaccination of pregnant and/or non-pregnant women with tetanus toxoid, and the provision of clean delivery services. Tetanus toxoid consists of a formaldehyde-treated toxin which stimulates the production of antitoxin.

OBJECTIVES

To assess the effectiveness of tetanus toxoid, administered to women of childbearing age or pregnant women, to prevent cases of, and deaths from, neonatal tetanus.

SEARCH STRATEGY

We searched the Cochrane Pregnancy and Childbirth Group Trials Register (December 2004) , The Cochrane Library (Issue 1, 2005), MEDLINE (1966 to December 2004), EMBASE (1974 to December 2004). We also used the results from handsearching and consultations with manufacturers and authors.

SELECTION CRITERIA

Randomised or quasi-randomised trials evaluating the effects of tetanus toxoid in pregnant women or women of childbearing age on numbers of neonatal tetanus cases and deaths.

DATA COLLECTION AND ANALYSIS

Three review authors independently assessed trials for inclusion, data extraction and trial quality.

MAIN RESULTS

Two trials (10,560 infants) were included. One study (1919 infants) assessed the effectiveness of tetanus toxoid in preventing neonatal tetanus deaths. After a single dose, the relative risk (RR) was 0.57 (95% confidence interval (CI) 0.26 to 1.24), and the vaccine effectiveness was 43%. With a two or three dose course, the RR was 0.02 (95% CI 0.00 to 0.30); vaccine effectiveness was 98%. No effect was detected on causes of death other than tetanus. The RR of cases of neonatal tetanus after at least one dose of tetanus toxoid was 0.20 (95% CI 0.10 to 0.40); vaccine effectiveness was 80%. Another study, involving 8641 children, assessed the effectiveness of tetanus-diptheria toxoid in preventing neonatal mortality after one or two doses. The RR was 0.68 (95% CI 0.56 to 0.82); vaccine effectiveness was 32%. In preventing deaths at 4 to 14 days, the RR was 0.38 (95% CI 0.27 to 0.55), and vaccine effectiveness 62% (95% CI 45% to 73%).

AUTHORS' CONCLUSIONS

Available evidence supports the implementation of immunisation practices on women of childbearing age or pregnant women in communities with similar, or higher, levels of risk of neonatal tetanus, to the two study sites. More information is needed on possible interference of vaccination by malaria chemoprophylaxis on the roles of malnutrition and vitamin A deficiency, and on the quality of tetanus toxoid production and storage.

Nearly half of dental randomized controlled trials published in German are not included in Medline

Randomized controlled trials (RCTs) are considered the most reliable type of clinical intervention studies. However, not all reports of RCTs are accessible in Medline. This can impede the validity of the results of systematic reviews. Ten German-language dental journals were manually searched to locate reports of controlled clinical trials published between 1970 and 2000. The publication type was determined and compared with Medline. Of the 15 777 articles, 210 reports of RCTs and 410 articles of non-randomized controlled clinical trials (CCTs) were identified. Only 56% of the RCTs and 75% of the CCTs are available in Medline. Of the 118 reports of RCTs registered in Medline. 15 are indexed with the correct Publication Type term. Our data suggest that (a) hand-searching plays a valuable role in identifying reports of clinical dental trials, and (b) a literature search in Medline is likely to yield incomplete results.

Demyelinating disease and hepatitis B vaccination: is there a link?

The recent decision by the French government to compensate 3 recipients of hepatitis B vaccine preceding the onset of multiple sclerosis presumes a possible causal link and brings into question the use of current rules of causality assessment. Available evidence does not support a causal link or is equivocal but the accuracy of current methods of vaccine surveillance should be urgently improved. Larger and longer randomised trials, updated summaries of evidence, linked databases, prospective vaccination registers, bar-coding of vaccines and standardisation of adverse event definitions are possible measures to address current problems.

Neuraminidase inhibitors for preventing and treating influenza in healthy adults

OBJECTIVES

Influenza is an acute respiratory infection associated with raised temperature, headache, muscle ache and cough. The objective of this review was to assess the effects of neuraminidase inhibitors (NIs) in preventing cases of influenza and shortening or reducing the severity of influenza in healthy adults. A further objective was to estimate the frequency of adverse effects associated with NI administration.

SEARCH STRATEGY

We searched Medline, the Cochrane Acute Respiratory Infections Group trials register, the Cochrane Controlled Trials Register (CCTR), manufacturers' databases, Embase (1991 to 1998) and reference lists of articles in May 1999. We also contacted manufacturers, researchers in the field, and authors of studies evaluated in the review.

SELECTION CRITERIA

Randomised or quasi-randomised placebo-controlled studies of NIs in healthy adults. Studies assessing protection or treatment from exposure to naturally occurring and experimental influenza were considered. The main outcomes were numbers and/or severity of influenza cases and the number and seriousness of adverse effects.

DATA COLLECTION AND ANALYSIS

Two reviewers applied the inclusion criteria to the retrieved studies, assessed trial quality and extracted data.

MAIN RESULTS

Eight trials with 1180 adults were included. Overall the methodological quality of the studies appeared to be good. As a preventive measure, NIs when compared to placebo were 74% effective (95% confidence interval 50% to 87%) in preventing naturally occurring cases of clinically defined influenza, and 60% effective (95% confidence interval 76% to 33%) in preventing cases of laboratory confirmed influenza. As a treatment, NIs shorten the duration of symptoms by one day - weighted mean difference 1 (95% confidence interval -1.3 to -0.6). The time gained in returning to normal activities is half a day - weighted mean difference -0.5 ( 95% confidence interval -1.1 to -0.1) for laboratory cases of influenza. The adverse event profile (local nasal irritation) of Zanamivir appears no better than placebo - odds ratio 1.19 ( 95% confidence interval 0.39 to 3.62). Compared with rimantadine in a preventive role, Oseltamivir has a significantly lower incidence of adverse effects and significantly higher incidence of nausea. For treatment, the adverse event profile shows that gastrointestinal symptoms are significantly worse in NIs than placebo - Peto odds ratio 2.32 ( 95% confidence interval 1.55 to 3.47).

REVIEWER'S CONCLUSIONS

NIs are effective for the prevention and treatment of influenza. Overall NIs are safe, although Oseltamivir causes significant nausea.

Vaccines for preventing cholera

BACKGROUND

Oral cholera vaccines (either killed whole cell or live recombinant vaccines) are newer alternatives to the parenteral vaccines which have been thought to confer only moderate and short-term immunity.

OBJECTIVES

The objective of this review was to assess the effect of cholera vaccines in preventing cases of cholera and preventing deaths.

SEARCH STRATEGY

We searched the Cochrane Infectious Diseases Group trials register, Medline, Embase and reference lists of articles. We handsearched the journal Vaccine, contacted researchers in the field and manufacturers.

SELECTION CRITERIA

Randomised and quasi-randomised studies comparing cholera vaccines (killed or live) with placebo, control vaccines or no intervention, or comparing types, doses or schedules of cholera vaccine. We included adults and children irrespective of immune status or special risk category.

DATA COLLECTION AND ANALYSIS

Data extraction and assessment of trial quality was done independently by two reviewers.

MAIN RESULTS

Thirty-two trials were included. Seventeen efficacy trials of relatively good quality, testing parenteral and oral killed whole cell vaccines and involving over 2. 6 million adults, children and infants were included. Nineteen safety trials have been conducted for both types of killed whole cell vaccines and for live vaccines and have involved 11,459 people. For all types of vaccines compared to placebo, the relative risk of contracting cholera at 12 months was 0.49, 95% confidence interval 0. 41 to 0.59 (random effects model). This translates to an efficacy of 51%, 95% confidence interval 41% to 59%. Both parenteral and oral administration were relatively efficacious, but significant protection extended into the third year for oral killed whole cell vaccines. Children under 5 were only protected for up to a year, while older children or adults were protected for up to three years. Parenteral killed whole cell vaccines were associated with increased systemic and local adverse effects compared to placebo. Oral killed whole cell vaccines or oral live vaccines were not.

REVIEWER'S CONCLUSIONS

Cholera killed whole cell vaccines appear to be relatively effective and safe. Live oral recombinant vaccines appear to be safe, but efficacy data are not available. Protection against cholera appears to persist for up to two years following a single dose of vaccine, and for three to four years with an annual booster.

Relation between experimental and non-experimental study designs. HB vaccines: a case study

STUDY OBJECTIVE

To examine the relation between experimental and non-experimental study design in vaccinology.

DESIGN

Assessment of each study design's capability of testing four aspects of vaccine performance, namely immunogenicity (the capacity to stimulate the immune system), duration of immunity conferred, incidence and seriousness of side effects, and number of infections prevented by vaccination.

SETTING

Experimental and non-experimental studies on hepatitis B (HB) vaccines in the Cochrane Vaccines Field Database.

RESULTS

Experimental and non-experimental vaccine study designs are frequently complementary but some aspects of vaccine quality can only be assessed by one of the types of study. More work needs to be done on the relation between study quality and its significance in terms of effect size.