Teaching safety: evaluation of a children's village in Maryland

Teaching children road safety through storybooks: an approach to child health literacy in Pakistan

Background

Road traffic injuries (RTIs) commonly affect the younger population in low- and-middle-income countries. School children may be educated about road safety using storybooks with colorful pictures, which tends to increase the child’s interest in the text. Therefore, this study assessed the use of bilingual pictorial storybooks to improve RTI prevention knowledge among school children.

Methods

This pretest-posttest study was conducted in eight public and nine private schools of Karachi, Pakistan, between February to May 2015. Children in grades four and five were enrolled at baseline (n = 410). The intervention was an interactive discussion about RTI prevention using a bilingual (Urdu and English) pictorial storybook. A baseline test was conducted to assess children’s pre-existing knowledge about RTI prevention followed by administration of the intervention. Two posttests were conducted: first immediately after the intervention, and second after 2 months. Test scores were analyzed using McNemar test and paired sample t-test.

Results

There were 57% girls and 55% public school students; age range 8–16 years. Compared to the overall baseline score (5.1 ± 1.4), the number of correct answers increased in both subsequent tests (5.9 ± 1.2 and 6.1 ± 1.1 respectively, p-value < 0.001). Statistically significant improvement in mean scores was observed based on gender, grades and school type over time (p-value < 0.001).

Conclusion

Discussions using bilingual pictorial storybooks helped primary school children in Pakistan grasp knowledge of RTI prevention. RTI education sessions may be incorporated into school curricula using storybooks as teaching tools. Potential exists to create similar models for other developing countries by translating the storybooks into local languages.

Electronic supplementary material

The online version of this article (10.1186/s12887-018-0982-5) contains supplementary material, which is available to authorized users.

School-based education programmes for the prevention of unintentional injuries in children and young people

BACKGROUND

Unintentional injuries are the leading cause of death in children aged four to 18 years and are a major cause of ill health. The school setting offers the opportunity to deliver preventive interventions to a large number of children and has been used to address a range of public health problems. However, the effectiveness of the school setting for the prevention of different injury mechanisms in school-aged children is not well understood.

OBJECTIVES

To assess the effects of school-based educational programmes for the prevention of injuries in children and evaluate their impact on improving children's safety skills, behaviour and practices, and knowledge, and assess their cost-effectiveness.

SEARCH METHODS

We ran the most recent searches up to 16 September 2016 for the following electronic databases: Cochrane Injuries Group Specialised Register; Cochrane Central Register of Controlled Trials; Ovid MEDLINE(R), Ovid MEDLINE(R) In-Process & Other Non-Indexed Citations; Ovid MEDLINE(R) Daily and Ovid OLDMEDLINE(R); Embase and Embase Classic (Ovid); ISI Web of Science: Science Citation Index Expanded; ISI Web of Science Conference Proceedings Citation Index-Science; ISI Web of Science: Social Sciences Citation Index; ISI Web of Science: Conference Proceedings Citation Index - Social Sciences & Humanities; and the 14 October 2016 for the following electronic databases: Health Economics Evaluations Database (HEED); Health Technology Assessment Database (HTA); CINAHL Plus (EBSCO); ZETOC; LILACS; PsycINFO; ERIC; Dissertation Abstracts Online; IBSS; BEI; ASSIA; CSA Sociological Abstracts; Injury Prevention Web; SafetyLit; EconLit (US); PAIS; UK Clinical Research Network Study Portfolio; Open Grey; Index to Theses in the UK and Ireland; Bibliomap and TRoPHI.

SELECTION CRITERIA

We included randomised controlled trials (RCTs), non-randomised controlled trials (non-RCTs), and controlled before-and-after (CBA) studies that evaluated school-based educational programmes aimed at preventing a range of injury mechanisms. The primary outcome was self-reported or medically attended unintentional (or unspecified intent) injuries and secondary outcomes were observed safety skills, observed behaviour, self-reported behaviour and safety practices, safety knowledge, and health economic outcomes. The control groups received no intervention, a delayed injury-prevention intervention or alternative school-based curricular activities. We included studies that aimed interventions at primary or secondary prevention of injuries from more than one injury mechanism and were delivered, in part or in full, in schools catering for children aged four to 18 years.

DATA COLLECTION AND ANALYSIS

We used standard methodological procedures expected by Cochrane. Two review authors identified relevant trials from title and abstracts of studies identified in searches and two review authors extracted data from the included studies and assessed risk of bias. We grouped different types of interventions according to the outcome assessed and the injury mechanism targeted. Where data permitted, we performed random-effects meta-analyses to provide a summary of results across studies.

MAIN RESULTS

The review included 27 studies reported in 30 articles. The studies had 73,557 participants with 12 studies from the US; four from China; two from each of Australia, Canada, the Netherlands and the UK; and one from each of Israel, Greece and Brazil. Thirteen studies were RCTs, six were non-RCTs and eight were CBAs. Of the included studies, 18 provided some element of the intervention in children aged four to 11 years, 17 studies included children aged 11 to 14 years and nine studies included children aged 14 to 18 years.The overall quality of the results was poor, with the all studies assessed as being at high or unclear risks of bias across multiple domains, and varied interventions and data collection methods employed. Interventions comprised information-giving, peer education or were multi-component.Seven studies reported the primary outcome of injury occurrence and only three of these were similar enough to combine in a meta-analysis, with a pooled incidence rate ratio of 0.73 (95% confidence interval (CI) 0.49 to 1.08; 2073 children) and substantial statistical heterogeneity (I² = 63%). However, this body of evidence was low certainty, due to concerns over this heterogeneity (inconsistency) and imprecision. This heterogeneity may be explained by the non-RCT study design of one of the studies, as a sensitivity analysis with this study removed found stronger evidence of an effect and no heterogeneity (I² = 0%).Two studies report an improvement in safety skills in the intervention group. Likewise, the four studies measuring observed safety behaviour reported an improvement in the intervention group relative to the control. Thirteen out of 19 studies describing self-reported behaviour and safety practices showed improvements, and of the 21 studies assessing changes in safety knowledge, 19 reported an improvement in at least one question domain in the intervention compared to the control group. However, we were unable to pool data for our secondary outcomes, so our conclusions were limited, as they were drawn from highly diverse single studies and the body of evidence was low (safety skills) or very low (behaviour, safety knowledge) certainty. Only one study reported intervention costs but did not undertake a full economic evaluation (very low certainty evidence).

AUTHORS' CONCLUSIONS

There is insufficient evidence to determine whether school-based educational programmes can prevent unintentional injuries. More high-quality studies are needed to evaluate the impact of educational programmes on injury occurrence. There is some weak evidence that such programmes improve safety skills, behaviour/practices and knowledge, although the evidence was of low or very low quality certainty. We found insufficient economic studies to assess cost-effectiveness.

Home safety education and provision of safety equipment for injury prevention (Review)

BACKGROUND

In industrialised countries injuries (including burns, poisoning or drowning) are the leading cause of childhood death and steep social gradients exist in child injury mortality and morbidity. The majority of injuries in pre-school children occur at home but there is little meta-analytic evidence that child home safety interventions reduce injury rates or improve a range of safety practices, and little evidence on their effect by social group.

OBJECTIVES

We evaluated the effectiveness of home safety education, with or without the provision of low cost, discounted or free equipment (hereafter referred to as home safety interventions), in reducing child injury rates or increasing home safety practices and whether the effect varied by social group.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL) (2009, Issue 2) in The Cochrane Library, MEDLINE (Ovid), EMBASE (Ovid), PsycINFO (Ovid), ISI Web of Science: Science Citation Index Expanded (SCI-EXPANDED), ISI Web of Science: Social Sciences Citation Index (SSCI), ISI Web of Science: Conference Proceedings Citation Index- Science (CPCI-S), CINAHL (EBSCO) and DARE (2009, Issue 2) in The Cochrane Library. We also searched websites and conference proceedings and searched the bibliographies of relevant studies and previously published reviews. We contacted authors of included studies as well as relevant organisations. The most recent search for trials was May 2009.

SELECTION CRITERIA

Randomised controlled trials (RCTs), non-randomised controlled trials and controlled before and after (CBA) studies where home safety education with or without the provision of safety equipment was provided to those aged 19 years and under, and which reported injury, safety practices or possession of safety equipment.

DATA COLLECTION AND ANALYSIS

Two authors independently assessed study quality and extracted data. We attempted to obtain individual participant level data (IPD) for all included studies and summary data and IPD were simultaneously combined in meta-regressions by social and demographic variables. Pooled incidence rate ratios (IRR) were calculated for injuries which occurred during the studies, and pooled odds ratios were calculated for the uptake of safety equipment or safety practices, with 95% confidence intervals.

MAIN RESULTS

Ninety-eight studies, involving 2,605,044 people, are included in this review. Fifty-four studies involving 812,705 people were comparable enough to be included in at least one meta-analysis. Thirty-five (65%) studies were RCTs. Nineteen (35%) of the studies included in the meta-analysis provided IPD. There was a lack of evidence that home safety interventions reduced rates of thermal injuries or poisoning. There was some evidence that interventions may reduce injury rates after adjusting CBA studies for baseline injury rates (IRR 0.89, 95% CI 0.78 to 1.01). Greater reductions in injury rates were found for interventions delivered in the home (IRR 0.75, 95% CI 0.62 to 0.91), and for those interventions not providing safety equipment (IRR 0.78, 95% CI 0.66 to 0.92). Home safety interventions were effective in increasing the proportion of families with safe hot tap water temperatures (OR 1.41, 95% CI 1.07 to 1.86), functional smoke alarms (OR 1.81, 95% CI 1.30 to 2.52), a fire escape plan (OR 2.01, 95% CI 1.45 to 2.77), storing medicines (OR 1.53, 95% CI 1.27 to 1.84) and cleaning products (OR 1.55, 95% CI 1.22 to 1.96) out of reach, having syrup of ipecac (OR 3.34, 95% CI 1.50 to 7.44) or poison control centre numbers accessible (OR 3.30, 95% CI 1.70 to 6.39), having fitted stair gates (OR 1.61, 95% CI 1.19 to 2.17), and having socket covers on unused sockets (OR 2.69, 95% CI 1.46 to 4.96). Interventions providing free, low cost or discounted safety equipment appeared to be more effective in improving some safety practices than those interventions not doing so. There was no consistent evidence that interventions were less effective in families whose children were at greater risk of injury.

AUTHORS' CONCLUSIONS

Home safety interventions most commonly provided as one-to-one, face-to-face education, especially with the provision of safety equipment, are effective in increasing a range of safety practices. There is some evidence that such interventions may reduce injury rates, particularly where interventions are provided at home. Conflicting findings regarding interventions providing safety equipment on safety practices and injury outcomes are likely to be explained by two large studies; one clinic-based study provided equipment but did not reduce injury rates and one school-based study did not provide equipment but did demonstrate a significant reduction in injury rates. There was no consistent evidence that home safety education, with or without the provision of safety equipment, was less effective in those participants at greater risk of injury. Further studies are still required to confirm these findings with respect to injury rates.

Home safety education and provision of safety equipment for injury prevention

BACKGROUND

In industrialised countries injuries (including burns, poisoning or drowning) are the leading cause of childhood death and steep social gradients exist in child injury mortality and morbidity. The majority of injuries in pre-school children occur at home but there is little meta-analytic evidence that child home safety interventions reduce injury rates or improve a range of safety practices, and little evidence on their effect by social group.

OBJECTIVES

We evaluated the effectiveness of home safety education, with or without the provision of low cost, discounted or free equipment (hereafter referred to as home safety interventions), in reducing child injury rates or increasing home safety practices and whether the effect varied by social group.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL) (2009, Issue 2) in The Cochrane Library, MEDLINE (Ovid), EMBASE (Ovid), PsycINFO (Ovid), ISI Web of Science: Science Citation Index Expanded (SCI-EXPANDED), ISI Web of Science: Social Sciences Citation Index (SSCI), ISI Web of Science: Conference Proceedings Citation Index- Science (CPCI-S), CINAHL (EBSCO) and DARE (2009, Issue 2) in The Cochrane Library. We also searched websites and conference proceedings and searched the bibliographies of relevant studies and previously published reviews. We contacted authors of included studies as well as relevant organisations. The most recent search for trials was May 2009.

SELECTION CRITERIA

Randomised controlled trials (RCTs), non-randomised controlled trials and controlled before and after (CBA) studies where home safety education with or without the provision of safety equipment was provided to those aged 19 years and under, and which reported injury, safety practices or possession of safety equipment.

DATA COLLECTION AND ANALYSIS

Two authors independently assessed study quality and extracted data. We attempted to obtain individual participant level data (IPD) for all included studies and summary data and IPD were simultaneously combined in meta-regressions by social and demographic variables. Pooled incidence rate ratios (IRR) were calculated for injuries which occurred during the studies, and pooled odds ratios were calculated for the uptake of safety equipment or safety practices, with 95% confidence intervals.

MAIN RESULTS

Ninety-eight studies, involving 2,605,044 people, are included in this review. Fifty-four studies involving 812,705 people were comparable enough to be included in at least one meta-analysis. Thirty-five (65%) studies were RCTs. Nineteen (35%) of the studies included in the meta-analysis provided IPD.There was a lack of evidence that home safety interventions reduced rates of thermal injuries or poisoning. There was some evidence that interventions may reduce injury rates after adjusting CBA studies for baseline injury rates (IRR 0.89, 95% CI 0.78 to 1.01). Greater reductions in injury rates were found for interventions delivered in the home (IRR 0.75, 95% CI 0.62 to 0.91), and for those interventions not providing safety equipment (IRR 0.78, 95% CI 0.66 to 0.92).Home safety interventions were effective in increasing the proportion of families with safe hot tap water temperatures (OR 1.41, 95% CI 1.07 to 1.86), functional smoke alarms (OR 1.81, 95% CI 1.30 to 2.52), a fire escape plan (OR 2.01, 95% CI 1.45 to 2.77), storing medicines (OR 1.53, 95% CI 1.27 to 1.84) and cleaning products (OR 1.55, 95% CI 1.22 to 1.96) out of reach, having syrup of ipecac (OR 3.34, 95% CI 1.50 to 7.44) or poison control centre numbers accessible (OR 3.30, 95% CI 1.70 to 6.39), having fitted stair gates (OR 1.61, 95% CI 1.19 to 2.17), and having socket covers on unused sockets (OR 2.69, 95% CI 1.46 to 4.96).Interventions providing free, low cost or discounted safety equipment appeared to be more effective in improving some safety practices than those interventions not doing so. There was no consistent evidence that interventions were less effective in families whose children were at greater risk of injury.

AUTHORS' CONCLUSIONS

Home safety interventions most commonly provided as one-to-one, face-to-face education, especially with the provision of safety equipment, are effective in increasing a range of safety practices. There is some evidence that such interventions may reduce injury rates, particularly where interventions are provided at home. Conflicting findings regarding interventions providing safety equipment on safety practices and injury outcomes are likely to be explained by two large studies; one clinic-based study provided equipment but did not reduce injury rates and one school-based study did not provide equipment but did demonstrate a significant reduction in injury rates. There was no consistent evidence that home safety education, with or without the provision of safety equipment, was less effective in those participants at greater risk of injury. Further studies are still required to confirm these findings with respect to injury rates.

Children's acquisition and retention of safety skills: the Lifeskills program

OBJECTIVES

Assessment of safety skills performance and knowledge, to evaluate the education offered by the Lifeskills "Learning for Living" village, Bristol, UK which emphasizes interactive learning-by-doing.

DESIGN

Two quasi-experimental matched control group studies. Study 1: knowledge and performance three months post-intervention. Study 2: knowledge pre-intervention and post-intervention at three time points, to distinguish between immediate learning and longer term retention.

SETTING

The Lifeskills training village, Bristol, UK; primary schools in four education authorities in the area.

PARTICIPANTS

Study 1: 145 children aged 10-11 years; 109 from the Lifeskills program, 36 control. Study 2: 671 children aged 10-11 years; 511 Lifeskills, 160 control.

OUTCOME MEASURES

Three areas (road, home, and fire safety). Five performance tests: observation of children's safety skills. Five knowledge tests: pictorial quiz.

RESULTS

Study 1: Lifeskills/intervention children did better than control children on performance and knowledge tests. The knowledge-performance correlation was r = 0.51. Study 2: intervention children did better than control children immediately after the intervention and three months later on all five knowledge tests. On three tests the intervention group showed retention of knowledge from immediately post-intervention to three months, but on two tests there was some loss. This loss was primarily among children from scholastically lower achieving schools. In all other respects the intervention was equally successful for boys and girls, and for children from higher and lower achieving schools.

CONCLUSIONS

The Lifeskills package improved both knowledge and performance but had shortcomings. Complexity of material did not affect knowledge acquisition but did affect its retention.

Evaluation of interventions to prevent injuries: an overview

Overview of issues involved in evaluating the effectiveness of injury interventions is presented. An intervention should be evaluated to show it prevents injuries in the target population, to identify unintended consequences, to correct problems that limit effectiveness, to justify current and future resources from funding agencies, and to guide its replication elsewhere. Problems in conducting evaluations include obtaining sufficient resources, coping with rare events, establishing reliability and validity of measurement instruments, separating effects of multiple simultaneous events, and adjusting for the time lag between an intervention and its effects. When feasible, changes in injury rates (documented by medical records) should be used. These are more convincing for demonstrating intervention effectiveness than changes in observed or reported behaviors or in knowledge and attitudes (documented by surveys). Quasiexperimental evaluation designs are often useful, such as measuring injury rates before and after an intervention in a time series design, or intervening in one of two comparable communities in a nonequivalent control group design. Evaluations using true experimental designs, in which individuals or groups are randomized to receive or not receive an intervention, are highly desirable but are often difficult due to logistical or ethical considerations. An evaluation component should be integral to the introduction of any new injury intervention.