Teacher- versus peer-mediated instruction: an ecobehavioral analysis of achievement outcomes

Associations Between Preschool Sleep Problems and Observed Dimensions of Elementary Classroom Engagement

Sleep has clear importance for academic success. However, most research in this area has focused on older children and adolescents and has used narrow measures of academic achievement, overlooking the importance of early sleep problems in shaping children's classroom behaviors that support academic success. Using a community sample (N = 276, 50% female), the current study examined associations between parent-reported preschool sleep problems (M _age = 3.84, SD = 0.83) and three dimensions of classroom engagement coded during live classroom observations in the first grade (M _age = 6.72, SD = 0.34). The moderating role of family socioeconomic status (SES) was also considered. A multivariate multilevel model found that more preschool sleep problems were associated with less focused engagement (defined as involvement in academic tasks, such as writing or asking questions), but more competing responses (defined as inappropriate or distracting behaviors). Preschool sleep problems were not associated with task management (defined as preparation for academic tasks, such as locating classroom materials). Although family SES did not moderate any of these associations, higher income-to-needs ratios in preschool were associated with more focused engagement and fewer competing responses. Findings highlight the role of early sleep problems in classroom behaviors that facilitate academic success. Targeting sleep problems prior to the school transition may serve as a useful approach to optimizing learning conditions during this key developmental period.

Targeted school-based interventions for improving reading and mathematics for students with or at risk of academic difficulties in Grades K-6: A systematic review

Background

Low levels of numeracy and literacy skills are associated with a range of negative outcomes later in life, such as reduced earnings and health. Obtaining information about effective interventions for children with or at risk of academic difficulties is therefore important.

Objectives

The main objective was to assess the effectiveness of interventions targeting students with or at risk of academic difficulties in kindergarten to Grade 6.

Search Methods

We searched electronic databases from 1980 to July 2018. We searched multiple international electronic databases (in total 15), seven national repositories, and performed a search of the grey literature using governmental sites, academic clearinghouses and repositories for reports and working papers, and trial registries (10 sources). We hand searched recent volumes of six journals and contacted international experts. Lastly, we used included studies and 23 previously published reviews for citation tracking.

Selection Criteria

Studies had to meet the following criteria to be included: Population: The population eligible for the review included students attending regular schools in kindergarten to Grade 6, who were having academic difficulties, or were at risk of such difficulties. Intervention: We included interventions that sought to improve academic skills, were conducted in schools during the regular school year, and were targeted (selected or indicated). Comparison: Included studies used an intervention-control group design or a comparison group design. We included randomised controlled trials (RCT); quasi-randomised controlled trials (QRCT); and quasi-experimental studies (QES). Outcomes: Included studies used standardised tests in reading or mathematics. Setting: Studies carried out in regular schools in an OECD country were included.

Data Collection and Analysis

Descriptive and numerical characteristics of included studies were coded by members of the review team. A review author independently checked coding. We used an extended version of the Cochrane Risk of Bias tool to assess risk of bias. We used random-effects meta-analysis and robust-variance estimation procedures to synthesise effect sizes. We conducted separate meta-analyses for tests performed within three months of the end of interventions (short-term effects) and longer follow-up periods. For short-term effects, we performed subgroup and moderator analyses focused on instructional methods and content domains. We assessed sensitivity of the results to effect size measurement, outliers, clustered assignment of treatment, risk of bias, missing moderator information, control group progression, and publication bias.

Results

We found in total 24,414 potentially relevant records, screened 4247 of them in full text, and included 607 studies that met the inclusion criteria. We included 205 studies of a wide range of intervention types in at least one meta-analysis (202 intervention-control studies and 3 comparison designs). The reasons for excluding studies from the analysis were that they had too high risk of bias (257), compared two alternative interventions (104 studies), lacked necessary information (24 studies), or used overlapping samples (17 studies). The total number of student observations in the analysed studies was 226,745. There were 93% RCTs among the 327 interventions we included in the meta-analysis of intervention-control contrasts and 86% were from the United States. The target group consisted of, on average, 45% girls, 65% minority students, and 69% low-income students. The mean Grade was 2.4. Most studies included in the meta-analysis had a moderate to high risk of bias.The overall average effect sizes (ES) for short-term and follow-up outcomes were positive and statistically significant (ES = 0.30, 95% confidence interval [CI] = [0.25, 0.34] and ES = 0.27, 95% CI = [0.17, 0.36]), respectively). The effect sizes correspond to around one third to one half of the achievement gap between fourth Grade students with high and low socioeconomic status in the United States and to a 58% chance that a randomly selected score of an intervention group student is greater than the score of a randomly selected control group student.All measures indicated substantial heterogeneity across short-term effect sizes. Follow-up outcomes pertain almost exclusively to studies examining small-group instruction by adults and effects on reading measures. The follow-up effect sizes were considerably less heterogeneous than the short-term effect sizes, although there was still statistically significant heterogeneity.Two instructional methods, peer-assisted instruction and small-group instruction by adults, had large and statistically significant average effect sizes that were robust across specifications in the subgroup analysis of short-term effects (ES around 0.35-0.45). In meta-regressions that adjusted for methods, content domains, and other study characteristics, they had significantly larger effect sizes than computer-assisted instruction, coaching of personnel, incentives, and progress monitoring. Peer-assisted instruction also had significantly larger effect sizes than medium-group instruction. Besides peer-assisted instruction and small-group instruction, no other methods were consistently significant across the analyses that tried to isolate the association between a specific method and effect sizes. However, most analyses showed statistically significant heterogeneity also within categories of instructional methods.We found little evidence that effect sizes were larger in some content domains than others. Fractions had significantly higher associations with effect sizes than all other math domains, but there were only six studies of interventions targeting fractions. We found no evidence of adverse effects in the sense that no method or domain had robustly negative associations with effect sizes.The meta-regressions revealed few other significant moderators. Interventions in higher Grades tend to have somewhat lower effect sizes, whereas there were no significant differences between QES and RCTs, general tests and tests of subdomains, and math tests and reading tests.

Authors’ Conclusions

Our results indicate that interventions targeting students with or at risk of academic difficulties from kindergarten to Grade 6 have on average positive and statistically significant short-term and follow-up effects on standardised tests in reading and mathematics. Peer-assisted instruction and small-group instruction are likely to be effective components of such interventions.We believe the relatively large effect sizes together with the substantial unexplained heterogeneity imply that schools can reduce the achievement gap between students with or at risk of academic difficulties and not-at-risk students by implementing targeted interventions, and that more research into the design of effective interventions is needed.

Effects of a peer-mediated performance improvement intervention on recording of child well-body checks by educational care-providers

We report the effects of peer-mediated training as a performance improvement intervention on recording of well-body checks by classroom instructors at a specialized school for children and youth. The instructors were trained as peer mediators and then assumed performance monitoring responsibilities in the classroom. Compared to baseline phases in a withdrawal design, peer-mediation increased recording of well-body checks to near-100% among the instructors. Results of the study document positive training effects on a critical health and wellness objective, support and expand the limited research base concerning the effects of peer-mediated training, suggest further application of such training in human services settings.

Recitation as a structured intervention to enhance the long-term verbatim retention and gist recall of complex texts in kindergarteners

Recitation is an effective way for children to become familiar with basic blocks of knowledge. It is not clear, however, whether repeated structured exposure to complex texts via listening or active reciting benefits the ability of kindergarteners to retain verbal material in long-term memory verbatim and as content. Here, we tested the effectiveness of teaching longer texts to kindergarteners by repeated exposure in terms of long-term retention (6 months). A set of 28 rhyming sentences (224 words) were introduced, 3 in each session, and the increasingly longer text was practiced by either voiced recitation or listening. The rhymes were in a literary language, and word meaning in each new rhyme was elaborated when first introduced. Both groups (recitation and listening) showed good long-term retention, but the recitation group outperformed the listening group when assessed at 24 h, 1 month, and 6 months postintervention in terms of the recall rate, error rate, number of prompts required, and sequence fidelity. In the later assessments, the reciting group was the more fluent group in producing the rhymes. Moreover, at 6 months postintervention, the gist (content) of the rhymes and the meaning of vocabulary items from the texts were robustly retained, with an advantage for the recitation group. Thus, practice in affording multiple repetitions, specifically active recitation, resulted in fluent, effortless, and accurate recall of statements and their content. We propose that these results support the notion that repetition-based practice may promote the mastery of complex verbal material by enabling better engagement of procedural memory, that is, by promoting "proceduralization" processes.

“Hey Dad, Watch Me”: The Effects of Training a Child to Teach Pain Management Skills to a Parent With Recurrent Headaches

This study examines the efficacy of a cognitive-behavioural program for recurrent headaches which was first implemented with an 8-year-old boy suffering from headaches. The child was subsequently trained to implement the same intervention with his father who also suffered from headaches. The treatment involved pain management skills, such as relaxation training, imagery, positive self-talk, and distraction techniques. In addition, a parent contingency management component involving the mother was employed. The treatment intervention was sequentially introduced to the child and father in a nonconcurrent multiple-baseline across-subjects design. Headache diaries and self-report measures were completed by both clients. From pre- to posttreatment there was respectively a 92.5% and 86.7% improvement in headache frequency, a 67% and 85% improvement in mean headache intensity and a 89.44% and 28% improvement in headache duration. Three-month follow-up data showed that both subjects had 100% improvement rates on all headache measures. The results highlight that some children can successfully teach their parents pain management skills. Possible implications of the results for the treatment of families, where multiple family members suffer from pain, are discussed.

Improving oral reading fluency with a peer-mediated intervention

This study examined the effects of an experimentally derived, peer-delivered reading intervention on the oral reading fluency of a first-grade student who had been referred for poor reading fluency. Same-grade peers were trained to lead the target student through a structured intervention protocol based on the results of a brief experimental analysis. Results indicated that reading improvements were obtained and are discussed in terms of selecting efficient interventions for use by peers.

Effect of response practice variables on learning spelling and sight vocabulary

Four experiments were conducted to examine variables associated with response practice as an instructional technique for individuals with intellectual disabilities. In Experiment 1, the effect of the cover component in the "cover write" method was evaluated, as were the comparative effects of written versus oral practice of spelling words by rehabilitation clients. The results showed that the cover procedure generally did not enhance performance over and above that produced by practice alone, and written practice generally was not superior to oral practice. Experiment 2 demonstrated that less response practice (i.e., five times) was as effective as more practice (i.e., 10 and 15 times) for teaching spelling to adolescents with developmental disabilities. Experiments 3 and 4 also showed that even less response practice (i.e., one time) was as effective as more practice (five times), and irrelevant practice following errors was as effective as relevant practice for teaching spelling and sight vocabulary to adolescents with behavior disorders and developmental disabilities, respectively. The findings suggest that a parsimonious procedure of limited response practice and positive reinforcement may be effective for the tasks and populations studied.

Academic effects of providing peer support in general education classrooms on students without disabilities

We studied the academic effects on peers without disabilities of serving as peer supports for students with disabilities in general education classrooms. Three peers were studied using a range of indicators, including academic engagement, coursework performance, and social validity assessments. Peers assisting a student with disabilities via curricular adaptation, assignment completion, and social facilitation constituted the multicomponent independent variable. We used withdrawal or multiple baseline designs to demonstrate positive benefits for peers for all measures used. In addition, follow-up data for 2 peers indicated that the positive changes associated with serving as a peer support were maintained for up to 2 months. Our results are discussed in relation to the possible academic and social effects of providing peer supports in general education classrooms for students with and without disabilities.

Classwide peer tutoring: an integration strategy to improve reading skills and promote peer interactions among students with autism and general education peers

A multiple baseline design across subjects with a reversal was used to examine the effects of classwide peer tutoring relative to traditional reading instruction on reading skills and social interaction time for 3 high-functioning students with autism and their typical peers in integrated, general education classrooms. Traditional reading instruction consisted largely of teacher-led instruction with individual student participation and seat work. Classwide peer tutoring consisted of 25 to 30 min of well-specified instruction in which tutor-learner pairs worked together on a classwide basis on reading fluency and comprehension skills. All students participated in 15- to 20-min unstructured free-time activities immediately following reading instruction. Results of reading assessments demonstrated that classwide peer tutoring increased reading fluency and correct responses to reading comprehension questions for students with autism and their peers. The procedure further increased the total duration of free-time social interactions for students with autism and typical peers, with individual variation in performance.

The classwide peer tutoring program: implementation factors moderating students' achievement

We conducted a study designed to assess implementation of the classwide peer tutoring program and the relationship between implementation variation and student outcome. A clinical replication design was used. Five volunteer elementary teachers were trained to implement the program; their implementation was monitored for 19 consecutive weeks during 1 school year. Overall, the results indicated that specific variations in program implementation were associated with students' responses to treatment. It was also demonstrated that different teachers' applications of the program produced differential levels of student outcome. Implementation factors related to lower spelling achievement were (a) reduced opportunities to receive program sessions, (b) reduced probabilities of students' participation in program opportunities, (c) too many students assigned unchallenging spelling words, and (d) reduced rates of daily point earning reflecting lower levels of spelling practice during tutoring sessions. The implications of these findings and methods of preventing these implementation problems are discussed in the context of quality assurance and social validity.

Effects of contextual competence on social initiations

The frequency of social initiations and satisfaction with interactions in three dyads, each consisting of 1 student with disabilities and 1 nondisabled peer, were assessed under two alternating conditions: Condition 1 assessed the interactions around a set of four trained computer games, and Condition 2 assessed interactions when students were playing a set of four untrained computer games. Training was conducted with a multiple baseline design across participants and was followed by social interaction probes using an alternating treatments design. The results indicated greater frequencies of social initiation by 5 of 6 participants, higher degrees of game satisfaction by all participants, and equal or higher degrees of peer satisfaction by 5 of 6 participants when playing trained games in comparison to untrained games.

Assessing and improving child care: a personal appearance index for children with autism

An index of children's physical appearance and personal care was developed and used to assess youngsters with autism who lived (a) at home, (b) in an established group home, (c) in new group homes, and (d) in a large institution. Subsequently, a multiple baseline design across participants documented major changes in personal appearance and cleanliness when children moved from an institution to community-based, family-style group homes. Finally, data-based feedback generated by the appearance index was used as a training tool enabling group home staff to further improve child appearance. This research demonstrates how an evaluation instrument can be used to obtain comparative data, measure some effects of different residential placements, and provide ongoing feedback to caregivers to promote high standards of personal care among persons with severe developmental disabilities.

Effects of collateral peer supportive behaviors within the classwide peer tutoring program

A classwide peer tutoring procedure was implemented in an urban elementary school classroom to improve students' spelling performance. Three students combined untrained or collateral tutoring behaviors with the core behaviors initially taught. To explore the function of these natural and spontaneous behaviors, a multielement single-subject experiment with replications was conducted. Results indicated that the additional tutoring behaviors increased (a) the academic response frequencies of 3 tutees and (b) the weekly spelling achievement of 1 target tutee. The remaining class members were successfully taught and continued to use these behaviors over the final 3 weeks of the school year. These findings are discussed with regard to academic instruction, natural communities of peer reinforcement, and the social validation of intervention procedures.

A comparison of peer-directed and teacher-directed employment interview training for mentally retarded adults

Interview skills deficits may limit employment prospects of mentally retarded adults. Although numerous papers highlight the importance of interview skills, few have validated effective strategies for use with mentally retarded persons. Further, there has been a lack of research contrasting rival interview skills training strategies. The present study was conducted with two mentally retarded young adults. It contrasted peer-directed instruction, in which both participants were equally deficient in the target skills, with teacher-directed instruction. Results of the investigation indicated that instruction, rehearsal, and feedback may be effective strategies regardless of who provides instruction. Comparisons of teacher-directed and peer-directed instruction indicated little or no difference in the effectiveness of the two procedures. However, the peer-directed procedure involved considerably less staff time than did the teacher-directed procedure.

Field replication of classwide peer tutoring

We conducted a large-scale field replication study of classwide peer tutoring applied to spelling instruction (Greenwood, Delquadri, & Hall, 1984). Two hundred and eleven inner-city students in four schools participated during their first- and second-grade school years. The effects of classwide peer tutoring were compared to teacher instructional procedures and pretest probes using a group replication design (Barlow, Hayes, & Nelson, 1984). Analysis of group and individual results indicated that (a) both teacher instructional procedures and classwide peer tutoring were effective in increasing spelling performance above pretest levels, (b) peer tutoring produced statistically greater gains relative to the teachers' procedures for both low and high student groups formed on pretest levels, (c) these outcomes were representative of groups, classes, individuals, and years during the project, and (d) participant satisfaction with the program was generally high. A separate analysis of the social importance of treatment outcome revealed differential findings for low and high groups related to pretest levels. Implications of these findings are discussed.