Conducting Psychoeducational Assessments During the COVID-19 Crisis: the Danger of Good Intentions

Children's communication repair strategies: Online versus face-to-face interaction

INTRODUCTION

One's ability to repair communication breakdown is an important pragmatic language skill. The present study examined children's communication repair strategies between online and face-to-face interactions using a reading comprehension task designed to probe for persistent clarification requests.

METHODS

4-6-year-old typically developing children (Age: M = 5.5years) completed a communication repair task. Online group (n = 17) completed the task online, face-to-face group(n = 22) met researchers in person. Children's responses were then categorized into verbal strategies, supplementary strategies, and nonresponses.

RESULTS

Our results showed that children can effectively employ repair strategies when a communication breakdown occurs, regardless of the communication setting in response to a series of clarification requests. However, types and patterns of communication repair strategies varied between online and face-to-face interactions. Children in online interaction showed higher use of repetition and suprasegmental strategies than did their face-to-face peers. In contrast, children in face-to-face interaction demonstrated more frequent use of revision and addition. Also, we examined the relationship between repair strategy and children's language skills. The results showed that children with better language skills used more addition, which is a more complex strategy than suprasegmental and nonresponse, and tried to use repair strategies effectively in an attempt to repair their statements as clarification requests proceeded.

CONCLUSION

It is important to understand different trends of pragmatic skills of children across online and face-to-face interaction. Guidance on the effective strategy to repair communication breakdowns depending on the different contexts needs to be considered for the successful use of online learning and telepractice.

The Experiences of Australian School Mental Health Professionals during COVID-19 Lockdowns

Young people have emerged as one of the most impacted groups from the COVID-19 pandemic and related restrictions to daily activities, with disruptions to schooling, social interactions, and connections. Simultaneously, students' access to school mental health professionals were restricted or modified. The aim of this paper was to identify how school mental health professionals supported and addressed the mental health needs of young people during COVID-19 restrictions in Australia. School mental health professionals were surveyed during the 2020 lockdowns using a questionnaire designed by researchers in the United States of America. The innovations school mental health staff adopted to support students during lockdowns and remote learning were presented, including telehealth services, digital resources, and the online training and support they received/provided. The barriers and facilitators to providing counselling and assessment services during lockdowns were identified, including issues with providing psychometric assessments during remote learning, and ethical concerns when delivering remote counselling to students. Recommendations have been included, which address how school mental health professionals could be supported to assess and treat young people during future pandemics and school restrictions.

Remote Assessment: Origins, Benefits, and Concerns

Although guidelines surrounding COVID-19 have relaxed and school-aged students are no longer required to wear masks and social distance in schools, we have become, as a nation and as a society, more comfortable working from home, learning online, and using technology as a platform to communicate ubiquitously across ecological environments. In the school psychology community, we have also become more familiar with assessing students virtually, but at what cost? While there is research suggesting score equivalency between virtual and in-person assessment, score equivalency alone is not sufficient to validate a measure or an adaptation thereof. Furthermore, the majority of psychological measures on the market are normed for in-person administration. In this paper, we will not only review the pitfalls of reliability and validity but will also unpack the ethics of remote assessment as an equitable practice.

Special Education Evaluation Considerations in a Post-pandemic Era

While disruptions to typical education, special education, and psycho-educational service delivery practices in response to the COVID-19 pandemic have dissipated, their impact magnified educational systems' overreliance on evaluations to determine eligibility for special education and related services. Given that the potential for future disruptions is now ever-present, it is imperative that service providers learn from these recent experiences to improve typical policies, procedures, and practices under normal service delivery circumstances as well as to respond efficiently and effectively to any future disruptions, should they arise. To this end, this work presents several reminders and considerations for multidisciplinary teams related to assessment, testing, special education evaluations, and closely related processes exacerbated by the COVID-19 pandemic.

Equivalency of In-Person Versus Remote Assessment: WISC-V and KTEA-3 Performance in Clinically Referred Children and Adolescents

OBJECTIVE

Teletesting has the potential to reduce numerous barriers to patient care which have only become exacerbated during the COVID-19 pandemic. Although telehealth is commonly utilized throughout medicine and mental health practices, teletesting has remained limited within cognitive and academic evaluations. This may be largely due to concern for the validity of test administration via remote assessment. This cross-sectional study examined the equivalency of cognitive [Wechsler Intelligence Scales for Children - Fifth Edition (WISC-V)] and academic [Kaufman Test of Educational Achievement - Third Edition (KTEA-3)] subtests administered via either teletesting or traditional in-person testing within clinically referred youth.

METHOD

Chart review using a retrospective, cross-sectional design included a total of 893 children and adolescents, ranging from 4 to 17 years (Mean age = 10.2 years, SD = 2.9 years) who were administered at least one subtest from the aforementioned cognitive or academic assessments. Of these, 285 received teletesting, with the remaining (n = 608) receiving in-person assessment. A total of seven subtests (five from the WISC-V and two from the KTEA-3) were examined. A series of inverse probability of exposure weighted (IPEW) linear regression models examined differences between groups for each of the seven subtests after adjustment for numerous demographic, diagnostic, and parent-reported symptom variables.

RESULTS

Only two significant differences were found, such that WISC-V Visual Puzzles (p < .01) and KTEA-3 Math Concepts (p = .03) scores were slightly higher in the teletesting versus in-person groups. However, these differences were quite small in magnitude (WISC-V Visual Puzzles, d = .33, KTEA-3 Math Concepts, d = .18).

CONCLUSIONS

Findings indicate equivalency across methods of service delivery without clinically meaningful differences in scores among referred pediatric patients.

Evaluating the Equivalence of Telepractice and Traditional Administration of the Test of Integrated Language and Literacy Skills

PURPOSE

This study evaluated the equivalence of the Test of Integrated Language and Literacy Skills (TILLS) when administrated via telepractice (Tele-TILLS) and face-to-face methods.

METHOD

Participants were 51 children and adolescents in three age bands, ages 6-7 years (n = 9), 8-11 years (n = 21), and 12-18 years (n = 21). Data were gathered by 25 volunteer examiners who assessed the same participants twice within a 2- to 4-week period, using Tele-TILLS and traditional methods in randomly selected, counterbalanced order.

RESULTS

Evaluation of identification equivalence showed 96% agreement between methods (49 of 51 decisions), with 39 agreements of no disorder, 10 agreements of yes disorder, and two disagreements (yes disorder for Tele-TILLS and no disorder for traditional). Partial correlations, controlled for test order, showed moderate to high agreement between all composite and subtest scores, except Nonword Repetition. Scoring by examiners and the first author showed high interrater agreement. No differences between Nonword Repetition scores were found for students who wore headsets (n = 12), whereas differences were found for those who did not (n = 34).

CONCLUSIONS

This study provided preliminary evidence that Tele-TILLS results can be equivalent to traditional TILLS, supporting its validity for identifying language/literacy disorder and interpreting profiles. The small, highly homogeneous sample with well-educated parents limits generalizability to the broader population. Caution is warranted when testing 6- to 7-year-old students for whom Nonword Repetition is part of the Identification Core score. Suggestions are provided for optimizing technological setup, preparing facilitators, and making minor modifications in subtest administration.

Special education staff well-being and the effectiveness of remote services during the COVID-19 pandemic

Since March 2020, many school districts across the country have employed remote learning procedures in response to the COVID-19 pandemic. During the pandemic, schools continued to provide special education services, yet little is known about how services were adapted for remote or hybrid learning during the height of the pandemic in the United States. In the current study, 332 respondents completed a web-based survey that asked what special education services were provided remotely, whether services were deemed effective, and how remote learning has influenced their well-being. Most respondents identified as White (79.5%), females (92.4%), and worked as special education teachers (52.9%) and school psychologists (35.4%). In compliance with federal guidelines, most respondents continued to hold individualized education plan meetings, conduct assessments, and provide interventions and related services. There was a significant decrease in respondents' reports of efficacy and sense of school connectedness during remote and hybrid learning. Respondents' identification as a person of color, along with reports of higher school connectedness and self-efficacy were positive predictors of their perceived effectiveness of remote special education service delivery. Recommendations are made for school districts to inform decisions regarding their approach to special education services and staff support during remote or hybrid learning.

Tele-Assessments in Rural and Remote Schools – Perspectives of Support Teachers

Tele-assessments may enable specialist evaluation of students in schools and their progress following intervention. The aim of this project was to evaluate the feasibility of using videoconferencing technology to assess students with reading difficulties in the school setting and obtain the perspectives of teachers supporting the students during the assessment. Teachers ( n = 57) of 71 primary school age students participated in the study. Teachers provided feedback on the tele-assessment by completing questionnaires about students’ behaviours and the quality of the technology and assessment process. Randomly selected teachers ( n = 24) were invited to participate in a semi-structured interview to provide qualitative feedback. Tele-assessments were completed in 93.4% of the sample. Support teachers reported satisfaction with the audio and visual quality as well as the assessment process. The majority of students completed the tele-assessment with good compliance, engagement and attention. Feedback from support teachers also reflected the strengths of tele-assessments, such as better access to service, cost saving and convenience. Barriers to tele-assessments included technical difficulties, assessment limitations and equipment issues at schools. Tele-assessment is a feasible method of objectively measuring outcomes of students following an intervention. Tele-assessment at school is largely accepted by teachers who supported students in this study. Feedback obtained from this research may be used to offer guidance on undertaking tele-assessments with students in the school setting.

Q-interactive: Training Implications for Accuracy and Technology Integration

With the iPad-mediated cognitive assessment gaining popularity with school districts and the need for alternative modes for training and instruction during this COVID-19 pandemic, school psychology training programs will need to adapt to effectively train their students to be competent in administering, scoring, an interpreting cognitive assessment instruments. This manuscript describes a mixed methods study of graduate students learning both the traditional and digital format (Q-interactive) of the WISC-V, with the goal of improving training methods and reducing administration and scoring errors. Results indicated that more errors are made on the traditional format than on the digital format, but the errors that did occur on the digital format were on subtests that require clinical acumen. Q-interactive did not reduce errors related to more complex judgments and nuanced scoring. The participating graduate students were surveyed regarding their perceptions of each format, and they revealed a majority preference for the digital format. Training implications are discussed, and specific suggestions provided for how training programs may respond to our current situation by integrating Q-interactive into their assessment courses.

Meeting the COVID-19 Deadlines: Choosing Assessments to Determine Eligibility

Timely identification of children with disabilities is required by federal special education law (Individuals with Disabilities Education Improvement Act, 20 U.S.C. § 1400, 2004). During COVID-19, school psychologists have been faced with the challenge of completing valid, comprehensive, and diagnostic assessments when traditional methods are not an option. Traditional methods of testing have become nearly impossible due to social distancing requirements; therefore, alternate methods need to be considered. These alternate methods may be unfamiliar to the practitioner and/or lack validation to use with confidence. This study offers a prospective guide to help practitioners make safe and valid test selection and interpretation decisions during a pandemic. Examples of assessments analyzed using this guide are provided for the reader. In addition, a case study is provided as an example.

Testing Our Children When the World Shuts Down: Analyzing Recommendations for Adapted Tele-Assessment during COVID-19

In 2017, the National Association of School Psychologists described tele-assessment as the least researched area of telehealth. This became problematic in 2020 when COVID-19 curtailed the administration of face-to-face assessments. Publishers began to offer computer-adapted tele-assessment methods for tests that had only previously been administered in person. Recommendations for adapted tele-assessment practice had to be developed with little empirical data. The current study analyzed recommendations from entities including professional organizations, test publishers, and governmental offices. The samples for each were small, but the findings were noteworthy. Test publishers were unanimous in recommending the use of their face-to-face assessments through adapted tele-assessment methods (either with or without caution). Governmental agencies were more likely to recommend not using adapted tele-assessment methods or to use these methods with caution. Finally, professional organizations were almost unanimous in their recommendations to use adapted tele-assessment but to do so with caution. In addition to deviations in the types of recommendations provided, entities varied in how the information was distributed. About one-fifth (23.5%) of all entities surveyed provided no recommendations at all. About 45% of the remaining entities provided recommendations on their Web sites. The rest provided information through shared documents, online toolkits, peer-reviewed journals, and emails. Implications for the field of psychology’s future crisis management planning are discussed in response to these findings.

Beyond the four walls: The evolution of school psychological services during the COVID-19 outbreak

The emergence of the novel coronavirus disease (COVID-19) in early 2020 led to the sudden temporary closure of K-12 schools across the United States. Schools were tasked with providing remote instruction to students, and many of these children continued to require mental and behavioral health services provided by school psychologists. In this study, 675 school psychologists were surveyed across the United States to examine how their roles and responsibilities changed as a result of COVID-19. Participants reported the perceived impact of COVID-19 on students' mental health and difficulty serving students and families, as well as their concerns and recommendations pertaining to school reentry. Overall, respondents in this study reported that their roles and responsibilities notably changed because of COVID-19. Participants noted their belief that children and educators will need increased mental health support upon returning to school. Implications for future practice and research are discussed.

Remote Forensic Psychological Assessment in Civil Cases: Considerations for Experts Assessing Harms from Early Life Abuse

The COVID-19 pandemic has brought to the fore the question of whether psycho-legal assessments can be executed remotely in a manner that adheres to the rigorous standards applied during in-person assessments. General guidelines have evolved, but to date, there are no explicit directives about whether and how to proceed. This paper reviews professional, ethical, and legal challenges that experts should consider before conducting such an evaluation remotely. Although the discussion is more widely applicable, remote forensic psychological assessment of adults alleging childhood abuse is used as an example throughout, due to the complexity of these cases, the ethical dilemmas they can present, and the need to carefully assess non-verbal trauma-related symptoms. The use of videoconferencing technology is considered in terms of potential benefits of this medium, as well as challenges this method could pose to aspects of interviewing and psychometric testing. The global pandemic is also considered with respect to its effects on functioning and mental health and the confounding impact such a crisis has on assessing the relationship between childhood abuse and current psychological functioning. Finally, for those evaluators who want to engage in remote assessment, practice considerations are discussed.

Operating a University Counseling and School Psychology Training Clinic in a Global Pandemic

The COVID-19 global pandemic has shaken the status quo including the way university counseling and assessment centers provide training to graduate students and psychological services to the community. The pandemic brought high levels of uncertainty and contradictory telehealth guidelines across organizations. Guidelines related to telehealth assessment services were especially challenging to navigate. Center directors worked collaboratively with faculty and campus leadership to follow best practices and mitigate training and service disruptions to the best of their ability. The tension created by the pandemic offered an opportunity for centers to challenge long-standing practices, experiment with new practices, and ultimately enhance their programs. This paper offers reflections on our experiences in following best practice guidelines for telehealth counseling and psychoeducational assessment service delivery within a university counseling and diagnostic training center. Training considerations for directors and faculty affiliated with counseling and diagnostic training centers are provided.

When You Can't R.I.O.T., R.I.O.: Tele-assessment for School Psychologists

The acronym R.I.O.T., record review, interview, observation, and test, is a well-known tool for conceptualizing a comprehensive assessment. With COVID-19 and the need to provide school psychological services virtually, it is important to reconsider R.I.O.T. in light of the limitations of virtual assessment. We describe the limitations of virtual assessment and argue that in spite of these barriers, the first three elements of R.I.O.T., record review, interviews, and observations, when used systematically, can provide useful comprehensive assessment data. Specific recommendations are provided for implementing assessment virtually.