Remote Assessment of Cognitive Function in Juvenile Neuronal Ceroid Lipofuscinosis (Batten disease): A Pilot Study of Feasibility and Reliability

Development of an Infantile GM2 Clinical Rating Scale: Remote Assessment of Clinically Meaningful Health-Related Function

GM2 gangliosidoses (GM2) are a group of rare lysosomal storage disorders in which accumulation of GM2 gangliosides results in progressive central nervous system damage. The infantile GM2 phenotype is characterized by delays in milestones by 6 months of age, followed by rapid loss of motor, cognitive, and visual function. Advancements in early diagnosis and pharmacotherapies provide promise for improved outcomes. However, the lack of feasible and clinically meaningful clinical outcome assessments for GM2 poses a challenge to characterizing GM2 natural history and selecting clinical trial endpoints. The purpose of this study was to develop a remotely administered infantile GM2 rating scale to measure health-related function in children with infantile GM2. A 2-phase mixed methods design was employed. In phase 1 of the study, 8 families of children with Infantile GM2 completed a natural history survey and a 1:1 semistructured interview to provide caregiver perspectives on the impacts of GM2 on health-related function. In phase 2 of the study, 8 expert clinicians provided feedback via surveys and participated in videoconference-hosted focus groups to refine scale administration and scoring procedures. These methods guided the development of 16 scale items to assess function in 5 health-related function domains: vision, hand and arm use, communication, gross motor, and feeding. This study used caregiver perspectives and expert clinician feedback to develop a remotely administered clinical outcome assessment of clinically meaningful health-related function in children with infantile GM2. Future studies will further evaluate the feasibility, reliability, and validity of the Infantile GM2 Clinical Rating Scale.

Assessing the integrity of auditory sensory memory processing in CLN3 disease (Juvenile Neuronal Ceroid Lipofuscinosis (Batten disease)): an auditory evoked potential study of the duration-evoked mismatch negativity (MMN)

BACKGROUND

We interrogated auditory sensory memory capabilities in individuals with CLN3 disease (juvenile neuronal ceroid lipofuscinosis), specifically for the feature of "duration" processing. Given decrements in auditory processing abilities associated with later-stage CLN3 disease, we hypothesized that the duration-evoked mismatch negativity (MMN) of the event related potential (ERP) would be a marker of progressively atypical cortical processing in this population, with potential applicability as a brain-based biomarker in clinical trials.

METHODS

We employed three stimulation rates (fast: 450 ms, medium: 900 ms, slow: 1800 ms), allowing for assessment of the sustainability of the auditory sensory memory trace. The robustness of MMN directly relates to the rate at which the regularly occurring stimulus stream is presented. As presentation rate slows, robustness of the sensory memory trace diminishes. By manipulating presentation rate, the strength of the sensory memory trace is parametrically varied, providing greater sensitivity to detect auditory cortical dysfunction. A secondary hypothesis was that duration-evoked MMN abnormalities in CLN3 disease would be more severe at slower presentation rates, resulting from greater demand on the sensory memory system.

RESULTS

Data from individuals with CLN3 disease (N = 21; range 6-28 years of age) showed robust MMN responses (i.e., intact auditory sensory memory processes) at the medium stimulation rate. However, at the fastest rate, MMN was significantly reduced, and at the slowest rate, MMN was not detectable in CLN3 disease relative to neurotypical controls (N = 41; ages 6-26 years).

CONCLUSIONS

Results reveal emerging insufficiencies in this critical auditory perceptual system in individuals with CLN3 disease.

Cognitive pediatric tele-assessment: a scoping review

Cognitive tele-assessment (CTA) adoption has increased considerably recently, in parallel with the maturation of the digital technologies that enable it, and the push to move assessment to the online format during the COVID-19 pandemic in 2019. This mode of assessment stems from remote assessment applications that originated in general tele-medicine, where it was typically used for patient screening as part of an intervention. The development of remote tele-medicine was later adapted for CTA in adult populations in tele-neuropsychiatry and tele-psychology and is increasingly applied in experimental research in cognitive science research with adult and pediatric populations, and for remote academic assessment. Compared to in-person assessment, CTA offers advantages such as decreasing time and logistic costs and facilitating the assessment of remote or special needs populations. However, given the novelty of CTA, its technical, methodological, and ethical issues remain poorly understood, especially in cases where methods for assessment of adults are used in pediatric populations. In the current paper, we provide a scoping review on the evolution of remote tele-assessment from the years 2000 to 2021, to identify its main themes, methodologies, and applications, and then focus on the issues of assessment in pediatric populations. Finally, we present recommendations on how to address the challenges previously mentioned.

Assessing the integrity of auditory sensory memory processing in CLN3 disease (Juvenile Neuronal Ceroid Lipofuscinosis (Batten disease)): An auditory evoked potential study of the duration-evoked mismatch negativity (MMN)

Background

We interrogated auditory sensory memory capabilities in individuals with CLN3 disease (juvenile neuronal ceroid lipofuscinosis), specifically for the feature of "duration" processing, a critical cue in speech perception. Given decrements in speech and language skills associated with later-stage CLN3 disease, we hypothesized that the duration-evoked mismatch negativity (MMN) of the event related potential (ERP) would be a marker of progressively atypical cortical processing in this population, with potential applicability as a brain-based biomarker in clinical trials.

Methods

We employed three stimulation rates (fast: 450 ms, medium: 900 ms, slow: 1800 ms), allowing for assessment of the sustainability of the auditory sensory memory trace. The robustness of MMN directly relates to the rate at which the regularly occurring stimulus stream is presented. As presentation rate slows, robustness of the sensory memory trace diminishes. By manipulating presentation rate, the strength of the sensory memory trace is parametrically varied, providing greater sensitivity to detect auditory cortical dysfunction. A secondary hypothesis was that duration-evoked MMN abnormalities in CLN3 disease would be more severe at slower presentation rates, resulting from greater demand on the sensory memory system.

Results

Data from individuals with CLN3 disease (N=21; range 6-28 years of age) showed robust MMN responses (i.e., intact auditory sensory memory processes) at the medium stimulation rate. However, at the fastest rate, MMN was significantly reduced, and at the slowest rate, MMN was not detectable in CLN3 disease relative to neurotypical controls (N=41; ages 6-26 years).

Conclusions

Results reveal emerging insufficiencies in this critical auditory perceptual system in individuals with CLN3 disease.

Tele-neuropsychological Assessment of Children and Young People: A Systematic Review

The coronavirus pandemic identified a clinical need for pediatric tele-neuropsychology (TeleNP) assessment. However, due to limited research, clinicians have had little information to develop, adapt, or select reliable pediatric assessments for TeleNP. This preliminary systematic review aimed to examine the feasibility of pediatric TeleNP assessment alongside (1) patient/family acceptability, (2) reliability, and (3) the quality of the literature. Between May 2021 and November 2022, manual searches of PubMed, PsycINFO, and Google Scholar were conducted using terms related to "pediatric" and "tele-neuropsychology." After extracting relevant papers with samples aged 0-22 years, predefined exclusion criteria were applied. Quality assessment was completed using the AXIS appraisal tool (91% rater-agreement). Twenty-one studies were included in the review, with reported qualitative and quantitative data on the feasibility, reliability, and acceptability extracted. Across included studies, TeleNP was completed via telephone/video conference with participants either at home, in a local setting accompanied by an assistant, or in a different room but in the same building as the assessor. Pediatric TeleNP was generally reported to be feasible (e.g., minimal behavioral differences) and acceptable (e.g., positive feedback). Nineteen studies conducted some statistical analyses to assess reliability. Most observed no significant difference between in-person and TeleNP for most cognitive domains (i.e., IQ), with a minority finding variable reliability for some tests (e.g., attention, speech, visuo-spatial). Limited reporting of sex-assigned birth, racialized identity, and ethnicity reduced the quality and generalizability of the literature. To aid clinical interpretations, studies should assess underexamined cognitive domains (e.g., processing speed) with larger, more inclusive samples.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40817-023-00144-6.

Equivalency of In-Person Versus Remote Assessment: WISC-V and KTEA-3 Performance in Clinically Referred Children and Adolescents

OBJECTIVE

Teletesting has the potential to reduce numerous barriers to patient care which have only become exacerbated during the COVID-19 pandemic. Although telehealth is commonly utilized throughout medicine and mental health practices, teletesting has remained limited within cognitive and academic evaluations. This may be largely due to concern for the validity of test administration via remote assessment. This cross-sectional study examined the equivalency of cognitive [Wechsler Intelligence Scales for Children - Fifth Edition (WISC-V)] and academic [Kaufman Test of Educational Achievement - Third Edition (KTEA-3)] subtests administered via either teletesting or traditional in-person testing within clinically referred youth.

METHOD

Chart review using a retrospective, cross-sectional design included a total of 893 children and adolescents, ranging from 4 to 17 years (Mean age = 10.2 years, SD = 2.9 years) who were administered at least one subtest from the aforementioned cognitive or academic assessments. Of these, 285 received teletesting, with the remaining (n = 608) receiving in-person assessment. A total of seven subtests (five from the WISC-V and two from the KTEA-3) were examined. A series of inverse probability of exposure weighted (IPEW) linear regression models examined differences between groups for each of the seven subtests after adjustment for numerous demographic, diagnostic, and parent-reported symptom variables.

RESULTS

Only two significant differences were found, such that WISC-V Visual Puzzles (p < .01) and KTEA-3 Math Concepts (p = .03) scores were slightly higher in the teletesting versus in-person groups. However, these differences were quite small in magnitude (WISC-V Visual Puzzles, d = .33, KTEA-3 Math Concepts, d = .18).

CONCLUSIONS

Findings indicate equivalency across methods of service delivery without clinically meaningful differences in scores among referred pediatric patients.

Executive Functions and Rapid Automatized Naming: A New Tele-Rehabilitation Approach in Children with Language and Learning Disorders

Executive function deficits are documented in many neurodevelopmental disorders and may contribute to clinical complexity or rehabilitation resilience. The present research was primarily aimed at presenting and evaluating the feasibility and effectiveness of a telerehabilitation program used during the pandemic period. MemoRAN (Anastasis), a computerised cognitive training to improve executive control during visual-verbal integration tasks was used in a sample of 42 children (5–11 years old) with specific learning or language disorders. The MemoRAN training was based on exercises of inhibition, cognitive flexibility and updating in working memory for three months, with a frequency of approximately three sessions per week. Afterwards, a comparison between a subgroup of children using Memo-RAN and an active control group, using a tele-rehabilitation program directed on reading was conducted. Effect size analysis in pre-post measurements suggests an average effect of MemoRAN in measurements that require control processes, such as accuracy in dictation, reading, inhibition and working memory testing. Comparison with the active control group and the clinical utility implications of these types of treatment will be discussed.

Tele-assessment of cognitive functions in children: a systematic review

Cognitive Tele-Assessment approach (CTA) has been widely used in adults for clinical, research, and screening purposes. In the last decades, it has been considered a useful tool for evaluating child development in both clinical and educational settings and new instruments for CTA in children have been developed. In comparison to In Person Assessment (IPA), CTA can have several advantages, such as increasing accessibility, cutting waiting lists, reducing time and travel costs, and assisting with infection control by minimizing face-to-face contact in times of pandemic. Nevertheless, several issues related to the feasibility and reliability of using CTA to evaluate cognitive development are still open. The present systematic review has a twofold aim: 1. to describe the cognitive functions that are most frequently measured by CTA in children, the procedures used, and the characteristics of the samples investigated; 2. to investigate the agreement between CTA and IPA scores in children.In the present systematic review, 23 studies using CTA in children, with typical or atypical development, have been selected and analyzed. Results support the similarities in performance scores between IPA and CTA and good compliance by children and their families in participating in CTA. Nonetheless, most studies suggest that several methodological precautions must be taken to manage technical and procedural characteristics that may represent challenges for CTA of children. Suggestions for a correct use of CTA, factors affecting the validity of the results and directions for future research are discussed.

Remote Assessment of Cognition in Kids and Adolescents with Daytime Sleepiness: A pilot study of feasibility and reliability

In this pilot study, we assessed the reliability of cognitive testing for kids and adolescents ages 8–19 years of age with narcolepsy or subjective daytime sleepiness compared to healthy controls. Forty-six participants took part in the study (n=18 with narcolepsy type 1, n=6 with subjective daytime sleepiness, and n= 22 healthy controls recruited from the community). Participants completed verbal (vocabulary testing) and non-verbal intelligence quotient (IQ) tasks (block design, matrix reasoning) from the Weschler Abbreviated Scale of Intelligence- Second Edition (WASI-II) in-person or remotely in their home through a HIPAA compliant telehealth web platform with conditions counterbalanced. We found that vocabulary T-scores showed good reliability with intraclass correlation coefficient (ICC) of 0.76 (95% CI: 0.64, 0.85) between remote and in-person testing conditions. Matrix Reasoning T-scores showed moderate reliability (ICC 0.69, 95% CI: 0.68, 0.90) and Block Design T-scores was poor between testing conditions. Bland-Altman plots showed outliers on vocabulary and matrix reasoning tasks performed better on remote assessments. Overall, the results of this pilot study support the feasibility and reliability of verbal and non-verbal IQ scores collected by telehealth. Use of telehealth to collect verbal and non-verbal IQ scores may offer a means to acquire cognitive data for pediatric sleep research through the COVID-19 pandemic and beyond.

Remote Assessment of Pediatric Patients with Daytime Sleepiness and Healthy Controls: A Pilot Study of Feasibility and Reliability

We assessed the reliability of cognitive testing for children and adolescents ages 8 to 19 years of age with narcolepsy or subjective daytime sleepiness compared to healthy controls. Forty-six participants took part in the study (n = 18 narcolepsy type 1, n = 6 subjective daytime sleepiness, and n = 22 healthy controls). Participants completed verbal (vocabulary testing) and non-verbal intelligence quotient (IQ) tasks (block design, matrix reasoning) from the Wechsler Abbreviated Scale of Intelligence- Second Edition (WASI-II) in-person or remotely through a HIPAA compliant telehealth platform with conditions counterbalanced. We found that vocabulary T-scores showed good reliability with intraclass correlation coefficient (ICC) of 0.76 (95% CI: 0.64, 0.85) between remote and in-person testing conditions. Matrix Reasoning T-scores showed moderate reliability (ICC 0.69, 95% CI: 0.68, 0.90) and Block Design T-scores was poor between testing conditions. Overall, the results of this pilot study support the feasibility and reliability of verbal and non-verbal IQ scores collected by telehealth.

Utilizing telehealth to create a clinical model of care for patients with Batten disease and other rare diseases

The COVID-19 pandemic transformed the delivery of healthcare across the world. Telehealth has emerged as the primary method for providing healthcare early in the pandemic. Patient and healthcare provider views of the effectiveness of telehealth services are encouraging and support the long-term use of telehealth services in clinical practice. Telehealth may provide a strategy that has far-reaching benefits for diverse patient populations, such as patients with Batten disease and other rare diseases, who face additional barriers to accessing subspecialty healthcare services. The aims of this paper, through the experience of a single Batten Disease Center of Excellence, are to (1) review the benefits and barriers involved in the delivery of telehealth services to patients with rare diseases; (2) discuss components of a model for clinical care that utilizes telehealth services for patients with Batten disease; (3) discuss limitations and future directions of using telehealth in patients with rare diseases. Healthcare systems should consider building clinical models that utilize telehealth services to provide multidisciplinary services to patients with rare diseases. There are numerous benefits in using telehealth that can enhance and expand service delivery between the patient and clinician. Telehealth services can also improve provider-to-provider communication and collaboration when providing clinical care to individuals with rare diseases. Although there are many benefits to utilizing telehealth services in provision of care to patients with rare diseases, it is important to consider factors that may limit or add additional barriers prior to implementing telehealth services. There is a need for future collaborative research to examine and compare the effectiveness and outcomes of telehealth services with standard of care services that are provided in-person. Future research should also examine how to reduce the challenges and barriers associated with the implementation of telehealth services.

Plain language summary

What is telehealth? Telehealth is defined by the US Department of Health Resources and Services Administrations1 as the "use of electronic information and telecommunication technologies to support long-distance clinical healthcare, patient and professional health-related education, public health, and health administration. Technologies include video conference, the internet, store-and-forward imaging, streaming media, and terrestrial and wireless communication." What was the aim of this review? This review was conducted to guide a clinical model using telehealth services for patients with Batten disease and other rare diseases based on the experiences of a single Batten Disease Center of Excellence. Why is this important? Individuals with rare diseases may face multiple barriers to accessing clinical services. Local doctors and treatment providers, such as speech therapists, occupational therapists, physical therapists, and psychologists, may not have knowledge of rare diseases or how to manage symptoms and disease progression, or how to guide treatment services. Other barriers may also include:• Lack of local resources;• Increased caregiver stress;• Difficulty obtaining a correct diagnosis.There are numerous benefits to using telehealth services for both patients with rare diseases, such as:• Convenience;• Cost savings;• Improved access to care;• Ability to see multiple providers that can help with symptom monitoring, assessment, and treatment services. Where do we go from here? It is important to consider limitations when creating a model for clinical care for patients with rare diseases. Some limitations to think about are:• Clinician and organization familiarity with telehealth;• Reimbursement and coverage from insurance companies for telehealth;• Security and privacy of patient information;• Training of telehealth providers;• Logistical factors, including use of equipment, internet/connectivity, and technical troubleshooting.Future directions should involve collaborative research that studies the effectiveness, feasibility, and perceptions of families of rare diseases and providers that use telehealth for clinical healthcare services. Research should also further study and consider ways to improve barriers and challenges associated with implementing telehealth systems into existing healthcare systems.

A case series illustrating the implementation of a novel tele-neuropsychology service model during COVID-19 for children with complex medical and neurodevelopmental conditions: A companion to Pritchard et al., 2020

Objective: Despite a movement toward tele-based clinical services in other healthcare domains, implementation of these services within neuropsychology, particularly with pediatric populations, is limited. With the onset of social distancing due to COVID-19, the field of pediatric neuropsychology is encouraged to consider the utility of non-traditional, tele-neuropsychological assessments. In order to accommodate ongoing service needs for medically and neurodevelopmentally complex children, a novel three-tiered telehealth service model of care was developed and implemented in a large pediatric outpatient neuro/psychological clinic within an academic medical center.Method: In this article, we provide case examples that illustrate the clinical implementation of this three-tiered telehealth service model of care for serving children during this uncertain time.Conclusion: The primary aim of this article is to provide examples outlining how clinical service decisions were made in the application of this three-tiered model for children with complex medical and neurodevelopmental histories. This article is intended to serve as a guide for other pediatric neuropsychology providers considering tele-neuropsychological services for complex pediatric patients during social distancing.

Agreement between telehealth and face-to-face assessment of intellectual ability in children with specific learning disorder

Introduction

Access to cognitive assessments for children living remotely is limited. Telehealth represents a potential cost- and time-effective solution. A pilot study was conducted to determine the feasibility of telehealth to assess cognitive function in children with learning difficulties.

Methods

Thirty-three children (median age = 9 years 11 months), recruited from the New South Wales (NSW) Centre for Effective Reading, underwent assessment of intellectual ability. Comparisons were made between the intellectual ability index scores obtained by a psychologist sitting face-to-face with the children and another psychologist via telehealth using a web-based platform, Coviu.

Results

The telehealth administration method yielded comparable results to the face-to-face method. Correlation analyses showed high associations between the testing methodologies on the intellectual ability indices (correlation coefficient range = 0.981–0.997).

Discussion

Findings indicate that telehealth may be an alternative to face-to-face cognitive assessment. Future work in a broader range of cognitive tests and wider range of clinical populations is warranted.

The Promise of Telemedicine for Movement Disorders: an Interdisciplinary Approach

PURPOSE OF REVIEW

Advances in technology have expanded telemedicine opportunities covering medical practice, research, and education. This is of particular importance in movement disorders (MDs), where the combination of disease progression, mobility limitations, and the sparse distribution of MD specialists increase the difficulty to access. In this review, we discuss the prospects, challenges, and strategies for telemedicine in MDs.

RECENT FINDINGS

Telemedicine for MDs has been mainly evaluated in Parkinson's disease (PD) and compared to in-office care is cost-effective with similar clinical care, despite the barriers to engagement. However, particular groups including pediatric patients, rare MDs, and the use of telemedicine in underserved areas need further research. Interdisciplinary telemedicine and tele-education for MDs are feasible, provide similar care, and reduce travel costs and travel time compared to in-person visits. These benefits have been mainly demonstrated for PD but serve as a model for further validation in other movement disorders.

Teleneurology and mobile technologies: the future of neurological care

Neurological disorders are the leading cause of global disability. However, for most people around the world, current neurological care is poor. In low-income countries, most individuals lack access to proper neurological care, and in high-income countries, distance and disability limit access. With the global proliferation of smartphones, teleneurology - the use of technology to provide neurological care and education remotely - has the potential to improve and increase access to care for billions of people. Telestroke has already fulfilled this promise, but teleneurology applications for chronic conditions are still in their infancy. Similarly, few studies have explored the capabilities of mobile technologies such as smartphones and wearable sensors, which can guide care by providing objective, frequent, real-world assessments of patients. In low-income settings, teleneurology can increase the capacity of local care systems through professional development, diagnostic support and consultative services. In high-income settings, teleneurology is likely to promote the expansion and migration of neurological care away from institutions, incorporate systems of asynchronous communication (such as e-mail), integrate clinicians with diverse skill sets and reach new populations. Inertia, outdated policies and social barriers - especially the digital divide - will slow this progress at considerable cost. However, a future increasingly will be possible in which neurological care can be accessed by anyone, anywhere. Here, we examine the emerging evidence regarding the benefits of teleneurology for chronic conditions, its role and risks in low-income countries and the promise of mobile technologies to measure disease status and deliver care. We conclude by discussing the future trends, barriers and timing for the adoption of teleneurology.

Neurocognitive clinical outcome assessments for inborn errors of metabolism and other rare conditions

Well-defined and reliable clinical outcome assessments are essential for determining whether a drug provides clinically meaningful treatment benefit for patients. In 2015, FDA convened a workshop, "Assessing Neurocognitive Outcomes in Inborn Errors of Metabolism." Topics covered included special challenges of clinical studies of inborn errors of metabolism (IEMs) and other rare diseases; complexities of identifying treatment effects in the context of the dynamic processes of child development and disease progression; and the importance of natural history studies. Clinicians, parents/caregivers, and participants from industry, academia, and government discussed factors to consider when developing measures to assess treatment outcomes, as well as tools and methods that may contribute to standardizing measures. Many issues examined are relevant to the broader field of rare diseases in addition to specifics of IEMs.