Inter Organizational Practice Committee Recommendations/Guidance for Teleneuropsychology in Response to the COVID-19 Pandemic†

Large-scale evidence for the validity of remote MoCA administration among people with cerebellar ataxia

Objective: For over half a century, studies of rare diseases using in-person cognitive tools have faced challenges, such as long study periods and small sample sizes (e.g. n = 10). The Montreal Cognitive Assessment (MoCA) was widely employed to assess mild cognitive impairment (MCI). We aimed to validate a modified online version of the MoCA in a large sample of a rare disease (population prevalence < .01%). Method: First, we analyzed 20 previous findings (n = 1,377), comparing the MoCA scores between large groups of neurotypically healthy (NH; n = 837) and cerebellar ataxia (CA; n = 540), where studies were conducted in-person. Second, we administered the MoCA in-person to a group of NH (n = 41) and a large group of CA (n = 103). Third, we administered a video conferencing version of the MoCA to NH (n = 38) and a large group of CA (n = 83). Results: We observed no performance differences between online and in-person MoCA administration in the NH and CA groups (p > .05, η2 = 0.001), supporting reliability. Additionally, our online CA group had lower MoCA scores than the NH group (p < .001, Hedges' g = 0.68). This result is consistent with previous studies, as demonstrated by our forest plot across 20 previous in-person findings, supporting construct validity. Conclusion: The results indicate that an online screening tool is valid in a large sample of individuals with CA. Online testing is not only time and cost-effective, but facilitates disease management and monitoring, ultimately enabling early detection of MCI.

Test-retest reliability, practice effects and estimates of change: A study on the Mindmore digital cognitive assessment tool

The present study aimed to establish test-retest reliability and investigate practice effects of the Mindmore cognitive assessment tool, a digital adaptation of traditional pencil and paper tests designed for self-administration. Additionally, normative change scores for the most frequently used tests were derived. A total of 149 healthy Swedish adults (aged 20-79) completed the test battery twice, 1 month apart. The battery assessed attention and processing speed, memory, language, visuospatial functions, and executive functions. Test-retest reliability, measured by ICC and Spearman coefficients, and practice effects were estimated for 22 main-scores and 33 sub-scores. Regression models were used to assess change in performance while controlling for demographics, computer equipment, testing location (online or in-laboratory) and baseline performance for 12 main-scores and nine sub-scores. Test-retest reliability was good for 11 main-scores (≥0.70), satisfactory for five (0.60-0.69), and minimal for six (<0.60) albeit three having satisfactory sub-scores. Practice effects were observed for tests with a major speed component, but not for reaction time, sustained attention, verbal memory and naming (alternate forms), nor visuospatial functions. Trackpad negatively influenced change for one test. Demographics and testing location did not significantly affect the change scores. Our study provides support for test-retest reliability and practice effects of the Mindmore cognitive assessment tool which were comparable to those of traditional tests. These findings, together with the normative change scores, can aid researchers and clinicians in interpreting test results and distinguishing between normal variations in performance and changes indicative of clinical impairment.

A digital teleneuropsychology platform for the diagnosis of mild cognitive impairment: from concept to certification as a medical device

BACKGROUND

Innovative digital solutions are shaping a new concept of dementia care, opening additional venues for prevention, diagnosis, monitoring and treatment. Hereby, we report the development of a tablet-based teleneuropsychology platform (Tenèpsia®), from concept to certification as Medical Device (MD) Class IIA, as per new MD regulation 745/2017.

METHODS

The platform was designed for the remote cognitive evaluation and created thanks to the effort of a collaborative working group including experts from three Italian scientific societies and Biogen Italia S.r.l. (hereafter "Biogen"), and developers from Xenia Reply and Inside AI. The development strategy was guided by converting traditional paper-and-pencil tests into digital versions while maintaining comparable neuropsychological features and optimizing patient accessibility and user experience. The experts focused on the choice and adaptation of traditional neuropsychology measures for a 45-min teleneuropsychology assessment.

RESULTS

The developers created a web and a mobile interface, respectively, for the professional (neuropsychologist) and non-professional (patient and caregiver) use. Recording of voice, drawing and typing information was enabled. Instant dashboards provide a quick overview of the patient's condition. Simulation activities were performed to obtain MD certification, valid across Europe.

CONCLUSION

Neuropsychology services will benefit from the implementation in clinics of harmonized digital tools with adequate scientific and technological standards. The use of digital cognitive testing for the diagnosis of mild cognitive impairment is expected to enhance patient and clinician outcomes through simplified, digital objective data collection, sparing of time and resources, with a positive impact on healthcare costs and access to treatments, reducing inequalities and delays in diagnosis and cure.

ZOom Delivered Intervention Against Cognitive decline (ZODIAC) COVID-19 pandemic adaptations to the Post-Ischaemic Stroke Cardiovascular Exercise Study (PISCES): protocol for a randomised controlled trial of remotely delivered fitness training for brain health

BACKGROUND

Stroke increases subsequent dementia risk yet there are no specific post-stroke therapies to protect cognition. Cardiorespiratory exercise is recommended for secondary prevention of stroke and may be neuroprotective. The Post Ischaemic Stroke Cardiovascular Exercise Study (PISCES) aims to reduce post-stroke secondary neurodegeneration and cognitive decline. During the pandemic, we pivoted to a ZOom Delivered Intervention Against Cognitive decline (ZODIAC) protocol, reducing pandemic-amplified barriers to exercise.

METHODS

We present pandemic adaptions for a multicentre phase IIb assessor-blinded randomised controlled trial of ischaemic stroke survivors testing the efficacy and feasibility of an 8-week home-based exercise intervention delivered at 2 months post-stroke. We compare cardiorespiratory exercise (intervention arm) versus balance and stretching (active control arm). Participants are assessed with magnetic resonance imaging (MRI), fitness, blood, microbiome, and neuropsychological tests at three study visits: before and after the exercise intervention and at 12 months. Modifications to the original protocol include pre-exercise safety home visits, commercial delivery of exercise equipment to facilitate assessor blinding, and reconsideration of statistical plan to allow pooling of the studies. We have reduced in-person study visits from 27 to 3. Primary outcome remains between-group (intervention versus control) difference in brain volume change; secondary outcome is between-group difference in global cognitive ability to allow remote administration of a validated cognitive scale.

DISCUSSION

Remotely delivered exercise interventions reduce participant burden and may reduce barriers to recruitment. A decrease in the number of in-person study visits can be supported by greater information capture via self-reported questionnaires and phone surveys.

TRIAL REGISTRATION

Prospectively ACTRN12616000942459. Registered on July 2016.

Chronotype, Time of Day, and Children's Cognitive Performance in Remote Neuropsychological Assessment

Research on the influence of chronotype and time of day (TOD) on cognitive performance, especially in children, is limited. We explored potential interactive effects, hypothesizing that performance differs when comparing preferred vs. non-preferred TOD. In total, 76 morning-type (MT = 37) or evening-type (ET = 39) children from the third and fourth grades (48.7% girls; M age = 8.05; SD age = 0.51), identified through the Children Chronotype Questionnaire, completed two 30-min neuropsychological assessment sessions via videoconference on the first (9:00) or last hour (16:00) of the school day. The protocol included neuropsychological tests targeting memory, language, and attention/executive domains. The results revealed an interactive effect of medium size between chronotype and TOD on a Rapid Alternating Stimulus (Naming) Task. MT and ET performed faster in asynchrony conditions (morning for ET; afternoon for MT). Additionally, ET outperformed MT in a Backward Digit Span Task, irrespective of TOD. TOD also influenced performance on an Alternating Verbal Fluency Task, with both MT and ET children performing better in the morning. These results underscore the importance of chronotype and TOD in children's cognitive performance, particularly in working memory and verbal fluency. Children assessed during non-preferred TOD exhibited better performance on some cognitive tasks, challenging the assumption that optimal times always yield superior results.

Evidence-based position paper on Physical and Rehabilitation Medicine (PRM) professional practice on telerehabilitation. The European PRM position (UEMS PRM Section)

INTRODUCTION

The evidence on the utility and effectiveness of rehabilitation interventions delivered via telerehabilitation is growing rapidly. Telerehabilitation is expected to have a key role in rehabilitation in the future.

AIM

The aim of this evidence-based position paper (EBPP) is to improve PRM physicians' professional practice in telerehabilitation to be delivered to improve functioning and to reduce activity limitations and/or participation restrictions in individuals with a variety of disabling health conditions.

METHODS

To produce recommendations for PRM physicians on telerehabilitation, a systematic review of the literature and a consensus procedure by means of a Delphi process have been performed involving the delegates of all European countries represented in the UEMS PRM Section.

RESULTS

The systematic literature review is reported together with the 32 recommendations resulting from the Delphi procedure.

CONCLUSIONS

It is recommended that PRM physicians deliver rehabilitation services remotely, via digital means or using communication technologies to eligible individuals, whenever required and feasible in a variety of health conditions in favor of the patient and his/her family, based on evidence of effectiveness and in compliance with relevant regulations. This EBPP represents the official position of the European Union through the UEMS PRM Section and designates the professional role of PRM physicians in telerehabilitation.

Using the MMPI-2-RF, IOP-29, IOP-M, and FIT in the In-Person and Remote Administration Formats: A Simulation Study on Feigned mTBI

Our study compared the impact of administering Symptom Validity Tests (SVTs) and Performance Validity Tests (PVTs) in in-person versus remote formats and assessed different approaches to combining validity test results. Using the MMPI-2-RF, IOP-29, IOP-M, and FIT, we assessed 164 adults, with half instructed to feign mild traumatic brain injury (mTBI) and half to respond honestly. Within each subgroup, half completed the tests in person, and the other half completed them online via videoconferencing. Results from 2 ×2 analyses of variance showed no significant effects of administration format on SVT and PVT scores. When comparing feigners to controls, the MMPI-2-RF RBS exhibited the largest effect size (d = 3.05) among all examined measures. Accordingly, we conducted a series of two-step hierarchical logistic regression models by entering the MMPI-2-RF RBS first, followed by each other SVT and PVT individually. We found that the IOP-29 and IOP-M were the only measures that yielded incremental validity beyond the effects of the MMPI-2-RF RBS in predicting group membership. Taken together, these findings suggest that administering these SVTs and PVTs in-person or remotely yields similar results, and the combination of MMPI and IOP indexes might be particularly effective in identifying feigned mTBI.

Tele-Neuropsychology: From Science to Policy to Practice

OBJECTIVE

The primary aim of this paper is to accelerate the number of randomized experimental studies of the reliability and validity in-home tele-neuropsychological testing (tele-np-t).

METHOD

We conducted a critical review of the tele-neuropsychology literature. We discuss this research in the context of the United States' public and private healthcare payer systems, including the Centers for Medicare & Medicaid Services (CMS) and Current Procedural Terminology (CPT) coding system's telehealth lists, and existing disparities in healthcare access.

RESULTS

The number of tele-np publications has been stagnant since the onset of the COVID-19 pandemic. There are less published experimental studies of tele-neuropsychology (tele-np), and particularly in-home tele-np-t, than other tele-np publications. There is strong foundational evidence of the acceptability, feasibility, and reliability of tele-np-t, but relatively few studies of the reliability and validity of in-home tele-np-t using randomization methodology.

CONCLUSIONS

More studies of the reliability and validity of in-home tele-np-t using randomization methodology are necessary to support inclusion of tele-np-t codes on the CMS and CPT telehealth lists, and subsequently, the integration and delivery of in-home tele-np-t services across providers and institutions. These actions are needed to maintain equitable reimbursement of in-home tele-np-t services and address the widespread disparities in healthcare access.

Remote assessment of cognition in Parkinson's disease and Cerebellar Ataxia: the MoCA test in English and Hebrew

There is a critical need for accessible neuropsychological testing for basic research and translational studies worldwide. Traditional in-person neuropsychological studies are inherently difficult to conduct because testing requires the recruitment and participation of individuals with neurological conditions. Consequently, studies are often based on small sample sizes, are highly time-consuming, and lack diversity. To address these challenges, in the last decade, the utilization of remote testing platforms has demonstrated promising results regarding the feasibility and efficiency of collecting patient data online. Herein, we tested the validity and generalizability of remote administration of the Montreal Cognitive Assessment (MoCA) test. We administered the MoCA to English and Hebrew speakers from three different populations: Parkinson's disease, Cerebellar Ataxia, and healthy controls via video conferencing. First, we found that the online MoCA scores do not differ from traditional in-person studies, demonstrating convergent validity. Second, the MoCA scores of both our online patient groups were lower than controls, demonstrating construct validity. Third, we did not find differences between the two language versions of the remote MoCA, supporting its generalizability to different languages and the efficiency of collecting binational data (USA and Israel). Given these results, future studies can utilize the remote MoCA, and potentially other remote neuropsychological tests to collect data more efficiently across multiple different patient populations, language versions, and nations.

Assessing the Impact of Evidence-Based Mental Health Guidance During the COVID-19 Pandemic: Systematic Review and Qualitative Evaluation

BACKGROUND

During the COVID-19 pandemic, the Oxford Precision Psychiatry Lab (OxPPL) developed open-access web-based summaries of mental health care guidelines (OxPPL guidance) in key areas such as digital approaches and telepsychiatry, suicide and self-harm, domestic violence and abuse, perinatal care, and vaccine hesitancy and prioritization in the context of mental illness, to inform timely clinical decision-making.

OBJECTIVE

This study aimed to evaluate the practice of creating evidence-based health guidelines during health emergencies using the OxPPL guidance as an example. An international network of clinical sites and colleagues (in Australia, New Zealand, and the United Kingdom) including clinicians, researchers, and experts by experience aimed to (1) evaluate the clinical impact of the OxPPL guidance, as an example of an evidence-based summary of guidelines; (2) review the literature for other evidence-based summaries of COVID-19 guidelines regarding mental health care; and (3) produce a framework for response to future global health emergencies.

METHODS

The impact and clinical utility of the OxPPL guidance were assessed using clinicians' feedback via an international survey and focus groups. A systematic review (protocol registered on Open Science Framework) identified summaries or syntheses of guidelines for mental health care during and after the COVID-19 pandemic and assessed the accuracy of the methods used in the OxPPL guidance by identifying any resources that the guidance had not included.

RESULTS

Overall, 80.2% (146/182) of the clinicians agreed or strongly agreed that the OxPPL guidance answered important clinical questions, 73.1% (133/182) stated that the guidance was relevant to their service, 59.3% (108/182) said that the guidelines had or would have a positive impact on their clinical practice, 42.9% (78/182) that they had shared or would share the guidance, and 80.2% (146/182) stated that the methodology could be used during future health crises. The focus groups found that the combination of evidence-based knowledge, clinical viewpoint, and visibility was crucial for clinical implementation. The systematic review identified 2543 records, of which 2 syntheses of guidelines met all the inclusion criteria, but only 1 (the OxPPL guidance) used evidence-based methodology. The review showed that the OxPPL guidance had included the majority of eligible guidelines, but 6 were identified that had not been included.

CONCLUSIONS

The study identified an unmet need for web-based, evidence-based mental health care guidance during the COVID-19 pandemic. The OxPPL guidance was evaluated by clinicians as having a real-world clinical impact. Robust evidence-based methodology and expertise in mental health are necessary, but easy accessibility is also needed, and digital technology can materially help. Further health emergencies are inevitable and now is the ideal time to prepare, including addressing the training needs of clinicians, patients, and carers, especially in areas such as telepsychiatry and digital mental health. For future planning, guidance should be widely disseminated on an international platform, with allocated resources to support adaptive updates.

Clinical utility of teleneuropsychology among pediatric patients with broadly average and low intellectual functioning

The reliability of teleneuropsychology (teleNP) within pediatric populations, particularly those with low intellectual functioning (LIF; i.e., Intellectual Quotient <80), is largely unknown. This repeated-measures study compared performance on WISC-V and WAIS-IV subtests administered in-person before the COVID-19 pandemic and via teleNP during the pandemic in individuals with LIF versus broadly average (BA) intellectual functioning in a clinically referred pediatric cohort. Data were collected from a retrospective chart review of 35 pediatric patients who underwent in-person neuropsychological evaluation at an academic medical center before the pandemic (Mage = 10.10 years, SD = 2.93) and videoconference teleNP assessment during the pandemic (Mage = 13.47 years, SD = 2.88). Participants completed the Similarities, Matrix Reasoning, and Digit Span subtests from the WISC-V or WAIS-IV at both time points. After controlling for test-retest time interval, partial correlations showed relatively strong associations in test-retest performance across subtests in the whole sample and among the subset of LIF patients. Distribution of significant reliable change indices (RCI) between the LIF and BA groups were similar. Strong correlations were observed between performances on select Wechsler subtests administered in-person and via teleNP. Results lend initial support toward the utility of teleNP administration of these measures in children with a broad range of intellectual functioning.

Virtual Assessment as a Way to Reduce Help-seeking Barriers in Older Adults With Subjective Cognitive Decline

Subjective cognitive decline (SCD), a potential early marker for neurodegenerative disease such as Alzheimer's disease, is common among older adults. Although it is often regarded as a personal health concern, most individuals with SCD do not seek help from a health care professional. Help-seeking (HS) is a complex, individualized process with significant life-course implications, and older adults often face several barriers to HS across personal, socioeconomic, and cultural domains. The pandemic exacerbated these barriers by imposing additional limitations on in-person care. In response, virtual assessment became a popular method to conduct remote care. We provide a narrative review of the challenges and triumphs that came with the transition from in-person, pen-paper cognitive assessments to virtual cognitive assessments. In addition, we address the impact virtual assessment had in tackling barriers that previously limited individuals with SCD from formal HS. We argue that virtual cognitive assessment helps alleviate health access barriers to HS (e.g., cost, transportation, and physician availability) and allows individuals with different coping styles to undergo assessment within more convenient environments. We hope the findings presented in this review inform health care practice, public education, and future research targeted towards the use of virtual assessment to facilitate HS in older adults with SCD.

Switching to online: Testing the validity of supervised remote testing for online reinforcement learning experiments

Online experiments are an alternative for researchers interested in conducting behavioral research outside the laboratory. However, an online assessment might become a challenge when long and complex experiments need to be conducted in a specific order or with supervision from a researcher. The aim of this study was to test the computational validity and the feasibility of a remote and synchronous reinforcement learning (RL) experiment conducted during the social-distancing measures imposed by the pandemic. An additional feature of this study was to describe how a behavioral experiment originally created to be conducted in-person was transformed into an online supervised remote experiment. Open-source software was used to collect data, conduct statistical analysis, and do computational modeling. Python codes were created to replicate computational models that simulate the effect of working memory (WM) load over RL performance. Our behavioral results indicated that we were able to replicate remotely and with a modified behavioral task the effects of working memory (WM) load over RL performance observed in previous studies with in-person assessments. Our computational analyses using Python code also captured the effects of WM load over RL as expected, which suggests that the algorithms and optimization methods were reliable in their ability to reproduce behavior. The behavioral and computational validation shown in this study and the detailed description of the supervised remote testing may be useful for researchers interested in conducting long and complex experiments online.

Validating virtual administration of neuropsychological testing in Parkinson disease: a pilot study

COVID-19 has highlighted the need for remote cognitive testing, but the reliability and validity of virtual cognitive testing in Parkinson disease (PD) is unknown. Therefore, we assessed PD participants enrolled in an observational, cognition-focused study with an extensive cognitive battery completed both in-person and via video conference close in time. Data for 35 PD participants with normal cognition to mild dementia were analyzed. Only one test (semantic verbal fluency) demonstrated a difference in score by administration type, with a significantly better score virtually. Only three tests demonstrated good reliability for in-person versus virtual testing, but reliability values for visit 1 versus visit 2 were similarly low overall. Trail Making Test B was successfully administered virtually to only 18 participants due to technical issues. Virtual and in-person cognitive testing generate similar scores at the group level, but with poor to moderate reliability for most tests. Mode of test administration, learning effects, and technical difficulties explained little of the low test-retest reliability, indicating possible significant short-term variability in cognitive performance in PD in general, which has implications for clinical care and research. In-person cognitive testing with a neuropsychologist remains the gold standard, and it remains to be determined if virtual cognitive testing is feasible in PD.

A validation study for wide-range remote assessment of cognitive functions in the healthy older Japanese population: a pilot randomised crossover trial

BACKGROUND

The assessment of a wide range of cognitive functions using video teleconference (VTC) systems cannot be applied in practice yet. We aimed to determine the feasibility and reliability of previously unvalidated remote cognitive function tests in Japan using common information and communication technology (ICT) devices, software, and VTC systems compared with face-to-face (FTF) assessment.

METHODS

The sample consisted of 26 participants from senior citizens clubs and an employment service centre in Sapporo Japan, including 11 females and 15 males (age averaged 78.6 ± 6.8 years). Tests included the RCPM, Story recall, 10/36 spatial recall, selective reminding test, SDMT, PASAT, FAB, TMT-A, TMT-B, visual cancellation task, digit span, tapping span. The experimental design was a counterbalanced crossover randomised controlled trial. Intraclass correlations (ICCs), paired-samples t-tests, Cohen's Kappa (κ) coefficients, and Wilcoxon signed-rank test were calculated to compare the scores between VTC and FTF assessments.

RESULTS

All ICCs were significant and ranged from 0.47 (RCPM time) to 0.92 (RCPM score and PASAT), with a mean ICC of 0.75. Digit span using Cohen's Kappa (κ) coefficient was significant, but the tapping span was not. Paired samples t-test showed statistically significant differences in SDMT, RCPM time, and cancellation time.

CONCLUSIONS

The results suggest that remote video conference-based neuropsychological tests even using familiar devices and software may be able to assess a wide range of cognitive functions in the Japanese older population. As for the processing speed tasks, we need to create our own standards for the remote condition. For the tapping span, we should consider increasing the number of trials.

Recommendations for the Use of Telepsychology in Psychology-Law Practice and Research: A Statement by American Psychology-Law Society (APA Division 41)

In response to the COVID-19 pandemic and subsequent impact on psychological work, Division 41 of the American Psychological Association convened a taskforce to provide guidance to its membership regarding the use of technology for practice and research at the intersection of psychology and law. Drawing from existing research in psychology-law and beyond, as well as the first-hand experience of taskforce members, this document outlines foundational guidance to apply technology to forensic and correctional work while acknowledging these settings provide unique challenges to ethical practice. The recommendations provide support for psychologists involved in assessment, treatment, training, and research. However, these recommendations may not exhaustively apply to all areas of psycholegal practice or all forms of technology. Further, these recommendations are intended to be consulted in conjunction with other professional practice guidelines, emerging research, and policy changes that impact the integration of technologies into this work.

Teleneuropsychology for vascular cognitive impairment: Which tools do we have?

The halt of clinical activities imposed during the COVID-19 pandemic forced clinicians to find alternative strategies to provide continuity of care and services, and led to a renewed interest in use of teleneuropsychology (TNP) to remotely assess patients. Recent TNP guidelines recommend maximizing the reproduction of standard in-person assessment, particularly through videoconferences. However, consistency of the adaptations of usual cognitive tests to videoconference needs further elucidation. This review aims at critical reviewing which cognitive tests could be recommended for a remote evaluation of patients with vascular cognitive impairment (VCI) among those widely recognized as reference standards. Current evidence supports the use of global cognitive efficiency (MMSE and MoCA), verbal memory (Revised Hopkins Verbal Learning Test), and language tests (phonemic and semantic verbal fluencies, Boston Naming Test), while there is a lack of strong validity support for measures of visuospatial functions (Rey-Osterreith Complex Figure), and executive functioning and processing speed (Trail making Test, and Digit symbol or Symbol digit tests). This represents a major limitation in the evaluation of VCI because its cognitive profile in often characterized by attention and executive deficits. At present, a videoconference TNP visit appears useful for a brief evaluation of global cognitive efficiency, and to 'triage' patients towards a second level in person evaluation. In future, hybrid models of TNP based on data collected across multiple modalities, incorporating both adaptation of usual cognitive tools and new computerized tools in the supervised videoconference setting, are likely to become the best option for a comprehensive remote cognitive assessment.

Remote Assessment: Origins, Benefits, and Concerns

Although guidelines surrounding COVID-19 have relaxed and school-aged students are no longer required to wear masks and social distance in schools, we have become, as a nation and as a society, more comfortable working from home, learning online, and using technology as a platform to communicate ubiquitously across ecological environments. In the school psychology community, we have also become more familiar with assessing students virtually, but at what cost? While there is research suggesting score equivalency between virtual and in-person assessment, score equivalency alone is not sufficient to validate a measure or an adaptation thereof. Furthermore, the majority of psychological measures on the market are normed for in-person administration. In this paper, we will not only review the pitfalls of reliability and validity but will also unpack the ethics of remote assessment as an equitable practice.

Telehealth equivalence of the Montreal cognitive assessment (MoCA): Results from the Emory healthy brain study (EHBS)

BACKGROUND

We investigated potential differences between in-person cognitive testing and video telehealth administration of the Montreal Cognitive Assessment (MoCA). In addition to the MoCA, the Patient Health Questionnaire-8 (PHQ-8) and Generalized Anxiety Disorder-7 (GAD-7) were administered.

METHODS

MoCA scores from participants in the Emory Health Brain Study (EHBS) were contrasted based upon whether they were administered the MoCA in the standard face-to-face (F2F) assessment setting (n = 1205) or using a video telehealth administration (n = 491). All EHBS participants were self-reported to be cognitively normal.

RESULTS

MoCA scores did not differ across administration method (F2F MoCA = 26.6, SD = 2.4; telehealth MoCA = 26.5, SD = 2.4). The 95% confidence interval for difference in administration was small (CI = -0.16 to 0.34). When examining MoCA domain scores, administration differences were either associated with no statistically significant effect, or if present due to large sample sizes, were associated with small effects and differences <0.5 point. Telehealth patients reported slightly lower PHQ-8 scores (F2F PHQ-8 = 2.0, SD = 2.5; telehealth PHQ-8 = 1.6, SD = 2.1), although these scores are well within the normal range. No group difference in GAD-7 scores was present (F2F GAD-7 = 1.4, SD = 2.4; telehealth PHQ-8 = 1.4, SD = 2.4).

DISCUSSION

This report with its large sample size and between subject cohort provides complementary evidence to smaller test-retest studies, further supporting equivalence of MoCA telehealth testing to F2F MoCA administration. These findings provide additional reassurance that administration mode does not introduce systematic performance differences for MoCA test administration, thereby permitting telehealth MoCA testing to be applied confidently for both clinical and research applications.

Concurrent validity and reliability of at-home teleneuropsychological evaluations among people with and without HIV

OBJECTIVE

To determine the reliability of teleneuropsychological (TNP) compared to in-person assessments (IPA) in people with HIV (PWH) and without HIV (HIV-).

METHODS

Participants included 80 PWH (Mage = 58.7, SDage = 11.0) and 23 HIV- (Mage = 61.9, SDage = 16.7). Participants completed two comprehensive neuropsychological IPA before one TNP during the COVID-19 pandemic (March-December 2020). The neuropsychological tests included: Hopkins Verbal Learning Test-Revised (HVLT-R Total and Delayed Recall), Controlled Oral Word Association Test (COWAT; FAS-English or PMR-Spanish), Animal Fluency, Action (Verb) Fluency, Wechsler Adult Intelligence Scale 3rd Edition (WAIS-III) Symbol Search and Letter Number Sequencing, Stroop Color and Word Test, Paced Auditory Serial Addition Test (Channel 1), and Boston Naming Test. Total raw scores and sub-scores were used in analyses. In the total sample and by HIV status, test-retest reliability and performance-level differences were evaluated between the two consecutive IPA (i.e., IPA1 and IPA2), and mean in-person scores (IPA-M), and TNP.

RESULTS

There were statistically significant test-retest correlations between IPA1 and IPA2 (r or ρ = .603-.883, ps < .001), and between IPA-M and TNP (r or ρ = .622-.958, ps < .001). In the total sample, significantly lower test-retest scores were found between IPA-M and TNP on the COWAT (PMR), Stroop Color and Word Test, WAIS-III Letter Number Sequencing, and HVLT-R Total Recall (ps < .05). Results were similar in PWH only.

CONCLUSIONS

This study demonstrates reliability of TNP in PWH and HIV-. TNP assessments are a promising way to improve access to traditional neuropsychological services and maintain ongoing clinical research studies during the COVID-19 pandemic.

A phase II single-arm trial of memantine for prevention of cognitive decline during chemotherapy in patients with early breast cancer: Feasibility, tolerability, acceptability, and preliminary effects

BACKGROUND

Cognitive difficulties have been described after chemotherapy for breast cancer, but there is no standard of care to improve cognitive outcomes in these patients. This trial examined the feasibility, tolerability, acceptability, and preliminary effects of memantine to prevent cognitive decline during chemotherapy for breast cancer.

METHODS

Patients with stage I-III breast cancer, scheduled for neo/adjuvant chemotherapy, completed a cognitive battery prior to and 4 weeks after completing chemotherapy. Memantine (10 mg BID) was administered concurrent with chemotherapy. Our primary cognitive outcome was visual working memory assessed by the Delayed Matching to Sample test. We used the Brief Medication Questionnaire to assess acceptability.

RESULTS

Of 126 patients approached, 56 (44%) enrolled. Forty-five (80%) received ≥1 dose of memantine and completed pre-post assessments. Seventy-six percent reported taking ≥90% of scheduled doses. Participants were mean age of 56, 77% White, and 57% had stage I disease. Sixty-four percent had stable or improved Delayed Matching to Sample test scores. Stable or improved cognition was observed in 87%-91% across objective cognitive domain composite measures. Sixty-six percent self-reported stable or improved cognitive symptoms. There were seven greater than or equal to grade 3 adverse events; two were possibly related to memantine. Only 5% reported that taking memantine was a disruption to their lives.

CONCLUSIONS

Memantine was well-tolerated and consistently taken by a large majority of patients receiving breast cancer chemotherapy. The majority demonstrated stable or improved cognition from pre- to post-assessment. Randomized trials are needed to determine memantine's efficacy to ameliorate cognitive loss.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04033419.

Feasibility and Acceptability of a Multidisciplinary Academic Telemedicine System for Memory Care in Response to COVID-19

Background and Objectives

In response to the restrictions imposed by the COVID-19 pandemic, the University of California San Francisco Memory and Aging Center (UCSF MAC) has deployed a comprehensive telemedicine model for the diagnosis and management of Alzheimer disease and related dementias. This review summarizes a large academic behavioral neurology clinic's experience transitioning to telemedicine services, including the impact on clinic care indicators, access metrics, and provider's experience. We compared these outcomes from 3 years before COVID-19 to 12 months after the transition to video teleconferencing (VTC) encounters.

Methods

Patient demographics and appointment data (dates, visit types, and departments) were extracted from our institution's electronic health record database from January 1, 2017, to May 1, 2021. We present data as descriptive statistics and comparisons using Wilcoxon rank-sum tests and Fisher exact tests. The results of anonymous surveys conducted among the clinic's providers are reported as descriptive findings.

Results

After the implementation of telemedicine services, the proportion of clinic encounters completed via VTC increased from 1.9% to 86.4%. There was a statistically significant decline in both the percentage of scheduled appointments that were canceled (32.9% vs 27.9%; p < 0.01) and total cancelations per month (mean 240.3 vs 179.4/mo; p < 0.01). There was an increase in the percentage of completed scheduled appointments (60.2% vs 64.8%; p < 0.01) and an increase in the average estimated commuting distance patients would need to drive for follow-up appointments (mean 49.8 vs 54.7 miles; p < 0.01). The transition to telemedicine services did not significantly affect the clinic's patient population as measured by age, gender, estimated income, area deprivation index, or self-reported racial/ethnic identity. The results of the provider survey revealed that physicians reported a more positive experience relative to neuropsychologists. Both types of providers reported telemedicine services as a reasonable equivalent and acceptable alternative to in-person evaluations with notable caveats.

Discussion

UCSF MAC's comprehensive integration of telemedicine services maintained critical ambulatory care to patients living with dementia during the COVID-19 pandemic. The recognized benefits of our care model suggest dementia telemedicine may be used as a feasible and equivalent alternative to in-person ambulatory care in the after COVID-19 era.

Understanding Clinician's Experiences with Implementation of a Younger Onset Dementia Telehealth Service

The successful implementation of telehealth services depends largely on clinician acceptance of telehealth as a viable healthcare option and their adoption of telehealth methods into their clinical practice. While growing research supports the feasibility of telehealth services, no research has evaluated clinicians' experiences during the implementation of a younger onset dementia telehealth service. Semi-structured group interviews were conducted with 7 metropolitan (hub) clinicians and 16 rural (spoke) clinicians during the pre-and post-implementation phases of a novel Younger onset dementia (YOD) telehealth service. Reflexive thematic analysis identified five themes at pre-implementation: clinical need, previous experiences and views, potential telehealth barriers, solutions to potential telehealth barriers, and potential clinical outcomes. At post-implementation, nine themes were identified: clinical need, clinical relationships, concerns about the future of rural healthcare, clinical practice and resourcing factors, patient suitability, difficulties with technology, service quality, the way forward, and the impact of COVID-19. Most clinicians held positive views regarding the service, particularly the ability to provide more options to rural-dwelling patients. However, some concerns about threats to rural healthcare and the validity of telehealth assessments remained. Overall, this study has identified service implementation barriers and facilitators and contributes to the long-term sustainability of current and future telehealth YOD services.

Initial investigation of test-retest reliability of home-to-home teleneuropsychological assessment in healthy, English-speaking adults

Prior teleneuropsychological research has assessed the reliability between in-person and remote administration of cognitive assessments. Few, if any, studies have examined the test-retest reliability of cognitive assessments conducted in sequential clinic-to-home or home-to-home teleneuropsychological evaluations - a critical issue given the state of clinical practice during the COVID-19 pandemic. This study examined this key psychometric question for several cognitive tests administered over repeated videoconferencing visits 4-6 months apart in a sample of healthy English-speaking adults.

A total of 44 participants (ages 18-75) completed baseline and follow-up cognitive testing 4-6 months apart. Testing was conducted in a home-to-home setting over HIPAA-compliant videoconferencing meetings on participants' audio-visual enabled laptop or desktop computers. The following measures were repeated at both virtual visits: the Controlled Oral Word Association Test (FAS), Category Fluency (Animals), and Digit Span Forward and Backward from the Wechsler Adult Intelligence Scale, Fourth Edition. Intraclass correlation coefficients (ICC), Pearson correlations, root mean square difference (RMSD), and concordance correlation coefficients (CCC) were calculated as test-retest reliability metrics, and practice effects were assessed using paired-samples t-tests.

Some tests exhibited small practice effects, and test-retest reliability was marginal or worse for all measures except FAS, which had adequate reliability (based on ICC and r). Reliability estimates with RMSD suggested that change within +/- 1 SD on these measures may reflect typical test-retest variability.

The included cognitive measures exhibited questionable reliability over repeated home-to-home videoconferencing evaluations. Future teleneuropsychology test-retest reliability research is needed with larger, more diverse samples and in clinical populations.

The Boston cognitive assessment: Psychometric foundations of a self-administered measure of global cognition

Objective: The Boston Cognitive Assessment (BoCA) is a novel, computerized, self-administered assessment of global cognition. This work sought to establish the validity and reliability of the BoCA. Method: Two studies were conducted. The first study used a sample of 43 outpatients from a clinic in eastern Massachusetts to evaluate the content validity and internal consistency of the BoCA. The second study used a sample of 38 patients seen at an outpatient specialty neurological clinic to evaluate the BoCA's test-retest reliability after one week. Results: In the first study, participants without cognitive diagnoses scored significantly higher on both the BoCA and the Telephone Interview for Cognitive Status (TICS) compared to those with mild Neurocognitive Disorders. Correlational analyses revealed moderate correlations between several of the BoCA tasks and measures of related abilities. Exploratory factor analysis of the BoCA tasks revealed one robust factor accounting for a plurality (i.e., 42%) of variance in participant scores. The BoCA demonstrated good internal consistency (α = 0.79) and strong correlations (r = 0.80, p < 0.01) with the TICS. The second study revealed strong (r = 0.89, p < 0.001) test-retest reliability of the total BoCA score one week after participants' initial administration. Conclusions: This work provides evidence of the BoCA's psychometric properties as a self-administered screener of global cognition, and supports its implementation in clinical practice and future studies. Clinical implications, future directions, and limitations are discussed.

VA psychologists' professional practices and attitudes toward tele-neuropsychology among a tele-neuropsychology interest group within the Veterans Health Administration

OBJECTIVE

To provide understanding of practices and attitudes toward tele-neuropsychology (teleNP) among Veterans Health Administration (VA) psychologists who have joined a related community of practice.

METHODS

Several VA psychologists (the authors) developed this survey to better understand dissemination of teleNP and attitudes toward teleNP among those involved in a VA teleNP community of practice. We contacted VA psychologists within this group to complete the survey. The survey was open from July to August 2021, during which time a total of 62 VA psychologists participated.

RESULTS

Response rate was estimated to be 41% of those receiving the survey (62 respondents). Approximately two thirds of those completing the survey reported current practice of teleNP (68%; n = 42). In contrast, only 25% of the entire sample (n = 15) conducted any teleNP pre-pandemic. Job satisfaction related to being able to perform teleNP is high. Support for continued and increased use of teleNP is high, with most respondents (84%) indicating they will be at least somewhat likely to practice teleNP post-pandemic.

CONCLUSIONS

The survey provides increased support for the use of teleNP by VA psychologists who responded to the survey, with significantly increased adoption since the Covid-19 pandemic, and greater likelihood of intention to use teleNP post pandemic.

Assessment of Neurocognitive Functions, Olfaction, Taste, Mental, and Psychosocial Health in COVID-19 in Adults: Recommendations for Harmonization of Research and Implications for Clinical Practice

OBJECTIVE

To propose a set of internationally harmonized procedures and methods for assessing neurocognitive functions, smell, taste, mental, and psychosocial health, and other factors in adults formally diagnosed with COVID-19 (confirmed as SARS-CoV-2 + WHO definition).

METHODS

We formed an international and cross-disciplinary NeuroCOVID Neuropsychology Taskforce in April 2020. Seven criteria were used to guide the selection of the recommendations' methods and procedures: (i) Relevance to all COVID-19 illness stages and longitudinal study design; (ii) Standard, cross-culturally valid or widely available instruments; (iii) Coverage of both direct and indirect causes of COVID-19-associated neurological and psychiatric symptoms; (iv) Control of factors specifically pertinent to COVID-19 that may affect neuropsychological performance; (v) Flexibility of administration (telehealth, computerized, remote/online, face to face); (vi) Harmonization for facilitating international research; (vii) Ease of translation to clinical practice.

RESULTS

The three proposed levels of harmonization include a screening strategy with telehealth option, a medium-size computerized assessment with an online/remote option, and a comprehensive evaluation with flexible administration. The context in which each harmonization level might be used is described. Issues of assessment timelines, guidance for home/remote assessment to support data fidelity and telehealth considerations, cross-cultural adequacy, norms, and impairment definitions are also described.

CONCLUSIONS

The proposed recommendations provide rationale and methodological guidance for neuropsychological research studies and clinical assessment in adults with COVID-19. We expect that the use of the recommendations will facilitate data harmonization and global research. Research implementing the recommendations will be crucial to determine their acceptability, usability, and validity.

Integrating Telehealth Into Neurodevelopmental Assessment: A Model From the Cardiac Neurodevelopmental Outcome Collaborative

Objective

In the wake of the COVID-19 pandemic, psychologists were pushed to look beyond traditional in-person models of neurodevelopmental assessment to maintain continuity of care. A wealth of data demonstrates that telehealth is efficacious for pediatric behavioral intervention; however, best practices for incorporating telehealth into neurodevelopmental assessment are yet to be developed. In this topical review, we propose a conceptual model to demonstrate how telehealth can be incorporated into various components of neurodevelopmental assessment.

Methods

Harnessing existing literature and expertise from a multidisciplinary task force comprised of clinicians, researchers, and patient/parent representatives from the subspecialty of cardiac neurodevelopmental care, a conceptual framework for telehealth neurodevelopmental assessment was developed. Considerations for health equity and access to care are discussed, as well as general guidelines for clinical implementation and gaps in existing literature.

Results

There are opportunities to integrate telehealth within each stage of neurodevelopmental assessment, from intake to testing, through to follow-up care. Further research is needed to determine whether telehealth mitigates or exacerbates disparities in access to care for vulnerable populations as well as to provide evidence of validity for a wider range of neurodevelopmental measures to be administered via telehealth.

Conclusions

While many practices are returning to traditional, face-to-face neurodevelopmental assessment services, psychologists have a unique opportunity to harness the momentum for telehealth care initiated during the pandemic to optimize the use of clinical resources, broaden service delivery, and increase access to care for pediatric neurodevelopmental assessment.

Neuropsychology consultation to identify learning disorders in children and adolescents: a proposal based on lessons learned during the COVID-19 pandemic

Learning disorders are common neurodevelopmental conditions, occurring both idiopathically and in the context of other medical conditions. They are frequently comorbid with other neurodevelopmental and psychiatric conditions. Delayed identification and treatment have been associated with significant negative psychosocial consequences. The need for pediatric neuropsychologists to efficiently screen for learning disorders is likely to increase in the months and years following the COVID-19 pandemic, which has severely disrupted access to educational services, especially for children who also face racial and economic disparities. In this paper, we describe a consultation model that can be used to screen for learning disorders and can be completed using both in-person and telemedicine visits. Implementation may result in earlier intervention for struggling children, increase access to neuropsychological services without increasing wait times for comprehensive evaluations, and provide opportunities for collaborations with other health professionals (e.g., pediatricians, therapists, psychiatrists, and neurologists).

Rationale and Design of the National Neuropsychology Network

OBJECTIVE

The National Neuropsychology Network (NNN) is a multicenter clinical research initiative funded by the National Institute of Mental Health (NIMH; R01 MH118514) to facilitate neuropsychology's transition to contemporary psychometric assessment methods with resultant improvement in test validation and assessment efficiency.

METHOD

The NNN includes four clinical research sites (Emory University; Medical College of Wisconsin; University of California, Los Angeles (UCLA); University of Florida) and Pearson Clinical Assessment. Pearson Q-interactive (Q-i) is used for data capture for Pearson published tests; web-based data capture tools programmed by UCLA, which serves as the Coordinating Center, are employed for remaining measures.

RESULTS

NNN is acquiring item-level data from 500-10,000 patients across 47 widely used Neuropsychology (NP) tests and sharing these data via the NIMH Data Archive. Modern psychometric methods (e.g., item response theory) will specify the constructs measured by different tests and determine their positive/negative predictive power regarding diagnostic outcomes and relationships to other clinical, historical, and demographic factors. The Structured History Protocol for NP (SHiP-NP) helps standardize acquisition of relevant history and self-report data.

CONCLUSIONS

NNN is a proof-of-principle collaboration: by addressing logistical challenges, NNN aims to engage other clinics to create a national and ultimately an international network. The mature NNN will provide mechanisms for data aggregation enabling shared analysis and collaborative research. NNN promises ultimately to enable robust diagnostic inferences about neuropsychological test patterns and to promote the validation of novel adaptive assessment strategies that will be more efficient, more precise, and more sensitive to clinical contexts and individual/cultural differences.

Tele-neuropsychological assessment tools in Italy: a systematic review on psychometric properties and usability

Background

The current COVID-19 pandemic has abruptly catalysed a shift towards remote assessment in neuropsychological practice (tele-neuropsychology, t-NPs). Although the validity of t-NPs diagnostics is gaining recognition worldwide, little is known about its implementation in Italy. The present review by the Italian working group on tele-neuropsychology (TELA) aims at describing the availability, psychometric properties, and feasibility of t-NPs tools currently available in Italy.

Methods

Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were followed. This work was pre-registered on the Prospective Register of Systematic Reviews (PROSPERO; CRD42021239687). Observational studies reporting telephone-, videoconference- or web-based assessment of cognition/behaviour in Italian both healthy participants (HPs) and patients were included. Bias assessment was performed through ad hoc scales.

Results

Fourteen studies were included from an initial N = 895 (4 databases searched). Studies were subdivided into those focused on psychometric properties and those characterized by a predominant applied nature. The majority of studies addressed either adult/elderly HPs or neurological/internal patients. Multi-domain screening tools for cognition, behaviour, mood/anxiety and quality of life were the most represented. Findings regarding validity, reliability, sensitivity, specificity and clinical usability were reported for cognitive screenings — the telephone- and videoconference-based Mini-Mental State Examination and the Telephone Interview for Cognitive Status.

Discussion

Positive albeit preliminary evidence regarding psychometric properties and feasibility in both clinical and non-clinical populations of Italian t-NPs brief screening tools are herewith provided. Further studies exploring clinical usability of t-NPs and psychometric properties/feasibility of tests for the in-depth assessment of specific cognitive domains are necessary.

Supplementary Information

The online version contains supplementary material available at 10.1007/s10072-021-05719-9.

Telemental Health Use in the COVID-19 Pandemic: A Scoping Review and Evidence Gap Mapping

Background: The COVID-19 pandemic has highlighted telemedicine use for mental illness (telemental health). Objective: In the scoping review, we describe the scope and domains of telemental health during the COVID-19 pandemic from the published literature and discuss associated challenges. Methods: PubMed, EMBASE, and the World Health Organization's Global COVID-19 Database were searched up to August 23, 2020 with no restrictions on study design, language, or geographical, following an a priori protocol (https://osf.io/4dxms/). Data were synthesized using descriptive statistics from the peer-reviewed literature and the National Quality Forum's (NQF) framework for telemental health. Sentiment analysis was also used to gauge patient and healthcare provider opinion toward telemental health. Results: After screening, we identified 196 articles, predominantly from high-income countries (36.22%). Most articles were classified as commentaries (51.53%) and discussed telemental health from a management standpoint (86.22%). Conditions commonly treated with telemental health were depression, anxiety, and eating disorders. Where data were available, most articles described telemental health in a home-based setting (use of telemental health at home by patients). Overall sentiment was neutral-to-positive for the individual domains of the NQF framework. Conclusions: Our findings suggest that there was a marked growth in the uptake of telemental health during the pandemic and that telemental health is effective, safe, and will remain in use for the foreseeable future. However, more needs to be done to better understand these findings. Greater investment into human and financial resources, and research should be made by governments, global funding agencies, academia, and other stakeholders, especially in low- and middle- income countries. Uniform guidelines for licensing and credentialing, payment and insurance, and standards of care need to be developed to ensure safe and optimal telemental health delivery. Telemental health education should be incorporated into health professions curricula globally. With rapidly advancing technology and increasing acceptance of interactive online platforms amongst patients and healthcare providers, telemental health can provide sustainable mental healthcare across patient populations. Systematic Review Registration: https://osf.io/4dxms/.

Investigating Clinician Experiences of Teleneuropsychology Service Implementation within Rural Inpatient Rehabilitation Settings: A Mixed Method Approach

OBJECTIVE

The aim of this study was to understand clinicians' experiences of teleneuropsychology service implementation within rural inpatient rehabilitation settings and the variability of those experiences across rural settings and clinical disciplines.

METHOD

Clinicians (n = 56 from four rehabilitation settings) who were involved in a hub-and-spoke teleneuropsychology service completed surveys throughout service implementation. A purposive sample of 16 clinicians then completed semi-structured interviews at the conclusion of the service implementation period. Quantitative data were analyzed descriptively and qualitative data were analyzed using thematic analysis, prior to the results being converged.

RESULTS

Four themes characterizing clinicians' experiences were identified. Pre- and early-implementation considerations included factors such as early collaboration and consultation, which were identified as important for service integration into rural settings. Facilitators/barriers included factors such as technology usability, which positively or negatively influenced service implementation. Benefits and outcomes included perceptions on the impact of the service, such as improved equity and quality of care in rural settings. Finally, future applications encapsulated what the clinicians envisaged for the future of teleneuropsychology services, such as hybrid teleneuropsychology/in-person services. Some differences were identified in clinicians' experiences across rural settings and disciplines, including preferences for technology infrastructure and satisfaction with teleneuropsychology sessions.

CONCLUSIONS

Most clinicians reported positive experiences and acceptability of the teleneuropsychology service. Facilitators and barriers, which can guide the successful establishment of future teleneuropsychology services, were identified. These findings may be used to contribute to improving equity and quality of care for people living with neuropsychological impairments, especially those living in rural areas.

Survey Findings About the Experiences, Challenges, and Practical Advice/Solutions Regarding Teleneuropsychological Assessment in Adults

OBJECTIVE

In the wake of the coronavirus pandemic, teleneuropsychology utilization has increased. There is a need to characterize the first-hand experiences of individuals using teleneuropsychology, identify the common teleneuropsychology challenges, and devise practical strategies for mitigating/resolving these challenges.

METHOD

Survey data were collected from U.S. based neuropsychologists and other individuals (e.g., graduate students and research assistants) who were engaged in remote cognitive assessment with adults (n = 87). Frequency analyses were conducted to examine: how respondents used teleneuropsychology (e.g., duration of use, types of measures and devices/technology platforms used); challenges that were encountered with different technology platforms and teleneuropsychology use; and advice for navigating these challenges.

RESULTS

Most respondents began using teleneuropsychology relatively recently in the context of the coronavirus pandemic, with home-to-home or clinic-to-home settings being the most frequently reported teleneuropsychology settings. Zoom®, Doxy.Me®, and MyChart® were the most frequently used platforms, largely due to workplace mandates and/or Health Insurance Portability and Accountability Act-compliant features. Common challenges with teleneuropsychology included internet connection issues and environmental distractions in examinees' homes, and examinees having limited-to-no access to technologies requisite for teleneuropsychology. Providing clear instructions to the examinee prior to the teleneuropsychology visit was the most common advice for ensuring a successful teleneuropsychology evaluation. Similar response patterns were generally noted for those who used TeleNP for clinical or research purposes.

CONCLUSIONS

These survey results reflect common experiences and challenges with teleneuropsychology and identify priority targets for increasing its feasibility, reliability, and validity. Findings provide context for the development of formal teleneuropsychology competencies.

The development and implementation of teleneuropsychology in an academic lifespan neuropsychology center: Lessons learned from the COVID-19 pandemic

INTRODUCTION

Teleneuropsychology (TNP) became a critical means for providing care during the COVID-19 pandemic and may continue as an option for delivery of neuropsychological services. To understand how patient characteristics impact clinician decisions and service models, this study examines practice patterns within a lifespan outpatient neuropsychology center before, during and post-pandemic.

METHODS

Patient volume, demographics, and characteristics were compared across four, 3-month time intervals in 2019-2020. Two baseline intervals when the center was physically open (PO) were compared to one interval when the center was physically closed (PC) (all evaluations were conducted via direct-to-home TNP) and a fourth interval when the center was physically reopened (RO) and evaluations were conducted in one of the three modalities: in-person, virtual only or hybrid (both virtual/in-person).

RESULTS

A total of 1,459 total neuropsychological evaluations were conducted with a 64.6% reduction during PC. At RO, the number of evaluations returned to pre-COVID baseline during which in-person (72.4%) evaluations were conducted at a higher rate than hybrid (7.1%) or virtual only (20.4%). Across the lifespan, mean number of appointments to complete evaluations was significantly greater during PC (p< .001) than at other time intervals, and during RO, hybrid evaluations required significantly more appointments (p < .001) than in-person and virtual. The majority of evaluations were conducted with adult patients (71.4%). For adult patients, neurodegenerative/memory disorders received TNP evaluations at a higher rate during PC and RO. Pediatric patients were significantly older during PC (p < .001); neurodevelopmental referrals received more hybrid and virtual evaluations.

CONCLUSIONS

Results indicate that patient characteristics, especially age and referral categories, impact the feasibility of TNP. Data from the RO period suggest that in-person evaluations not surprisingly remain the mainstay; however, for adult patients, and especially older adults with neurodegenerative/memory disorders, TNP may provide an important option for delivery of neuropsychological evaluations.

Cancer, cognition, and COVID: delivering direct-to-home teleneuropsychology services to neuro-oncology patients

BACKGROUND

The COVID-19 pandemic induced rapid adoption of telemedicine services for neuro-oncology patients at an increased risk of infection. Neuropsychological assessment is important to neuro-oncology care yet challenging to complete outside of a structured testing environment. Teleneuropsychology (TNP) has been explored in limited populations and proven feasible and reliable. Conducting TNP visits directly to patients' home (DTH) had minimal prior study.

METHODS

We used two voluntary surveys to examine acceptance (patients) and feasibility (providers) of DTH-TNP at two regionally diverse medical institutions providing neuropsychological services to neuro-oncology patients from April to September 2020.

RESULTS

A total of 119 patients were scheduled during the study period, 79 of whom completed neuropsychological testing via DTH-TNP. Neuropsychology providers completed surveys on 68 of these encounters (86%). In 98% of cases, neuropsychologists were able to achieve or partially achieve the individually defined goals of their assessment. Common problems reported included patient dysregulation (16%) and slow/unreliable internet (15%). Of the 52 patients who responded, 98% were satisfied with the DTH-TNP experience, and 92% would recommend the virtual visit to others. All respondents felt understood by the examiner (100%) and the majority denied technical difficulties (90%), communication challenges (94%), or privacy concerns (98%). Patients reported reduced risk of infection and saved travel time as favorable aspects of DTH-TNP.

CONCLUSIONS

These preliminary results suggest neuro-oncology patients find DTH-TNP acceptable and neuropsychologists find it a feasible practice, while also recognizing its limitations. Results suggest that further study of DTH-TNP (eg, reliability, validity) for neuro-oncology patients is warranted.

How We Work Now: Preliminary Review of a Pediatric Neuropsychology Hybrid Model in the Era of COVID-19 and Beyond

Objective

Although telehealth has become a central component of medical care in response to the coronavirus disease 2019 (COVID-19) pandemic, comprehensive pediatric neuropsychological assessment over virtual platforms lacks empirical efficacy. This paper presents: a) the results of a quality improvement project examining the feasibility of in-person evaluation in the context of safety measures that alter test standardization, b) the impact such changes had upon neuropsychological test scores, and c) how using a hybrid model of clinical service delivery affected access to care.

Method

We compared demographic and outcome variables between patients seen during the pandemic (N = 87) to a group of patients seen in our service immediately prior to COVID-19 (N = 87). A subset of those patients were case-matched for age and diagnosis (N = 39 per group). Children seen for neuropsychological re-evaluation during the pandemic (N = 10) were examined using pairwise comparison.

Results

Groups did not differ on age, sex, or FSIQ. Despite changes to standardized administration, no group differences were found for any selected neuropsychological test variables in the larger sample or subsamples. In fact, all variables were moderately to highly correlated in the re-evaluation subgroup. The hybrid model expedited feedback sessions and increased face-to-face (telehealth) feedbacks.

Conclusions

A hybrid model incorporating modified in-person testing and intake and feedback encounters via telehealth may be a feasible and effective way to provide pediatric neuropsychological services. These preliminary findings suggest such novel aspects of neuropsychological evaluation could represent an improvement over pre-COVID models, especially in rural settings.

Assessment of deep brain stimulation candidacy during the COVID-19 pandemic: Lessons learned and future directions for neuropsychologists

OBJECTIVE

Neuropsychological assessment is integral to the pre-surgical deep brain stimulation (DBS) workup for patients with movement disorders. The COVID-19 pandemic quickly affected care access and shifted healthcare delivery, and neuropsychology has adapted successfully to provide tele-neuropsychological (teleNP) DBS evaluations during this time, thus permanently changing the landscape of neuropsychological practice. Method: In this paper, we discuss the lessons learned from the pandemic and we offer care management guidelines for teleNP and in-person evaluations of pre-DBS populations, with exploration of the feasibility of the different approaches for uninterrupted care access. Results: We summarize the strengths and weaknesses of these care models and we provide future directions for the state of clinical neuropsychological practice for DBS programs, with implications for broader patient populations. Conclusions: A better understanding of these dynamics will inform and educate the DBS team and community regarding the complexities of performing DBS neuropsychological evaluations during COVID-19 and beyond.

The global pandemic has permanently changed the state of practice for pre-DBS neuropsychological evaluations

The evaluation and management of patients with movement disorders has evolved considerably due to the COVID-19 pandemic, including the assessment of candidates for deep brain stimulation (DBS) therapy. Members of the Neuropsychology Focus Group from the Parkinson Study Group Functional Neurosurgical Working Group met virtually to discuss current practices and solutions, build consensus, and to inform the DBS team and community regarding the complexities of performing DBS neuropsychological evaluations during COVID-19. It is our viewpoint that the practice of neuropsychology has adapted successfully to provide tele-neuropsychological pre-DBS evaluations during the global pandemic, thus permanently changing the landscape of neuropsychological services.

A Teleneuropsychology Protocol for the Cognitive Assessment of Older Adults During COVID-19

The Coronavirus Disease 2019 (COVID-19) pandemic prompted the need for a teleneuropsychology protocol for the cognitive assessment of older adults, who are at increased risk for both COVID-19 and dementia. Prior recommendations for teleneuropsychological assessment did not consider many of the unique challenges posed by COVID-19. The field is still in need of clear guidelines and standards of care for the assessment of older adults under the current circumstances. Advantages of teleneuropsychological assessment during the COVID-19 pandemic include reduced risk of contracting the virus, eliminating travel time and reducing cost, and more rapid access to needed services. Challenges include disparities in technology access among patients, reduced control over the testing environment, impeded ability to make behavioral observations, and limited research on valid and reliable cognitive assessment measures. The aim of this perspective review is to propose a teleneuropsychological protocol to facilitate neuropsychological assessment utilizing a virtual platform. The proposed protocol has been successful with our clinical and research populations and may help neuropsychologists implement teleneuropsychology services without compromising validity or reliability. However, there is increasing need for research on teleneuropsychological assessment options for both clinical and research purposes.

Validity of In-Home Teleneuropsychological Testing in the Wake of COVID-19

OBJECTIVE

Teleneuropsychology (TNP) has been shown to be a valid assessment method compared with in-person neuropsychological evaluations. Interest in delivering TNP directly to patients' homes has arisen in response to the coronavirus disease 2019 (COVID-19) pandemic. However, prior research has typically involved patients tested in clinical settings, and the validity of in-home TNP testing has not yet been established. The present study aims to explore the validity and clinical utility of in-home TNP testing in a mixed clinical sample in the wake of COVID-19.

METHODS

Test profiles for 111 in-home TNP patients were retrospectively compared with 120 patients who completed in-person evaluations. The TNP test battery consisted of tests measuring attention/processing speed, verbal memory, naming, verbal fluency, and visuoconstruction. TNP scores of cognitively normal (CN) patients were compared with patients with neurocognitive disorders (NCD), and score profiles were examined among suspected diagnostic groups of Alzheimer's disease (AD), Parkinson's disease (PD), and vascular disease (VaD).

RESULTS

TNP test scores did not significantly differ from in-person testing across all tests except the Hopkins Verbal Learning Test-Revised Discrimination Index. Within the TNP group, significant differences between the CN and NCD groups were found for all tests, and the memory and semantic fluency tests yielded large effect sizes (d ≥ 0.8). Score profiles among the AD, PD, and VaD groups were explored.

CONCLUSIONS

These findings support the validity of in-home TNP testing compared with in-person neuropsychological testing. Practice considerations, limitations, and future directions are discussed.

A Systematic Review of Telehealth and Sport-Related Concussion: Baseline Testing, Diagnosis, and Management

Background: The use of telehealth has increased as a result of the COVID-19 pandemic. As sports at all levels resume, sports medicine physicians may be interested in how telehealth can be used for concussion care. Questions/Purpose: We sought to assess how telehealth has been used in the baseline testing, diagnosis, and/or management of concussion. Secondarily, we sought to assess the strengths and weaknesses of telehealth for concussion care and identify aspects of concussion care for which telehealth has not yet been studied. Methods: A systematic review was performed in September 2020 of PubMed and Embase using the following terms: concuss*, "mild traumatic brain," "head injur*," telehealth, telemedicine, telecare, "mobile health," m-health, virtual. Studies included were original research articles investigating the use of telehealth in the care of concussion (including baseline testing, diagnosis, and management), published in English, and had full text available. Results: A total of 356 articles were screened, of which 5 were determined to meet inclusion criteria. These articles described the use of telehealth for managing concussion in military and rural settings. No articles involved the use of telehealth for baseline concussion testing of athletes or for sideline evaluation. Conclusion: Despite the limited original research on the use of telehealth for concussion care, the articles identified provide a foundation for exploring the potential value of telehealth in the office practice and sports team setting. Telehealth may expand the ability of a sports medicine physician to provide timely and effective concussion care to athletes during the COVID-19 pandemic and beyond. More rigorous research is needed.

Identifying response and predictive biomarkers for Transcranial magnetic stimulation outcomes: protocol and rationale for a mechanistic study of functional neuroimaging and behavioral biomarkers in veterans with Pharmacoresistant depression

BACKGROUND

Although repetitive transcranial magnetic stimulation ('TMS') is becoming a gold standard treatment for pharmacoresistant depression, we lack neural target biomarkers for identifying who is most likely to respond to TMS and why. To address this gap in knowledge we evaluate neural targets defined by activation and functional connectivity of the dorsolateral prefrontal cortex-anchored cognitive control circuit, regions of the default mode network and attention circuit, and interactions with the subgenual anterior cingulate. We evaluate whether these targets and interactions between them change in a dose-dependent manner, whether changes in these neural targets correspond to changes in cognitive behavioral performance, and whether baseline and early change in neural target and cognitive behavioral performance predict subsequent symptom severity, suicidality, and quality of life outcomes. This study is designed as a pragmatic, mechanistic trial partnering with the National Clinical TMS Program of the Veteran's Health Administration.

METHODS

Target enrollment consists of 100 veterans with pharmacoresistant Major Depressive Disorder (MDD). All veterans will receive a clinical course of TMS and will be assessed at 'baseline' pre-TMS commencement, 'first week' after initiation of TMS (targeting five sessions) and 'post-treatment' at the completion of TMS (targeting 30 sessions). Veterans will be assessed using functional magnetic resonance imaging (fMRI), a cognitive behavioral performance battery, and established questionnaires. Multivariate linear mixed models will be used to assess whether neural targets change with TMS as a function of dose (Aim 1), whether extent and change of neural target relates to and predicts extent of behavioral performance (Aim 3), and whether extent of neural target change predicts improvement in symptom severity, suicidality, and quality of life (Aim 3). For all three aims, we will also assess the contribution of baseline moderators such as biological sex and age.

DISCUSSION

To our knowledge, our study will be the first pragmatic, mechanistic observational trial to use fMRI imaging and cognitive-behavioral performance as biomarkers of TMS treatment response in pharmacoresistant MDD. The results of this trial will allow providers to select suitable candidates for TMS treatment and better predict treatment response by assessing circuit connectivity and cognitive-behavioral performance at baseline and during early treatment.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04663481 , December 5th, 2020, retrospectively registered. The first veteran was enrolled October 30th, 2020.

Pediatric Teleneuropsychology: Feasibility and Recommendations

OBJECTIVE

Teleneuropsychology (TeleNP) is a growing and promising practice within the telemedicine landscape that has been well established within the adult neuropsychology literature. This project aimed to demonstrate the feasibility of TeleNP in a pediatric clinical population and disseminate clinical decision-making procedures to guide best practices for pediatric TeleNP.

METHOD

This project conducted during the 2019 coronavirus (COVID-19) pandemic reflects the largest clinical cohort to date of TeleNP in a pediatric population (N = 129). Data were gathered retrospectively from patients who were rescheduled from in-person assessment to TeleNP between March to June 2020.

RESULTS

TeleNP was an accessible option for most patients and families, with no differences in demographic variables in patient appointment attendance, whether testing was conducted, and whether the patient was referred for face-to-face follow-up. Patients using laptops/desktops were more likely to undergo remote test administration in comparison with patients using phones/tablets (χ2 = 23.83, p < .002). Sixty-three percent of the sample were referred for a face-to-face follow-up assessment.

CONCLUSIONS

TeleNP is feasible in a pediatric clinical population ranging to begin the process of differential diagnosis and treatment planning. Pediatric TeleNP may be most efficacious as a screening procedure due to limited measures suited for remote administration and behavioral challenges interfering with testing requiring in-person follow-up. TeleNP screening as standard practice for patients who do not require a full, traditional neuropsychological battery may provide a more efficient care model, with more patients able to be seen using shorter batteries with less wait time.

Patient Satisfaction with Telephone Neuropsychological Assessment

OBJECTIVE

Telephone-based neuropsychological assessment (TeleNP) has been shown to be a valid alternative to in-person or video-based assessment. However, there is limited information regarding patients' satisfaction with TeleNP. This report presents satisfaction survey data from a diverse, clinical sample who received TeleNP during the coronavirus disease pandemic.

METHOD

A total of 43 adult patients (30.2% Hispanic/Latinx, 32.6% Black), aged 24-75, who received TeleNP as part of routine clinical care participated in a postassessment satisfaction survey. Responses were analyzed qualitatively and via nonparametric comparisons based on demographic factors.

RESULTS

Given options of "Not Satisfied," "Somewhat Satisfied," "Satisfied," or "Very Satisfied," 97.7% of patients reported satisfaction with their visit as well as the visit length, and 80% felt the visit met their needs ("Good" + "Very Good"). There were no significant differences in responses based on age, race/ethnicity, sex, or education. Endorsed advantages of TeleNP included "Avoid potential exposure to illness" and "Flexibility/Convenience," and 20% reported difficulty communicating, concentrating, and/or connecting with their provider as potential disadvantages. Although 67.7% reported a preference for in-person visits, 83.7% expressed interest in another "virtual visit" (telephone or video conference) with their provider.

CONCLUSIONS

TeleNP was well received by the sample and demonstrated good patient satisfaction. These results in conjunction with other research supporting the validity of TeleNP support consideration of this assessment modality for patients who might not otherwise have access to in-person or video conference-based neuropsychological services. Based on these findings, a greater focus on rapport building may be warranted when utilizing TeleNP to enhance patients' sense of connection to their provider.

Teleneuropsychology in the time of COVID-19: The experience of The Australian Epilepsy Project

PURPOSE

Traditional neuropsychological testing carries elevated COVID-19 risk for both examinee and examiner. Here we describe how the pilot study of the Australian Epilepsy Project (AEP) has transitioned to tele-neuropsychology (teleNP), enabling continued safe operations during the pandemic.

METHODS

The AEP includes adults (age 18-60) with a first unprovoked seizure, new diagnosis of epilepsy or drug resistant focal epilepsy. Shortly after launching the study, COVID-related restrictions necessitated adaptation to teleNP, including delivery of verbal tasks via videoconference; visual stimulus delivery via document camera; use of web-hosted, computerised assessment; substitution of oral versions for written tests; online delivery of questionnaires; and discontinuation of telehealth incompatible tasks.

RESULTS

To date, we have completed 24 teleNP assessments: 18 remotely (participant in own home) and six on-site (participant using equipment at research facility). Five face-to-face assessments were conducted prior to the transition to teleNP. Eight of 408 tests administered via teleNP (1.9 %) have been invalidated, for a variety of reasons (technical, procedural, environmental). Data confirm typical patterns of epilepsy-related deficits (p < .05) affecting processing speed, executive function, language and memory. Questionnaire responses indicate elevated rates of patients at high risk of mood (34 %) and anxiety disorder (38 %).

CONCLUSION

Research teleNP assessments reveal a typical pattern of impairments in epilepsy. A range of issues must be considered when introducing teleNP, such as technical and administrative set up, test selection and delivery, and cohort suitability. TeleNP enables large-scale neuropsychological research during periods of social distancing (and beyond), and offers an opportunity to expand the reach and breadth of neuropsychological services.