Interrater reliability of face-to-face, tele- and video-based assessments with the modified Mallet classification in brachial plexus birth injuries

The modified Mallet classification is widely used to measure motor function in brachial plexus birth injuries. The aim of the study was to investigate agreement and reliability of this classification under three different evaluation conditions: face-to-face; live tele-assessment; and delayed video-based assessment. A total of 100 children aged 4-15 years were included. Children were assessed by two raters except for live tele-assessment, which was performed by four raters. Agreement between the three different assessment conditions for the same rater were between strong and excellent for both raters 1 and 2. The interrater reliability for raters 1 and 2 under different assessment conditions was strong to excellent. Interrater reliability among the four raters was moderate to strong in tele-assessment. The modified Mallet classification may have appropriate reliability to be used in remote medical follow-up.Level of evidence: III.

Agreement between face-to-face and tele-assessment of upper limb disability in lung cancer survivors during COVID-19 era

INTRODUCTION

Upper limb disability can limit the quality of life of lung cancer survivors. The COVID-19 era has required a finding of alternatives to attend the monitoring of presented disturbances with the minor risk of spread. Tele-assessment offers new possibilities for clinical assessment demonstrating good reliability compared to traditional face-to-face assessment in a variety of patients. No previous study has applied this type of assessment in lung cancer survivors. For this reason, the aim of this study was to evaluate the level of agreement between upper limb disability assessment using tele-assessment and the face-to-face method in lung cancer survivors.

METHODS

A reliability study was conducted with 20 lung cancer survivors recruited from the Oncological Radiotherapy Service of the "Hospital PTS" (Granada). Patients attended a session for clinical face-to-face and real-time online tele-assessment. The main outcome measurements of the study included upper limb function (shirt task) and musculoskeletal disturbances (active range of movement and trigger points), and these outcomes were recorded by two independent researchers.

RESULTS

The outcome measures showed good agreement between both assessments. The active range of movement presented heterogeneous results, being excellent reliability (ρ > 0.75) in extension, internal rotation, homolateral adduction, and contralateral abduction, good (0.4 < ρ < 0.75) for flexion, homolateral abduction, contralateral adduction and contralateral external rotation, and poor (ρ < 0.4) for homolateral external rotation. The measure evaluating upper limb function and trigger points show the highest interrater reliability with confidence interval lower limits ≥0.99.

DISCUSSION

The tele-assessment of upper limb function and musculoskeletal disorders of lung cancer survivors present a good interrater reliability compared to face-to-face assessment. It could be useful for monitoring the disability presented by cancer survivors whose access is difficult by the residential situation, physical limitations or the risk of COVID-19 spread.

Spinal Cord Injuries in Iraq: A Teleassessment Survey of the Survivors from 2017 to 2018 Islamic State of Iraq and Syria War

Introduction: The significance of comprehensive investigations specifically addressing the characteristics and implications of nervous system injuries (NSIs) and particularly war-related spinal cord injuries (SCI) remain limited. Iraq lacks comprehensive survey studies for quality of life for people after SCI. The objective of this work was to identify the number of NSIs and mortality of those injured during the Islamic State of Iraq and Syria (ISIS) war in Iraq and analyze events specifically as sociodemographic variables to assess quality of life healthy, psychological, and social disorders from onset of injury till the involving. Methods: A survey-based descriptive study, and analytical retrospective at community-based of Nineveh Governorate, in Iraq. The participants were 34 survivors of ISIS war with SCIs, ages between 9 and 60 years, and 7 females (20.59%) and 27 males (79.41%) as registered in Nineveh Center of Disability Rehabilitation. Data collection was conducted using Telephone Video Interviews and respondents' health information. Protocol-specific questions and some psychological and social scales (PTSD) (DSM-IV), (TAS-20), (SWLS), and (MSPSS) were also used. Results: There were 2,990 NSIs with the highest rate of injuries occurring from 2017 to 2018, and the SCIs were 267 injuries (8.93%), and (70.59%) at level T the mortalities were 57 cases, all participants suffered from physical and psychological chronic complications, while the results of the PTSD, GPC, and SWLS were at a moderate level. Conclusions: In urban warfare, there's a rise in NSIs, notably SCIs influenced by the type of weaponry. The survivors face significant physical, psychological, social, and financial burdens. More research is crucial to understanding their situations and developing strategies to alleviate their health, social, and financial challenges.

Using the MMPI-2-RF, IOP-29, IOP-M, and FIT in the In-Person and Remote Administration Formats: A Simulation Study on Feigned mTBI

Our study compared the impact of administering Symptom Validity Tests (SVTs) and Performance Validity Tests (PVTs) in in-person versus remote formats and assessed different approaches to combining validity test results. Using the MMPI-2-RF, IOP-29, IOP-M, and FIT, we assessed 164 adults, with half instructed to feign mild traumatic brain injury (mTBI) and half to respond honestly. Within each subgroup, half completed the tests in person, and the other half completed them online via videoconferencing. Results from 2 ×2 analyses of variance showed no significant effects of administration format on SVT and PVT scores. When comparing feigners to controls, the MMPI-2-RF RBS exhibited the largest effect size (d = 3.05) among all examined measures. Accordingly, we conducted a series of two-step hierarchical logistic regression models by entering the MMPI-2-RF RBS first, followed by each other SVT and PVT individually. We found that the IOP-29 and IOP-M were the only measures that yielded incremental validity beyond the effects of the MMPI-2-RF RBS in predicting group membership. Taken together, these findings suggest that administering these SVTs and PVTs in-person or remotely yields similar results, and the combination of MMPI and IOP indexes might be particularly effective in identifying feigned mTBI.

Validity and intra- and inter-rater reliability of the Tinetti performance-oriented mobility assessment balance subscale using different tele-assessment methods in patients with chronic stroke

INTRODUCTION

Balance assessments are an important component of rehabilitation. Considering the increasing use of telemedicine to meet rehabilitation needs, it is important to examine the feasibility of such assessments. This study aimed to examine the reliability and validity of the Tinetti Performance-Oriented Mobility Assessment Balance Subscale (POMA-B) when applied via synchronous and asynchronous tele-assessment.

METHODS

Twenty-five patients with chronic stroke were included in the study. The first physiotherapist assessed the patients on the first day in a face-to-face clinical setting. Synchronous or asynchronous tele-assessment was applied the next day. The assessments were performed in the same time zone, with an interval of one day. The synchronous tele-assessment was done online in real time by the first and second physiotherapists. A reference assessment video was sent to the patients for asynchronous tele-assessment. They were asked to make a video recording while performing the evaluation activities according to the reference video. Then the first and second physiotherapists assessed these video recordings separately. All the tests were repeated 10 days later to determine the intra-rater reliability of the tele-assessment methods.

RESULTS

The intra-class correlation coefficients ranged from 0.96 to 0.98 for inter-rater reliability and from 0.97 to 0.98 for intra-rater reliability for both tele-assessment methods. Both asynchronous and asynchronous tele-assessment methods were medium correlated with the face-to-face versions.

CONCLUSIONS

We demonstrated the validity and reliability of the POMA-B in chronic stroke patients with different tele-assessment methods, typically using the internet and available devices.

Determining Post-COVID-19 Symptoms and Rehabilitation Needs in Hospitalized and Nonhospitalized COVID-19 Survivors with Tele-Assessment Methods

Objectives: This study aimed to evaluate the post-COVID-19 symptoms, the severity of symptoms, and functional capacities seen in hospitalized and nonhospitalized COVID-19 survivors according to time periods (total 6, 1-3, and 3-6 months) by tele-assessment methods and to predict the need for periodic rehabilitation of COVID-19 survivors. Methods: Three hundred ninety-four COVID-19 survivors (50.18 ± 15.14 years) who were between 1 and 6 months after PCR(+) were included in the study, and their ongoing symptoms and the severity of these symptoms (0-10 points) were assessed with COVID-19 Yorkshire Rehabilitation Screening (C19-YRS) Tool, and the 30-s Chair Stand Test (CST) was applied by tele-assessment methods. Results: In hospitalized and nonhospitalized survivors of COVID-19, 87% experienced at least one symptom within the first 6 months. The most prevalent symptoms were anxiety (47.7%), fatigue (46.7%), and muscle pain (45.7%). The most common symptom in the nonhospitalized group was fatigue (52.6%), whereas anxiety was 46.8% in the hospitalized group. The 30-s CST score of the nonhospitalized group was significantly higher than the hospitalized group (p < 0.001). Conclusions: In the first 6 months post-COVID-19, musculoskeletal problems, anxiety, fatigue, and muscle pain were observed to be the most prevalent symptoms, regardless of time, in hospitalized and nonhospitalized survivors. There was a serious decrease in their functional capacity. Priority should be given to psychiatric, cardiopulmonary, and musculoskeletal rehabilitation in post-COVID-19. Inclusion of hospitalized/nonhospitalized COVID-19 survivors in a comprehensive rehabilitation program tailored to their needs by following a comprehensive tele-assessment by a multidisciplinary team will reduce the "long COVID-19 syndrome." ClinicalTrials.gov Registration Number: NCT04900441.

Tele-Assessment of Functional Capacity through the Six-Minute Walk Test in Patients with Diabetes Mellitus Type 2: Validity and Reliability of Repeated Measurements

A tele-assessed 6MWT (TL 6MWT) could be an alternative method of evaluating functional capacity in patients with diabetes mellitus type 2 (DM2). This study aimed to assess the validity and reliability of a TL 6MWT. The functional capacity of 28 patients with DM2 (75% men) aged 61 ± 13 years was evaluated twice via an indoor, center-based 6MWT (CB 6MWT) and twice outside each patient's home via a web-based platform TL 6MWT. The study showed a high statistically significant correlation between the CB and TL 6MWT (Pearson's r = 0.76, p < 0.001). Reliability testing showed no statistically significant differences in the distance covered (CB1: 492 ± 84 m and CB2: 506 ± 86 m versus TL1: 534 ± 87 m and TL2: 542 ± 93 m, respectively) and in the best distance of the TL 6MWT (545 ± 93 m) compared to the best CB distance (521 ± 83 m). Strong internal reliability for both the CB (intraclass correlation coefficient (ICC) = 0.93) and the TL 6MWT (ICC = 0.98) was found. The results indicate that a TL 6MWT performed outdoors can be a highly valid and reliable tool to assess functional capacity in patients with DM2. No learning effect between the TL and CB assessment was found, minimizing the need for repetition.

Tele-assessment of young children referred for autism spectrum disorder evaluation during COVID-19: Associations among clinical characteristics and diagnostic outcome

The diagnosis of autism spectrum disorder (ASD) has traditionally been made through in-person evaluation. While the COVID-19 pandemic disrupted access to ASD services, there has been remarkable growth in research focused on novel ASD diagnostic practices, including the use of telemedicine. We implemented a standard ASD tele-assessment evaluation procedure, including use of a novel remote clinician-coached, caregiver-delivered ASD assessment tool (TELE-ASD-PEDS; TAP), with the goal of continuing to provide diagnostic services to young children and their families during the pandemic. We examined the relationship between child characteristics and diagnostic outcome for 335 children, ages 14-78 months, who received ASD tele-assessment conducted by psychologists and pediatricians in an outpatient clinic of a Midwestern academic medical center. We found that clinicians could make a determination about ASD diagnosis for most children (85%) evaluated using tele-assessment. Child clinical characteristics, including TAP scores and clinician ratings of ASD symptoms, were related to diagnostic outcome (i.e. diagnosis of ASD, no ASD, and Unsure about ASD). When all clinical characteristics were examined together, the presence of specific repetitive behaviors predicted ASD diagnosis. We also found that the TAP is effective for making an ASD diagnosis when used as part of comprehensive tele-assessment evaluation in children ⩾ 36 months of age with delayed language. Our study adds to an increasing body of research supporting use of tele-assessment for diagnosis of ASD. Although further research is needed, telemedicine may help families from different backgrounds and geographic locations to access high-quality diagnostic services.

Validity and Reliability of a Novel Smartphone Tele-Assessment Solution for Quantifying Hip Range of Motion

BACKGROUND

Tele-health has become a major mode of delivery in patient care, with increasing interest in the use of tele-platforms for remote patient assessment. The use of smartphone technology to measure hip range of motion has been reported previously, with good to excellent validity and reliability. However, these smartphone applications did not provide real-time tele-assessment functionality. We developed a novel smartphone application, the TelePhysio app, which allows the clinician to remotely connect to the patient's device and measure their hip range of motion in real time. The aim of this study was to investigate the concurrent validity and between-sessions reliability of the TelePhysio app. In addition, the study investigated the concurrent validity, between-sessions, and inter-rater reliability of a second tele-assessment approach using video analysis.

METHODS

Fifteen participants (nfemales = 6) were assessed in our laboratory (session 1) and at their home (session 2). We assessed maximum voluntary active hip flexion in supine and hip internal and external rotation, in both prone and sitting positions. TelePhysio and video analysis were validated against the laboratory's 3-dimensional motion capture system in session 1, and evaluated for between-sessions reliability in session 2. Video analysis inter-rater reliability was assessed by comparing the analysis of two raters in session 2.

RESULTS

The TelePhysio app demonstrated high concurrent validity against the 3D motion capture system (ICCs 0.63-0.83) for all hip movements in all positions, with the exception of hip internal rotation in prone (ICC = 0.48, p = 0.99). The video analysis demonstrated almost perfect concurrent validity against the 3D motion capture system (ICCs 0.85-0.94) for all hip movements in all positions, with the exception of hip internal rotation in prone (ICC = 0.44, p = 0.01). The TelePhysio and video analysis demonstrated good between-sessions reliability for hip external rotation and hip flexion, ICC 0.64 and 0.62, respectively. The between-sessions reliability of hip internal and external rotation for both TelePhysio and video analysis was fair (ICCs 0.36-0.63). Inter-rater reliability ICCs for the video analysis were 0.59 for hip flexion and 0.87-0.95 for the hip rotation range.

CONCLUSIONS

Both tele-assessment approaches, using either a smartphone application or video analysis, demonstrate good to excellent concurrent validity, and moderate to substantial between-sessions reliability in measuring hip rotation and flexion range of motion, but less in internal hip rotation in the prone position. Thus, it is recommended that the seated position be used when assessing hip internal rotation. The use of a smartphone to remotely assess hip range of motion is an appropriate, effective, and low-cost alternative to the face-to-face assessments. This method provides a simple, cost effective, and accessible patient assessment tool with no additional cost. This study validates the use of smartphone technology as a tele-assessment tool for remote hip range of motion assessment.

Videoconference-Based Physical Performance Tests: Reliability and Feasibility Study

Validated tools to evaluate physical performance remotely with real-time supervision are lacking. We assessed test−retest and inter-rater reliability, as well as the feasibility of carrying out the five-repetition sit-to-stand (5RSTS), kneeling push-up (KPU) and Shirado−Ito trunk flexor endurance (SIF) tests by 1:1 real-time videoconference. We also evaluated the correlation of these tests with measures of self-reported physical fitness, physical activity, health state and pain. A total of 96 healthy adults participated in the study (18−65 years). Relative and absolute reliabilities were assessed with the intraclass correlation coefficient (ICC) and standard error of measurement (SEM), respectively. Feasibility outcomes included testing duration, participant acceptability (1−5 Likert scale) and presence of adverse events. Self-reported measures were obtained with validated online questionnaires, and correlations were analyzed with Pearson’s partial correlation coefficients controlling for age. ICCs were excellent (>0.9), and SEMs were generally low (2.43−16.21%). The mean duration of all tests was <5 min, mean acceptability was ≥4.5, and adverse events were few. The KPU showed statistically significant correlations with various self-reported measures (p < 0.05). In conclusion, the 5RSTS, KPU and SIF were reliable and feasible when conducted by 1:1 real-time videoconference. This study provides a tool that could be logistically and economically advantageous.

Conducting oral and written language adapted tele-assessments with early elementary-age children with autism spectrum disorder

BACKGROUND AND AIMS

Due to the COVID-19 pandemic, tele-health has gained popularity for both providing services and delivering assessments to children with disabilities. In this manuscript, we discuss the process of collecting standardized oral language, reading, and writing tele-assessment data with early elementary children with autism spectrum disorder (ASD) and offer preliminary findings related to child and parent engagement and technology issues.

METHODS

The data presented are from pretest assessments during an efficacy study examining the electronic delivery of a listening comprehension intervention for children with ASD. Pretest sessions included a battery of standardized language, reading, and writing assessments, conducted over Zoom. The authors operationalized and developed a behavioral codebook of three overarching behavioral categories (parent involvement, child disengagement, and technology issues). Researchers coded videos offline to record frequencies of indicated behaviors across participants and assessment subtests.

RESULTS

Involvement from parents accounted for the highest number of codes. Children showed some disengagement during assessment sessions. Technology issues were minimal. Behavioral categories appeared overall limited but varied across participants and assessments.

CONCLUSIONS

Parent involvement behaviors made up approximately two-thirds of the coded behaviors. Child disengagement behaviors made up approximately one-fourth of the coded behaviors, and these behaviors occurred more frequently across many different participants (with lower frequencies but greater coverage across children). Technology problems specific to responding to assessment items were relatively uncommon.

IMPLICATIONS

Clear guidelines including assessment preparation, modification of directions, and guidelines for parents who remain present are among the implications discussed. We also provide practical implications for continued successful adapted tele-assessments for children with ASD.

Testing Our Children When the World Shuts Down: Analyzing Recommendations for Adapted Tele-Assessment during COVID-19

In 2017, the National Association of School Psychologists described tele-assessment as the least researched area of telehealth. This became problematic in 2020 when COVID-19 curtailed the administration of face-to-face assessments. Publishers began to offer computer-adapted tele-assessment methods for tests that had only previously been administered in person. Recommendations for adapted tele-assessment practice had to be developed with little empirical data. The current study analyzed recommendations from entities including professional organizations, test publishers, and governmental offices. The samples for each were small, but the findings were noteworthy. Test publishers were unanimous in recommending the use of their face-to-face assessments through adapted tele-assessment methods (either with or without caution). Governmental agencies were more likely to recommend not using adapted tele-assessment methods or to use these methods with caution. Finally, professional organizations were almost unanimous in their recommendations to use adapted tele-assessment but to do so with caution. In addition to deviations in the types of recommendations provided, entities varied in how the information was distributed. About one-fifth (23.5%) of all entities surveyed provided no recommendations at all. About 45% of the remaining entities provided recommendations on their Web sites. The rest provided information through shared documents, online toolkits, peer-reviewed journals, and emails. Implications for the field of psychology’s future crisis management planning are discussed in response to these findings.

Tele-assessment of cognitive functions in children: a systematic review

Cognitive Tele-Assessment approach (CTA) has been widely used in adults for clinical, research, and screening purposes. In the last decades, it has been considered a useful tool for evaluating child development in both clinical and educational settings and new instruments for CTA in children have been developed. In comparison to In Person Assessment (IPA), CTA can have several advantages, such as increasing accessibility, cutting waiting lists, reducing time and travel costs, and assisting with infection control by minimizing face-to-face contact in times of pandemic. Nevertheless, several issues related to the feasibility and reliability of using CTA to evaluate cognitive development are still open. The present systematic review has a twofold aim: 1. to describe the cognitive functions that are most frequently measured by CTA in children, the procedures used, and the characteristics of the samples investigated; 2. to investigate the agreement between CTA and IPA scores in children.In the present systematic review, 23 studies using CTA in children, with typical or atypical development, have been selected and analyzed. Results support the similarities in performance scores between IPA and CTA and good compliance by children and their families in participating in CTA. Nonetheless, most studies suggest that several methodological precautions must be taken to manage technical and procedural characteristics that may represent challenges for CTA of children. Suggestions for a correct use of CTA, factors affecting the validity of the results and directions for future research are discussed.

Telemedicine Applications for the Evaluation of Patients with Non-Acute Headache: A Narrative Review

The COVID-19 pandemic has spurred a hasty transition to virtual care but also an abundance of new literature highlighting telehealth’s capabilities and limitations for various healthcare applications. In this review, we aim to narrate the current state of the literature on telehealth applied to migraine care. First, telemedicine in the context of non-acute headache management has been shown to produce non-inferior patient outcomes when compared to traditional face-to-face appointments. The assignment of patients to telehealth appointments should be made after referring more urgent cases to dedicated in-person clinics. During the virtual appointment, physicians can ask their patients about the “3 F’s” in order to perform a thorough assessment of their headaches: frequency of headache days, frequency of acute medication usage and functional impairment. Clinical assessment scores that have been studied and deemed feasible for telemedicine, safe and efficient include the HIT-6, VAS and MIDAS scores. Although MIDAS was found to be redundant and inadequate to use on a daily basis, we suggest that it can be useful in periodic remote follow-up appointments. Additionally, several mobile health apps have been studied including Migraine Buddy, Migraine Coach and Migraine Monitor. All of these are appropriate for use in telemedicine when combined with an adequate trial period with Migraine Buddy being rated the highest, as it captures the most detailed clinical picture. High satisfaction rates have been reported for virtual headache management which were shown to be equal to in-person consults. These are based on patients’ perceived increase in convenience due to avoided travel time, less disruption of their daily routine and feeling more comfortable in the environment of their choice. Despite this, limitations such as technological knowledge, access to videoconferencing modalities and having a more impersonal consultation with the physician may hinder some patients from adopting this service.

Twelve tips for OSCE-style Tele-assessment

This article was migrated. The article was marked as recommended. The Australian College of Rural and Remote Medicine (ACRRM) has developed a flexible 'tele-assessment' approach to the delivery of its assessment modalities. Candidates can sit their examination remotely, close to their place of practice, which reduces the need for rural doctors - both candidates and examiners - to leave their communities for the purpose of assessment. A major component of the assessment process is the Structured Assessment using Multiple Patient Scenarios (StAMPS) examination, which blends the formats of an Objective Structured Clinical Examination (OSCE) and a traditional viva vocè examination. It is a high-stakes assessment, that was designed to be academically rigorous, flexible, valid, reliable, and fair. Since 2008 ACRRM has provided a videoconferencing option to candidates for their StAMPS examination allowing them to remain in or near their home location, while the examiners meet a central location. Travel restrictions due to the SARS-CoV-2 pandemic meant for the first time both candidates AND examiners participated in StAMPS via videoconference. ACRRM conducted an online StAMPS assessment using videoconferencing technology for 65 candidates in mid-May 2020, with all candidates, examiners and support staff remaining in or near their home communities. These Twelve Tips outline some of the experience gained in providing tele-assessment over the past twelve years.

Fellowship of the Australian College of Rural & Remote Medicine (FACRRM) Assessment: a review of the first 12 years

This article was migrated. The article was marked as recommended. This paper provides an overview of the first 12 years of the formal assessment program of the Australian College of Rural and Remote Medicine (ACRRM). The ACRRM Fellowship represents the world's first and only Fellowship exam in Rural Medicine. The ACRRM assessment program is mapped to its Rural Generalist curriculum, based on the principles of programmatic assessment. ACRRM offers candidates the opportunity to participate in assessment in or close to their home location. The ACRRM Rural Generalist Curriculum defines the scope and standards for independent general practice anywhere in Australia, with a focus on rural and remote settings. The program was initially developed in 2006 and has evolved during delivery from 2008 onwards, utilising the following modalities: •Multi Source Feedback (MSF)•Multiple Choice Questions (MCQ)•Mini Clinical Evaluation Exercise (Mini-CEX)•Case Based Discussion (CBD)•Procedural Skills Logbook•Structured Assessment using Multiple Patient Scenarios (StAMPS) StAMPS is a unique examination, blending the formats of an Objective Structured Clinical Examination and a traditional viva vocè. The program has an emphasis on formative assessment. Over the past 12 years there has been considerable work in developing resources for candidates, governance structures and quality assurance processes. ACRRM's Fellowship requirements represent a customised bespoke assessment tailored to ACRRM's curriculum and the Australian rural and remote context. ACRRM's assessment program has grown substantially with 649 Fellowships being awarded from 2008 - 2019, with considerable experience gained in rural and remote assessment. It now represents a mature firmly-established process as a vocational endpoint in Rural and Remote Medicine. ACRRM has continued to offer its 'tele-assessment' program throughout the COVID-19 pandemic, with candidates and examiners participating in assessment by use of distance technology while remaining in or near their home community. This model may provide some insights for other medical Colleges and educational institutions facing challenges in the current environment.

Design and Construction of a Bilateral Haptic System for the Remote Assessment of the Stiffness and Range of Motion of the Hand

The use of haptic devices in the rehabilitation of impaired limbs has become rather popular, given the proven effectiveness in promoting recovery. In a standard framework, such devices are used in rehabilitation centers, where patients interact with virtual tasks, presented on a screen. To track their sessions, kinematic/dynamic parameters or performance scores are recorded. However, as Internet access is now available at almost every home and in order to reduce the hospitalization time of the patient, the idea of doing rehabilitation at home is gaining wide consent. Medical care programs can be synchronized with the home rehabilitation device; patient data can be sent to the central server that could redirect to the therapist laptop (tele-healthcare). The controversial issue is that the recorded data do not actually represent the clinical conditions of the patients according to the medical assessment scales, forcing them to frequently undergo clinical tests at the hospital. To respond to this demand, we propose the use of a bilateral master/slave haptic system that could allow the clinician, who interacts with the master, to assess remotely and in real time the clinical conditions of the patient that uses the home rehabilitation device as the slave. In this paper, we describe a proof of concept to highlight the main issues of such an application, limited to one degree of freedom, and to the measure of the stiffness and range of motion of the hand.

Usability and reliability of a remotely administered adult autism assessment, the autism diagnostic observation schedule (ADOS) module 4

INTRODUCTION

The Autism Diagnostic Observation Schedule (ADOS) Module 4 is an autism assessment designed for verbally fluent adolescents and adults. Because of a shortage of available clinical expertise, it can be difficult for adults to receive a proper autism spectrum disorder (ASD) diagnostic assessment. A potential option to address this shortage is remote assessment. The objective of this study was to examine the feasibility, usability, and reliability of administering the ADOS Module 4 remotely using the Versatile and Integrated System for Telerehabilitation (VISYTER).

MATERIALS AND METHODS

VISYTER consists of computer stations at the client site and clinician site for video communication and a Web portal for managing and coordinating the assessment process. Twenty-three adults with an ASD diagnosis participated in a within-subject crossover design study in which both a remote ADOS and a face-to-face ADOS were administered. After completing the remote ADOS, participants completed a satisfaction survey.

RESULTS

Participant satisfaction with the remote ADOS delivery system was high. The kappa value was greater than 0.61 on 21 of 31 ADOS items. There was substantial agreement on ADOS classification (i.e., diagnosis) between assessments delivered face-to-face versus assessments delivered remotely (interclass coefficient=0.92). Non-agreement may have been due to outside factors or practice effect despite a washout period.

CONCLUSIONS

The results of this study demonstrate that an autism assessment designed to be delivered face to face can be administered remotely using an integrated Web-based system with high levels of usability and reliability.