Validation of a Vision-Guided Mobility Assessment for RPE65-Associated Retinal Dystrophy

Multi-luminance mobility testing after gene therapy in the context of retinal functional diagnostics

BACKGROUND

Voretigene neparvovec (Luxturna®) is the first approved gene therapy for RPE65-linked Leber congenital amaurosis (LCA). Though individual effects are highly variable, most recipients report improved vision in everyday life. To describe such effects, visual navigation tests are now frequently used in clinical trials. However, it is still unclear how their results should be interpreted compared to conventional parameters of visual function.

METHODS

Seven LCA patients underwent a multi-luminance visual navigation test (Ora-VNCTM) before and 3 months after receiving Luxturna gene therapy. Their performance was rated based on the luminance level at which they passed the course. Differences between the first and second test were correlated to changes in visual acuity, full-field stimulus thresholds, chromatic pupil campimetry, and dark-adapted perimetry.

RESULTS

A few patients displayed notable improvements in conventional measures of visual function whereas patients with advanced retinal degeneration showed no relevant changes. Independent of these results, almost all participants improved in the visual navigation task by one or more levels. The improvement in the mobility test was best correlated to the change in full-field stimulus thresholds. Other measures of visual functions showed no clear correlation with visual navigation.

DISCUSSION

In patients who passed the test's more difficult levels, improved visual navigation can be attributed to the reactivation of rods. However, the performance of patients with low vision seemed to depend much more on confounding factors in the easier levels. In sum, such tests might only be meaningful for patients with better preserved visual functions.

Development and Validation of a Novel Mobility Test for Rod-Cone Dystrophies: From Reality to Virtual Reality

PURPOSE

To validate a novel mobility test (MOST, MObility Standardized Test) and performance outcomes in real (RL) and virtual (VR) environments to be used for interventional clinical studies in order to characterize vision impairment in rod-cone dystrophies, also known as retinitis pigmentosa (RP).

DESIGN

Prospective, interventional, noninvasive, reliability and validity analysis.

METHODS

We designed MOST to be used in both VR and RL and conducted 3 experimental studies with 89 participants to (1) validate the difficulty of the mobility courses (15 controls), (2) determine the optimal number of light levels and training trials (14 participants with RP), and (3) validate the reproducibility (test-retest), reliability (VR/RL), sensitivity, and construct/content validity of the test (30 participants with RP and 30 controls). A comprehensive ophthalmologic examination was performed in all subjects. Outcomes of interest included MOST performance score, visual acuity, contrast sensitivity, dark adaptation thresholds, visual field parameters, and correlation between the performance score and visual function.

RESULTS

The mobility courses exhibited statistically similar difficulty, and 5 trials are sufficient to control for the learning effect. MOST is highly reproducible (test-retest correlations >0.98) and reliable (correlations VR/RL = 0.98). MOST achieved a discrimination between participants with RP and controls (accuracy >95%) and between early and late stages of the disease (82.3% accuracy). The performance score is correlated with visual function parameter (0.57-0.94).

CONCLUSION

MOST is a validated mobility test, with the controlled learning effect, excellent reproducibility, and high agreement between RL and VR conditions, as well as sensitivity and specificity to measure disease progression and therapeutic benefit in rod-cone dystrophies.

Subjective vision assessment in companion dogs using dogVLQ demonstrates age-associated visual dysfunction

Introduction

Dim light vision as assessed by proxy and clinical tools is commonly impaired in older humans and impacts quality of life. Although proxy visual assessment tools have been developed for dogs, it is unclear if they are sensitive enough to detect subtle visual dysfunction in older dogs. We sought to determine if a newly designed proxy visual function questionnaire could detect age-associated differences in visual behaviors in varying lighting conditions in dogs.

Methods

A 27-item questionnaire (the dog variable lighting questionnaire, dogVLQ) was designed to assess visual behavior in dogs in different lighting settings. We conducted the dogVLQ, a previously validated visual function questionnaire the dog vision impairment score and performed light- and dark-adapted electroretinography (ERG) on a subset of dogs. Questionnaire scores were analyzed for dog age associations using correlation analysis.

Results

Questionnaire responses from 235 dog owners were obtained (122 female, 112 male dogs), 79 of which underwent ERG (43 female, 36 male dogs). Bright light visual behavior was significantly associated with light-adapted bright flash ERG amplitudes, visual behavior in near darkness was associated with dark-adapted ERG amplitudes. The dogVLQ identified worse vision in older dogs in bright light, dim light, and darkness; predicted onset was younger for vision in near darkness. Older dogs had more difficulty navigating transitions between lighting conditions.

Discussion

Subjective dog owner assessment of visual function associates with objective measurement of retinal function in dogs and supports reduced vision-mediated behaviors in older dogs.

Application of Rasch Analysis to Timed Instrumental Activities of Daily Living in Low Vision: A Validation Study

SIGNIFICANCE

This work validates Rasch analysis of a performance-based low vision outcome measure evaluated in patients' own homes to ensure real-world relevance. Inclusion of sources of variance from the patient's home environment in functional outcome measures introduced nonuniform variance in measurements but did not preclude estimation of valid measures.

PURPOSE

This study aimed to validate Rasch analysis of a performance-based outcome measure with real-world relevance.

METHODS

Low vision patients (N = 161) receiving services from an occupational therapist performed Timed Instrumental Activity of Daily Living (TIADL) tasks in their homes. Rasch analysis was applied to error count and performance time data. Internal validity was assessed with evaluations of the accuracy and precision of estimated measures. External validity was assessed by comparing TIADL measures with measures estimated from the Activity Inventory (i.e., from self-reported difficulty ratings).

RESULTS

Task measures were well targeted to person measures estimated from task performance time but were poorly targeted for measures estimated from task performance errors, for which most task trials (72%) were performed without error at baseline. Error-based person measures had larger standard errors with a smaller pseudo- R2 than time-based person or task measures and error-based task measures. Person measure infits for time- and error-based estimates conformed to expected values. The linear regressions between time-based person and task measures and corresponding error-based estimates had slopes of approximately 0.5, an observation consistent with larger estimation error variance for error-based measures than for time-based measures. Time-based TIADL person measures ( x ) and Activity Inventory person measures (estimated from all items, y ) were colinear but weakly correlated ( R = 0.19).

CONCLUSIONS

Functional ability measures estimated from performance times of instrumental activity of daily living tasks in patients' homes demonstrate good internal and external validity. The ceiling effect from the infrequency of task performance errors in our data set limits use of TIADL error data to measure rehabilitation outcomes.

Therapy with voretigene neparvovec. How to measure success?

Retinal gene supplementation therapy such as the first approved one, voretigene neparvovec, delivers a functioning copy of the missing gene enabling the protein transcription in retinal cells and restore visual functions. After gene supplementation for the genetic defect, a complex network of functional regeneration is the consequence, whereas the extent is very individualized. Diagnostic and functional testings that have been used routinely by ophthalmologists so far to define the correct diagnosis, cannot be applied in the new context of defining small, sometimes subtle changes in visual functions. New view on retinal diagnostics is needed to understand this processes that define safety and efficacy of the treatment. Not only does vision have many aspects that must be addressed by specific evaluations and imaging techniques, but objective readouts of local retinal function for rods and cones separately have been an unmet need until recently. A reliable test-retest variability is necessary in rare diseases such as inherited retinal dystrophies, because statistics are often not applicable due to a low number of participants. Methods for a reliable individual evaluation of the therapy success are needed. In this manuscript we present an elaboration on retinal diagnostics combining psychophysics (eg. full-field stimulus threshold or dark adapted perimetry) as well as objective measures for local retinal function (eg. photopic and scotopic chromatic pupil campimetry) and retinal imaging for a meaningful workflow to apply in evaluation of the individual success in patients receiving gene therapy for photoreceptor diseases.

Concept Mapping to Identify Content for a Performance-Based Measure of Low Luminance Vision-Related Activities of Daily Living

Purpose

The purpose of this study was to identify low luminance activities of daily living (ADL) relevant to adults with vision impairment using a concept-mapping approach.

Methods

“Group concept mapping” was utilized to identify specific ADLs that persons with vision impairment find challenging under low light conditions. In the first “brainstorming” phase, 24 adults with vision impairment from a range of eye conditions (mean age = 73 years, SD = 14 years) and 26 international low vision experts (mean experience = 22, SD = 11 years) generated statements to the focus prompt, “Thinking as broadly as possible, generate a list of statements detailing specific day-to-day activities a person with vision impairment might find challenging under low light conditions, such as in a poorly lit room or outside at dusk.” In the second phase, participants sorted activities by similarity and rated the importance of each activity. Multidimensional scaling and hierarchical cluster analysis were applied to produce concept maps showing clusters of prioritized activities.

Results

One hundred thirteen unique ideas/activities were generated, rated and sorted. Eight clusters were identified (from highest to lowest importance): hazard detection and safety outside; social interactions; navigation; near reading; selfcare and safety at home; distance spotting; searching around the home; and cooking and cleaning.

Conclusions

The conceptual framework and low luminance ADLs identified (the most important being hazard detection and safety outside, and social interactions) provide a basis for developing a performance-based measure of low luminance visual function.

Translational Relevance

A performance-based measure of low luminance vision-related ADLs is required for comprehensively and objectively assessing efficacy of eye treatments and low vision rehabilitation outcomes in adults with vision impairment.

Mobility test to assess functional vision in dark-adapted patients with Leber congenital amaurosis

Background

Inherited retinal degenerations (IRDs) affect daylight and night vision to different degrees. In the current work, we devise a method to quantify mobility under dark-adapted conditions in patients with severe childhood blindness due to Leber congenital amaurosis (LCA). Mobility thresholds from two different LCA genotypes are compared to dark-adapted vision measurements using the full-field stimulus test (FST), a conventional desktop outcome measure of rod vision.

Methods

A device consisting of vertical LED strips on a plane resembling a beaded curtain was programmed to produce a rectangular pattern target defining a ‘door’ of varying luminance that could appear at one of three positions. Mobility performance was evaluated by letting the subject walk from a fixed starting position ~ 4 m away from the device with instructions to touch the door. Success was defined as the subject touching within the ‘door’ area. Ten runs were performed and the process was repeated for different levels of luminance. Tests were performed monocularly in dark-adapted and dilated eyes. Results from LCA patients with the GUCY2D and CEP290 genotypes and normal subjects were analyzed using logistic regression to estimate the mobility threshold for successful navigation. The relation of thresholds for mobility, FST and visual acuity were quantified using linear regression.

Results

Normal subjects had mobility thresholds near limits of dark-adapted rod vision. GUCY2D-LCA patients had a wide range of mobility thresholds from within 1 log of normal to greater than 8 log abnormal. CEP290-LCA patients had abnormal mobility thresholds that were between 5 and 6 log from normal. Sensitivity loss estimates using FST related linearly to the mobility thresholds which were not correlated with visual acuity.

Conclusions

The mobility task we developed can quantify functional vision in severely disabled patients with LCA. Taken together with other outcome measures of rod and cone photoreceptor-mediated vision, dark-adapted functional vision should provide a more complete understanding of the natural history and effects of treatment in patients with LCA.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12886-022-02475-y.

Patient-Reported Measures of the Effects of Vision Impairments and Low Vision Rehabilitation on Functioning in Daily Life

The quantification of vision impairments dates to the mid-nineteenth century with standardization of visual acuity and visual field measures in the eye clinic. Attempts to quantify the impact of vision impairments on patients' lives did not receive clinical attention until the close of the twentieth century. Although formal psychometric theories and measurement instruments were well developed and commonplace in educational testing, as well as in various areas in psychology and rehabilitation medicine, the late start applying them to clinical vision research created a vacuum that invited poorly developed and poorly functioning instruments and analytic methods. Although this research is still burdened with legacy instruments, mandates by regulatory agencies to include the patients' perspectives and preferences in the evaluation of clinical outcomes have stimulated the development and validation of self-report instruments grounded in modern psychometric theory and methods. Here I review the progress and accomplishments of applying modern psychometrics to clinical vision research. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Functional evaluation in inherited retinal disease

Functional assessments are a fundamental part of the clinical evaluation of patients with inherited retinal diseases (IRDs). Their importance and impact have become increasingly notable, given the significant breadth and number of clinical trials and studies investigating multiple avenues of intervention across a wide range of IRDs, including gene, pharmacological and cellular therapies. Moreover, the fact that many clinical trials are reporting improvements in vision, rather than the previously anticipated structural stability/slowing of degeneration, makes functional evaluation of primary relevance. In this review, we will describe a range of methods employed to characterise retinal function and functional vision, beginning with tests variably included in the clinic, such as visual acuity, electrophysiological assessment and colour discrimination, and then discussing assessments often reserved for clinical trials/research studies such as photoaversion testing, full-field static perimetry and microperimetry, and vision-guided mobility testing; addressing perimetry in greatest detail, given it is commonly a primary outcome metric. We will focus on how these tests can help diagnose and monitor particular genotypes, also noting their limitations/challenges and exploring analytical methodologies for better exploiting functional measurements, as well as how they facilitate patient inclusion and stratification in clinical trials and serve as outcome measures.

Assessing Photoreceptor Status in Retinal Dystrophies: From High-Resolution Imaging to Functional Vision

Purpose

To describe the value of integrating phenotype/genotype data, disease staging, and evaluation of functional vision in patient-centered management of retinal dystrophies.

Methods

(1) Cross-sectional structure-function and retrospective longitudinal studies to assess the correlations between standard fundus autofluorescence (FAF), optical coherence tomography, visual acuity (VA), and perimetry (visual field [VF]) examinations to evaluate photoreceptor functional loss in a cohort of patients with rod-cone dystrophy (RCD); (2) flood-illumination adaptive optics (FIAO) imaging focusing on photoreceptor misalignment and orientation of outer segments; and (3) evaluation of the impact of visual impairment in daily life activities, based on functional (visual and mobility) vision assessment in a naturalistic environment in visually impaired subjects with RCD and subjects treated with Luxturna^Ⓡ for RPE65-related Leber congenital amaurosis before and after therapy.

Results

The results of the cross-sectional transversal study showed that (1) VA and macular sensitivity were weakly correlated with the structural variables; and (2) functional impairment (VF) was correlated with reduction of anatomical markers of photoreceptor structure and increased width of autofluorescent ring. The dimensions of the ring of increased FAF evolved faster. Other criteria that differed among groups were the lengths of the ellipsoid zone, the external limiting membrane, and the foveal thickness. FIAO revealed a variety of phenotypes: paradoxical visibility of foveal cones; heterogeneous brightness of cones; dim, inner segment–like, and RPE-like mosaic. Directional illumination by varying orientation of incident light (Stiles-Crawford effect) and the amount of side illumination (gaze-dependent imaging) affected photoreceptor visibility. Mobility assessment under different lighting conditions showed correlation with VF, VA, contrast sensitivity (CS), and dark adaptation, with different predictive values depending on mobility study paradigms and illumination level. At high illumination level (235 lux), VF was a predictor for all mobility performance models. Under low illumination (1 and 2 lux), VF was the most significant predictor of mobility performance variables, while CS best explained the number of collisions and segments. In subjects treated with Luxturna^Ⓡ, a very favorable impact on travel speed and reduction in the number of collisions, especially at low luminance, was observable 6 months following injection, in both children and adults.

Conclusions

Our results suggest the benefit of development and implementation of quantitative and reproducible tools to evaluate the status of photoreceptors and the impact of both visual impairment and novel therapies in real-life conditions. NOTE: Publication of this article is sponsored by the American Ophthalmological Society.

Full-field stimulus testing: Role in the clinic and as an outcome measure in clinical trials of severe childhood retinal disease

Disease mechanisms have become better understood in previously incurable forms of early-onset severe retinal dystrophy, such as Leber congenital amaurosis (LCA). This has led to novel treatments and clinical trials that have shown some success. Standard methods to measure vision were difficult if not impossible to perform in severely affected patients with low vision and nystagmus. To meet the need for visual assays, we devised a psychophysical method, which we named full-field stimulus testing (FST). From early versions based on an automated perimeter, we advanced FST to a more available light-emitting diode platform. The journey from invention to use of such a technique in our inherited retinal degeneration clinic is reviewed and many of the lessons learned over the 15 years of application of FST are explained. Although the original purpose and application of FST was to quantify visual thresholds in LCA, there are rare opportunities for FST also to be used beyond LCA to measure aspects of vision in other inherited retinal degenerations; examples are given. The main goal of the current review, however, remains to enable investigators studying and treating LCA to understand how to best use FST and how to reduce artefact and confounding complexities so the test results become more valuable to the understanding of LCA diseases and results of novel interventions.

A Systematic Review and Meta-Analyses of Interventional Clinical Trial Studies for Gene Therapies for the Inherited Retinal Degenerations (IRDs)

IRDs are one of the leading causes of visual loss in children and young adults. Mutations in over 271 genes lead to retinal dysfunction, degeneration and sight loss. Though no cure exists, gene augmentation therapy has brought hope to the field. This systematic review sought to assess the efficacy of available gene therapy treatments for IRDs. Databases and public resources were searched for randomised controlled trials (RCTs) and non-randomised studies of interventions (NRSIs). Standard methodological procedures were used, including a risk-of-bias assessment. One RCT and five NRSIs were assessed, all for adeno-associated virus two (AAV2)-mediated treatment of RPE-specific 65 kDa (RPE65)-associated LCA (Leber congenital amaurosis). Five outcomes were reported for meta-analyses. Modest improvements in visual acuity, ambulatory navigation/mobility testing or central retinal thickness was observed. There was significant improvement in red and blue light full-field stimulus testing (FST) (red light risk ratio of 1.89, treated v control, p = 0.04; and blue light risk ratio of 2.01, treated v control, p = 0.001). Study design assessment using a ROBIN-I tool (Cochrane Library) showed risk-of-bias judgement to be "low/moderate", whilst there were "some concerns" for the RCT using a RoB-2 tool (Cochrane Library). Although comparison by meta-analysis is compromised by, amongst other issues, a variable amount of vector delivered in each trial, FST improvements demonstrate a proof-of-principle for treating IRDs with gene therapy.

Inherited retinal diseases: Therapeutics, clinical trials and end points-A review

Inherited retinal diseases (IRDs) are a clinically and genetically heterogeneous group of disorders characterised by photoreceptor degeneration or dysfunction. These disorders typically present with severe vision loss that can be progressive, with disease onset ranging from congenital to late adulthood. The advances in genetics, retinal imaging and molecular biology, have conspired to create the ideal environment for establishing treatments for IRDs, with the first approved gene therapy and the commencement of multiple clinical trials. The scope of this review is to familiarise clinicians and scientists with the current management and the prospects for novel therapies for: (1) macular dystrophies, (2) cone and cone-rod dystrophies, (3) cone dysfunction syndromes, (4) Leber congenital amaurosis, (5) rod-cone dystrophies, (6) rod dysfunction syndromes and (7) chorioretinal dystrophies. We also briefly summarise the investigated end points for the ongoing trials.