uB-VisioGeoloc: An image sequences dataset of pedestrian navigation including geolocalised-inertial information and spatial sound rendering of the urban environment's obstacles

The dataset proposed is a collection of pedestrian navigation data sequences combining visual and spatial information. The pedestrian navigation sequences are situations encountered by a pedestrian walking in an urban outdoor environment, such as moving on the sidewalk, navigating through a crowd, or crossing a street when the pedestrian light traffic is green. The acquired data are timestamped provided RGB-D images and are associated with GPS, and inertial data (acceleration, rotation). These recordings were acquired by separate processes, avoiding delays during their capture to guarantee a synchronisation between the moment of acquisition by the sensor and the moment of recording on the system. The acquisition was made in the city of Dijon, France, including narrow streets, wide avenues, and parks. Annotations of the RGB-D are also provided by bounding boxes indicating the position of relevant static or dynamic objects present in a pedestrian area, such as a tree, bench, or person. This pedestrian navigation dataset aims to support the development of smart mobile systems to assist visually impaired people in their daily movements in an outdoor environment. In this context, the visual data and localisation sequences we provide can be used to elaborate the appropriate visual processing methods to extract relevant information about the obstacles and their current positions on the path. Alongside the dataset, a visual-to-auditory substitution method has been employed to convert each image sequence into corresponding stereophonic sound files, allowing for comparison and evaluation. Synthetic sequences associated with the same information set are also provided based on the recordings of a displacement within the 3D model of a real place in Dijon.

An update on visual prosthesis

PURPOSE

To review the available evidence on the different retinal and visual prostheses for patients with retinitis pigmentosa and new implants for other indications including dry age-related macular degeneration.

METHODS

The PubMed, GoogleScholar, ScienceDirect, and ClinicalTrials databases were the main resources used to conduct the medical literature search. An extensive search was performed to identify relevant articles concerning the worldwide advances in retinal prosthesis, clinical trials, status of devices and potential future directions up to December 2022.

RESULTS

Thirteen devices were found to be current and were ordered by stimulation location. Six have active clinical trials. Four have been discontinued, including the Alpha IMS, Alpha AMS, IRIS II, and ARGUS II which had FDA and CE mark approval. Future directions will be presented in the review.

CONCLUSION

This review provides an update of retinal prosthetic devices, both current and discontinued. While some devices have achieved visual perception in animals and/or humans, the main issues impeding the commercialization of these devices include: increased length of time to observe outcomes, difficulties in finding validated meaures for use in studies, unknown long-term effects, lack of funding, and a low amount of patients simultaneously diagnosed with RP lacking other comorbid conditions. The ARGUS II did get FDA and CE mark approval so it was deemed safe and also effective. However, the company became more focused on a visual cortical implant. Future efforts are headed towards more biocompatible, safe, and efficacious devices.

Dataset for detecting motorcyclists in pedestrian areas

This paper presents a semi-automated, scalable, and homologous methodology towards IoT implemented in Python for extracting and integrating images in pedestrian and motorcyclist areas on the road for constructing a multiclass object classifier. It consists of two stages. The first stage deals with creating a non-debugged data set by acquiring images related to the semantic context previously mentioned, using an embedded device connected 24/7 via Wi-Fi to a free and public CCTV service in Medellin, Colombia. Through artificial vision techniques, and automatically performs a comparative chronological analysis to download the images observed by 80 cameras that report data asynchronously. The second stage proposes two algorithms focused on debugging the previously obtained data set. The first one facilitates the user in labeling the data set not debugged through Regions of Interest (ROI) and hotkeys. It decomposes the information in the nth image of the data set in the same dictionary to store it in a binary Pickle file. The second one is nothing more than an observer of the classification performed by the user through the first algorithm to allow the user to verify if the information contained in the Pickle file built is correct.

Artificial vision, white space and racial surveillance capitalism

This first half of the paper outlines the formation of racial surveillance capitalism across the longue durée of settler colonialism, with special attention to the formation of artificial vision. This artificial vision is deployed in the erased territory, creating a white space in which to see from platforms, ranging from the ship, to the train and today's drones. The second section examines the Eurodac digital fingerprint database created by the European Union to monitor and control asylum seekers and refugees as an "artificial life system," to use a phrase coined by its administrators. In this automated form, artificial vision is distributed rather than centralized.

A preliminary implementation of an active intraocular prosthesis as a new image acquisition device for a cortical visual prosthesis

An active intraocular prosthesis is herein proposed as a new image acquisition device for a cortical visual prosthesis. A conventional intraocular prosthesis is a passive device that helps blind patients underwent eye enucleation to maintain the shape of an eyeball. In contrast, an active intraocular prosthesis, which works as an implantable wireless camera, can capture real-time images and transmit them to a cortical visual prosthesis to restore partial vision of the patients. This active device has distinct advantages in that it can garner a variety of image information while focusing on objects in accordance with natural eye movements, compared with a glasses-mounted camera and implanted micro-photodiodes in typical artificial vision systems. Coated with an epoxy and sealed by an elastomer for biocompatibility as well as durability, the active intraocular prosthesis was fabricated in a spherical form miniaturized enough to be inserted into the eye. Its operation was evaluated by wireless image acquisition displaying a processed gray-scale image. Furthermore, signal-to-noise ratio measurements were conducted to find a reliable communication range of the fabricated prosthesis, while it was covered by an 8-mm-thick biological medium that mimicked in vivo environments. In conclusion, the feasibility of the active intraocular prosthesis to cooperate with a cortical visual prosthesis is discussed.

Retinal Prostheses and Artificial Vision

In outer retinal degenerative diseases such as retinitis pigmentosa, choroideremia, and geographic atrophy, 30% of the ganglion cell layer in the macula remains intact. With subretinal and epiretinal prostheses, these inner retinal cells are stimulated with controlled electrical current by either a microphotodiode placed in the subretinal area or a microelectrode array tacked to the epiretinal region. As the patient learns to interpret the resulting phosphene patterns created in the brain through special rehabilitation exercises, their orientation, mobility, and quality of life increase. Implants that stimulate the lateral geniculate nucleus or visual cortex are currently being studied for diseases in which the ganglion cells and optic nerve are completely destroyed.

Contemporary approaches to visual prostheses

Visual prostheses serve to restore visual function following acquired blindness. Acquired blindness (as opposed to congenital blindness) has many causes, including diseases such as retinitis pigmentosa, glaucoma, and macular degeneration, or trauma such as caused by automobile accident or blast damage from explosions. Many of the blindness-causing diseases target the retina or other ocular structure. Often, despite the loss of sensitivity to light, the remainder of the visual pathway is still functional, enabling electrical devices to deliver effective and meaningful visual information to the brain via arrays of electrodes. These arrays can be placed in any part of the early visual pathway, such as the retina, optic nerve, lateral geniculate nucleus, or visual cortex. A camera or other imaging source is used to drive electrical stimulation of remaining healthy cells or structures to create artificial vision and provide restoration of function. In this review, each approach to visual prostheses is described, including advantages and disadvantages as well as assessments of the current state of the art. Most of the work to-date has been targeting stimulation of (a) the retina, with three devices approved for general use and two more in clinical testing; (b) the lateral geniculate nucleus, with efforts still in the pre-clinical stage; and (c) the cortex, with three devices in clinical testing and none currently approved for general use despite the longest history of investigation of the three major approaches. Each class of device has different medical indications, and different levels of invasiveness required for implantation. All contemporary devices deliver relatively poor vision. There has been remarkable progress since the first proof-of-concept demonstration that used stimulation of the primary visual cortex, with the field exploring all viable options for restoration of function. Much of the progress has been recent, driven by advances in microelectronics and biocompatibility. With three devices currently approved for general use in various parts of the world, and a handful of additional devices well along in the pipeline toward approval, prospects for wide deployment of a device-based therapy to treat acquired blindness are good.

In-situ optical assessment of rat epicardial kinematic parameters reveals frequency-dependent mechanic heterogeneity related to gender

BACKGROUND

Gender-related cardiac mechanics following the electrical activity has been investigated from basic to clinical research, but results are still controversial. The aim of this work is to study the gender related cardiac mechanics and to focus on its heart rate dependency.

METHODS

We employed 12 Sprague Dawley rats (5 males and 7 females) of the same age and, through a novel high resolution artificial vision contactless approach, we evaluated in-situ cardiac kinematic. The hearts were paced on the right atria appendage via cathodal stimuli at rising frequency.

RESULTS

Kinematic data obtained at rising pacing rates are different between male and female rat hearts: male tended to maintain the same level of cardiac force, energy and contractility, while female responded with an increment of such parameters at increasing heart rate. Female hearts preserved their pattern of contraction and epicardial torsion (vorticity) at rising pacing rates compared to male. Furthermore, we observed a difference in the mechanical restitution: systolic time vs. diastolic time, as an index of cardiac performance, reached higher value in male compared to female hearts.

CONCLUSION

Our innovative technology was capable to evaluate in-situ rat epicardial kinematic at high stimulation frequency, revealing that male preserved kinematic parameters but varying the pattern of contraction/relaxation. On the contrary, female preserved the pattern of contraction/relaxation increasing kinematic parameters.

Development of visual Neuroprostheses: trends and challenges

Visual prostheses are implantable medical devices that are able to provide some degree of vision to individuals who are blind. This research field is a challenging subject in both ophthalmology and basic science that has progressed to a point where there are already several commercially available devices. However, at present, these devices are only able to restore a very limited vision, with relatively low spatial resolution. Furthermore, there are still many other open scientific and technical challenges that need to be solved to achieve the therapeutic benefits envisioned by these new technologies. This paper provides a brief overview of significant developments in this field and introduces some of the technical and biological challenges that still need to be overcome to optimize their therapeutic success, including long-term viability and biocompatibility of stimulating electrodes, the selection of appropriate patients for each artificial vision approach, a better understanding of brain plasticity and the development of rehabilitative strategies specifically tailored for each patient.

Laboratory and clinical reliability of conformally coated subretinal implants

Despite recent developments and new treatments in ophthalmology there is nothing available to cure retinal degenerations like Retinitis Pigmentosa (RP) yet. One of the most advanced approaches to treat people that have gone blind due to RP is to replace the function of the degenerated photoreceptors by a microelectronic neuroprosthetic device. Basically, this subretinal active implant transforms the incoming light into electric pulses to stimulate the remaining cells of the retina. The functional time of such devices is a crucial aspect. In this paper the laboratory and clinical reliability of the two active subretinal implants Alpha IMS and Alpha AMS is presented. Based on clinical data the median operating life of the Alpha AMS is estimated to be 3.3 years with a one-sided lower 75 % confidence level of 2.0 years. This data shows a significant improvement of the device lifetime compared to the previous device Alpha IMS which shows a median lifetime of 0.6 years with a lower confidence bound (75 %) of 0.5 years. The results are in good agreement with laboratory data from accelerated aging tests of the implant components, showing an estimated median lifetime for Alpha IMS components of 0.7 years compared to the improved lifetime of Alpha AMS of 4.7 years.

Endoscope-Assisted and Controlled Argus II Epiretinal Prosthesis Implantation in Late-Stage Retinitis Pigmentosa: A Report of 2 Cases

Several different approaches for restoring sight in subjects who are blind due to outer retinal degeneration are currently under investigation, including stem cell therapy, gene therapy, and visual prostheses. Although many different types of visual prostheses have shown promise, to date, the Argus II Epiretinal Prosthesis System, developed in a clinical setting over the course of 10 years, is the world's first and only retinal prosthesis that has been approved by the United States Food and Drug Administration (FDA) and has been given the CE-Mark for sale within the European Economic Area (EEA). The incidence of serious adverse events from Argus II implantation decreased over time after minor changes in the implant design and improvements in the surgical steps used for the procedure had been made. In order to further decrease the scleral incision-related complications and enhance the assessment of the tack position and the contact between the array and the inner macular surface, we used an ophthalmic endoscope during the regular course of Argus II implantation surgery in 2 patients with late-stage retinitis pigmentosa in an attempt to improve the anatomical and functional outcomes.

Transfer characteristics of subretinal visual implants: corneally recorded implant responses

PURPOSE

The subretinal Alpha IMS visual implant is a CE-approved medical device for restoration of visual functions in blind patients with end-stage outer retina degeneration. We present a method to test the function of the implant objectively in vivo using standard electroretinographic equipment and to assess the devices' parameter range for an optimal perception.

METHODS

Subretinal implant Alpha IMS (Retina Implant AG, Reutlingen, Germany) consists of 1500 photodiode-amplifier-electrode units and is implanted surgically into the subretinal space in blind retinitis pigmentosa patients. The voltages that regulate the amplifiers' sensitivity (V _gl) and gain (V _bias), related to the perception of contrast and brightness, respectively, are adjusted manually on a handheld power supply device. Corneally recorded implant responses (CRIR) to full-field illumination with long duration flashes in various implant settings for brightness gain (V _bias) and amplifiers' sensitivity (V _gl) are measured using electroretinographic setup with a Ganzfeld bowl in a protocol of increasing stimulus luminances up to 1000 cd/m².

RESULTS

CRIRs are a meaningful tool for assessing the transfer characteristic curves of the electronic implant in vivo monitoring the implants' voltage output as a function of log luminance in a sigmoidal shape. Changing the amplifiers' sensitivity (V _gl) shifts the curve left or right along the log luminance axis. Adjustment of the gain (V _bias) changes the maximal output. Contrast perception is only possible within the luminance range of the increasing slope of the function.

CONCLUSIONS

The technical function of subretinal visual implants can be measured objectively using a standard electroretinographic setup. CRIRs help the patient to optimise the perception by adjusting the gain and luminance range of the device and are a useful tool for clinicians to objectively assess the function of subretinal visual implants in vivo.

Subretinal Visual Implant Alpha IMS--Clinical trial interim report

A subretinal visual implant (Alpha IMS, Retina Implant AG, Reutlingen, Germany) was implanted in 29 blind participants with outer retinal degeneration in an international multicenter clinical trial. Primary efficacy endpoints of the study protocol were a significant improvement of activities of daily living and mobility to be assessed by activities of daily living tasks, recognition tasks, mobility, or a combination thereof. Secondary efficacy endpoints were a significant improvement of visual acuity/light perception and/or object recognition (clinicaltrials.gov, NCT01024803). During up to 12 months observation time twenty-one participants (72%) reached the primary endpoints, of which thirteen participants (45%) reported restoration of visual function which they use in daily life. Additionally, detection, localization, and identification of objects were significantly better with the implant power switched on in the first 3 months. Twenty-five participants (86%) reached the secondary endpoints. Measurable grating acuity was up to 3.3 cycles per degree, visual acuities using standardized Landolt C-rings were 20/2000, 20/2000, 20/606 and 20/546. Maximal correct motion perception ranged from 3 to 35 degrees per second. These results show that subretinal implants can restore very-low-vision or low vision in blind (light perception or less) patients with end-stage hereditary retinal degenerations.

Artificial vision support system (AVS(2)) for improved prosthetic vision

State-of-the-art and upcoming camera-driven, implanted artificial vision systems provide only tens to hundreds of electrodes, affording only limited visual perception for blind subjects. Therefore, real time image processing is crucial to enhance and optimize this limited perception. Since tens or hundreds of pixels/electrodes allow only for a very crude approximation of the typically megapixel optical resolution of the external camera image feed, the preservation and enhancement of contrast differences and transitions, such as edges, are especially important compared to picture details such as object texture. An Artificial Vision Support System (AVS(2)) is devised that displays the captured video stream in a pixelation conforming to the dimension of the epi-retinal implant electrode array. AVS(2), using efficient image processing modules, modifies the captured video stream in real time, enhancing 'present but hidden' objects to overcome inadequacies or extremes in the camera imagery. As a result, visual prosthesis carriers may now be able to discern such objects in their 'field-of-view', thus enabling mobility in environments that would otherwise be too hazardous to navigate. The image processing modules can be engaged repeatedly in a user-defined order, which is a unique capability. AVS(2) is directly applicable to any artificial vision system that is based on an imaging modality (video, infrared, sound, ultrasound, microwave, radar, etc.) as the first step in the stimulation/processing cascade, such as: retinal implants (i.e. epi-retinal, sub-retinal, suprachoroidal), optic nerve implants, cortical implants, electric tongue stimulators, or tactile stimulators.