Robot-assisted retinal vein cannulation in an in vivo porcine retinal vein occlusion model

Steady-Hand Eye Robot 3.0: Optimization and Benchtop Evaluation for Subretinal Injection

Subretinal injection methods and other procedures for treating retinal conditions and diseases (many considered incurable) have been limited in scope due to limited human motor control. This study demonstrates the next generation, cooperatively controlled Steady-Hand Eye Robot (SHER 3.0), a precise and intuitive-to-use robotic platform achieving clinical standards for targeting accuracy and resolution for subretinal injections. The system design and basic kinematics are reported and a deflection model for the incorporated delta stage and validation experiments are presented. This model optimizes the delta stage parameters, maximizing the global conditioning index and minimizing torsional compliance. Five tests measuring accuracy, repeatability, and deflection show the optimized stage design achieves a tip accuracy of < 30 μm, tip repeatability of 9.3 μm and 0.02°, and deflections between 20-350 μm/N. Future work will use updated control models to refine tip positioning outcomes and will be tested on in vivo animal models.

Microsurgery Robots: Applications, Design, and Development

Microsurgical techniques have been widely utilized in various surgical specialties, such as ophthalmology, neurosurgery, and otolaryngology, which require intricate and precise surgical tool manipulation on a small scale. In microsurgery, operations on delicate vessels or tissues require high standards in surgeons' skills. This exceptionally high requirement in skills leads to a steep learning curve and lengthy training before the surgeons can perform microsurgical procedures with quality outcomes. The microsurgery robot (MSR), which can improve surgeons' operation skills through various functions, has received extensive research attention in the past three decades. There have been many review papers summarizing the research on MSR for specific surgical specialties. However, an in-depth review of the relevant technologies used in MSR systems is limited in the literature. This review details the technical challenges in microsurgery, and systematically summarizes the key technologies in MSR with a developmental perspective from the basic structural mechanism design, to the perception and human-machine interaction methods, and further to the ability in achieving a certain level of autonomy. By presenting and comparing the methods and technologies in this cutting-edge research, this paper aims to provide readers with a comprehensive understanding of the current state of MSR research and identify potential directions for future development in MSR.

Using the language of surgery to enhance ophthalmology surgical education

Background

Currently, surgical education utilizes a combination of the apprentice model, wet-lab training, and simulation, but due to reliance on subjective data, the quality of teaching and assessment can be variable. The "language of surgery," an established concept in engineering literature whose incorporation into surgical education has been limited, is defined as the description of each surgical maneuver using quantifiable metrics. This concept is different from the traditional notion of surgical language, generally thought of as the qualitative definitions and terminology used by surgeons.

Methods

A literature search was conducted through April 2023 using MEDLINE/PubMed using search terms to investigate wet-lab, virtual simulators, and robotics in ophthalmology, along with the language of surgery and surgical education. Articles published before 2005 were mostly excluded, although a few were included on a case-by-case basis.

Results

Surgical maneuvers can be quantified by leveraging technological advances in virtual simulators, video recordings, and surgical robots to create a language of surgery. By measuring and describing maneuver metrics, the learning surgeon can adjust surgical movements in an appropriately graded fashion that is based on objective and standardized data. The main contribution is outlining a structured education framework that details how surgical education could be improved by incorporating the language of surgery, using ophthalmology surgical education as an example.

Conclusion

By describing each surgical maneuver in quantifiable, objective, and standardized terminology, a language of surgery can be created that can be used to learn, teach, and assess surgical technical skill with an approach that minimizes bias.

Key message

The "language of surgery," defined as the quantification of each surgical movement's characteristics, is an established concept in the engineering literature. Using ophthalmology surgical education as an example, we describe a structured education framework based on the language of surgery to improve surgical education.

Classifications

Surgical education, robotic surgery, ophthalmology, education standardization, computerized assessment, simulations in teaching.

Competencies

Practice-Based Learning and Improvement.

An automatic drug injection device with spatial micro-force perception guided by an microscopic image for robot-assisted ophthalmic surgery

Retinal vein injection guided by microscopic image is an innovative procedure for treating retinal vein occlusion. However, the retina organization is complex, fine, and weak, and the operation scale and force are small. Surgeons’ limited operation and force-sensing accuracy make it difficult to perform precise and stable drug injection operations on the retina in a magnified field of image vision. In this paper, a 3-DOF automatic drug injection mechanism was designed for microscopic image guiding robot-assisted needle delivery and automatic drug injection. Additionally, the robot-assisted real-time three-dimensional micro-force-sensing method for retinal vein injection was proposed. Based on the layout of three FBG sensors on the hollow outer wall of the nested needle tube in a circular array of nickel-titanium alloys, the real-time sensing of the contact force between the intraoperative instrument and the blood vessel was realized. The experimental data of 15 groups of porcine eyeball retinal veins with diameters of 100–200 μm showed that the piercing force of surgical instruments and blood vessels is 5.95∼12.97 mN, with an average value of 9.98 mN. Furthermore, 20 groups of experimental measurements on chicken embryo blood vessels with diameters of 150–500 μm showed that the piercing force was 4.02∼23.4 mN, with an average value of 12.05 mN.

Force-based Control for Safe Robot-assisted Retinal Interventions: In Vivo Evaluation in Animal Studies

In recent years, robotic assistance in vitreoretinal surgery has moved from a benchtop environment to the operating rooms. Emerging robotic systems improve tool manoeuvrability and provide precise tool motions in a constrained intraocular environment and reduce/remove hand tremor. However, often due to their stiff and bulky mechanical structure, they diminish the perception of tool-to-sclera (scleral) forces, on which the surgeon relies, for eyeball manipulation. In this paper we measure these scleral forces and actively control the robot to keep them under a predefined threshold. Scleral forces are measured using a Fiber Bragg Grating (FBG) based force sensing instrument in an in vivo rabbit eye model in manual, cooperative robotic assistance with no scleral force control (NC), adaptive scleral force norm control (ANC) and adaptive scleral force component control (ACC) methods. To the best of our knowledge, this is the first time that the scleral forces are measured in an in vivo eye model during robot assisted vitreoretinal procedures. An experienced retinal surgeon repeated an intraocular tool manipulation (ITM) task 10 times in four in vivo rabbit eyes and a phantom eyeball, for a total of 50 repetitions in each control mode. Statistical analysis shows that the ANC and ACC control schemes restrict the duration of the undesired scleral forces to 4.41% and 14.53% as compared to 43.30% and 35.28% in manual and NC cases, respectively during the in vivo studies. These results show that the active robot control schemes can maintain applied scleral forces below a desired threshold during robot-assisted vitreoretinal surgery. The scleral forces measurements in this study may enable a better understanding of tool-to-sclera interactions during vitreoretinal surgery and the proposed control strategies could be extended to other microsurgery and robot-assisted interventions.

Robotic Assistance for Intraocular Microsurgery: Challenges and Perspectives

Intraocular surgery, one of the most challenging discipline of microsurgery, requires sensory and motor skills at the limits of human physiological capabilities combined with tremendously difficult requirements for accuracy and steadiness. Nowadays, robotics combined with advanced imaging has opened conspicuous and significant directions in advancing the field of intraocular microsurgery. Having patient treatment with greater safety and efficiency as the final goal, similar to other medical applications, robotics has a real potential to fundamentally change microsurgery by combining human strengths with computer and sensor-based technology in an information-driven environment. Still in its early stages, robotic assistance for intraocular microsurgery has been accepted with precaution in the operating room and successfully tested in a limited number of clinical trials. However, owing to its demonstrated capabilities including hand tremor reduction, haptic feedback, steadiness, enhanced dexterity, micrometer-scale accuracy, and others, microsurgery robotics has evolved as a very promising trend in advancing retinal surgery. This paper will analyze the advances in retinal robotic microsurgery, its current drawbacks and limitations, as well as the possible new directions to expand retinal microsurgery to techniques currently beyond human boundaries or infeasible without robotics.

Force and Velocity Based Puncture Detection in Robot Assisted Retinal Vein Cannulation: in-vivo Study

OBJECTIVE

Retinal vein cannulation is a technically demanding surgical procedure and its feasibility may rely on using advanced surgical robots equipped with force-sensing microneedles. Reliable detection of the moment of venous puncture is important, to either alert or prevent the clinician from double puncturing the vessel and damaging the retinal surface beneath. This paper reports the first in-vivo retinal vein cannulation trial on rabbit eyes, using sensorized metal needles, and investigates puncture detection.

METHODS

We utilized total of four indices including two previously demonstrated ones and two new indices, based on the velocity and force of the needle tip and the correlation between the needle-tissue and tool-sclera interaction forces. We also studied the effect of detection timespan on the performance of detecting actual punctures.

RESULTS

The new indices, when used in conjunction with the previous algorithm, improved the detection rate form 75% to 92%, but slightly increased the number of false detections from 37 to 43. Increasing the detection window improved the detection performance, at the cost of adding to the delay.

CONCLUSION

The current algorithm can supplement the surgeons visual feedback and surgical judgment. To achieve automatic puncture detection, more measurements and further analysis are required. Subsequent in-vivo studies in other animals, such as pigs with their more human like eye anatomy, are required, before clinical trials.

SIGNIFICANCE

The study provides promising results and the criteria developed may serve as guidelines for further investigation into puncture detection in in-vivo retinal vein cannulation.

A Novel Tissue Identification Framework in Cataract Surgery using an Integrated Bioimpedance-Based Probe and Machine Learning Algorithms

OBJECTIVE

The objective of this work was to develop and experimentally validate a bioimpedance-based framework to identify tissues in contact with the surgical instrument during cataract surgery.

METHODS

This work introduces an integrated hardware and software solution based on the unique bioimpedance of different intraocular tissues. The developed hardware can be readily integrated with commonly used surgical instruments. The proposed software framework, which encompasses data acquisition and a machine-learning classifier, is fast enough to be deployed in real-time surgical interventions. The experimental protocol included bioimpedance data collected from 31 ex vivo pig eyes targeting four intraocular tissues: Iris, Cornea, Lens, and Vitreous.

RESULTS

A classifier based on a support vector machine exhibited an overall accuracy of 91% across all trials. The algorithm provided substantial performance in detecting the intraocular tissues with 100% reliability and 95% sensitivity for the lens, along with 88% reliability and 94% sensitivity for the vitreous.

CONCLUSION

The developed impedance-based framework demonstrated successful intraocular tissue identification.

SIGNIFICANCE

Clinical implications include the ability to ensure safe operations by detecting posterior capsule rapture with 94% probability and improving surgical efficacy through lens detection with 100% reliability.

Semi-Automated Extraction of Lens Fragments via a Surgical Robot Using Semantic Segmentation of OCT Images with Deep Learning - Experimental Results in ex vivo Animal Model

The overarching goal of this work is to demonstrate the feasibility of using optical coherence tomography (OCT) to guide a robotic system to extract lens fragments from ex vivo pig eyes. A convolutional neural network (CNN) was developed to semantically segment four intraocular structures (lens material, capsule, cornea, and iris) from OCT images. The neural network was trained on images from ten pig eyes, validated on images from eight different eyes, and tested on images from another ten eyes. This segmentation algorithm was incorporated into the Intraocular Robotic Interventional Surgical System (IRISS) to realize semi-automated detection and extraction of lens material. To demonstrate the system, the semi-automated detection and extraction task was performed on seven separate ex vivo pig eyes. The developed neural network exhibited 78.20% for the validation set and 83.89% for the test set in mean intersection over union metrics. Successful implementation and efficacy of the developed method were confirmed by comparing the preoperative and postoperative OCT volume scans from the seven experiments.

Stochastic Force-based Insertion Depth and Tip Position Estimations of Flexible FBG-Equipped Instruments in Robotic Retinal Surgery

Vitreoretinal surgery is among the most delicate surgical tasks during which surgeon hand tremor may severely attenuate surgeon performance. Robotic assistance has been demonstrated to be beneficial in diminishing hand tremor. Among the requirements for reliable assistance from the robot is to provide precise measurements of system states e.g. sclera forces, tool tip position and tool insertion depth. Providing this and other sensing information using existing technology would contribute towards development and implementation of autonomous robot-assisted tasks in retinal surgery such as laser ablation, guided suture placement/assisted needle vessel cannulation, among other applications. In the present work, we use a state-estimating Kalman filtering (KF) to improve the tool tip position and insertion depth estimates, which used to be purely obtained by robot forward kinematics (FWK) and direct sensor measurements, respectively. To improve tool tip localization, in addition to robot FWK, we also use sclera force measurements along with beam theory to account for tool deflection. For insertion depth, the robot FWK is combined with sensor measurements for the cases where sensor measurements are not reliable enough. The improved tool tip position and insertion depth measurements are validated using a stereo camera system through preliminary experiments and a case study. The results indicate that the tool tip position and insertion depth measurements are significantly improved by 77% and 94% after applying KF, respectively.

Advantages of robotic assistance over a manual approach in simulated subretinal injections and its relevance for gene therapy

Subretinal injection is a method for gene delivery to treat genetic diseases of the photoreceptors and retinal pigment epithelium. A reflux-free subretinal injection is important to allow effective, safe, and cost-effective gene therapy to the retina. We report on a comparison between manual and robotic assistance in simulated subretinal injections using an artificial retina model. Nine surgeons carried out the procedure with and without the Preceyes Surgical System, using an OPMI Lumera 700 Zeiss surgical microscope equipped with intra-operative optical coherence tomography. Success in creating a bleb without reflux, injection duration, drift, tremor, and increase in the diameter of the puncture hole were analyzed. Robotic assistance improved drift (median 16 vs 212 µm), tremor (median 1 vs 18 µm), enlargement of the retinal hole, and allowed for prolonged injection times (median 52 vs 29 sec). Robotic assistance allowed higher rate of bleb formation (8/9 vs 4/9 attempts) with a moderate reduction in reflux (7/9 vs 8/9 attempts) in this artificial model. Robotic assistance can significantly contribute to subretinal injections and provide quantifiable parameters in assessing surgical and clinical success of novel retinal gene therapies.

Robotic posterior capsule polishing by optical coherence tomography image guidance

BACKGROUND

In cataract surgery, polishing of the posterior capsule (PC) can lead to improved surgical outcomes but is currently avoided due to its high-risk nature. This work developed a robotic system capable of performing PC polishing on ex vivo pig eyes using optical coherence tomography (OCT) guidance.

METHODS

The lenses of five ex vivo pig eyes were extracted and a thin layer of glue deposited onto the PC. Transpupillary OCT scans of the anterior segment were used to generate a PC-polishing trajectory. During polishing, OCT B-scans tracked the tool tip and were displayed to the operator.

RESULTS

Complete removal of the glue was accomplished in all five trials with no PC rupture reported.

CONCLUSIONS

The feasibility of using a robotic system guided by OCT to perform PC polishing on a biological model was demonstrated. Contributions include modelling of the PC anatomy, intraoperative OCT visualization, and automated tool-tip motion with scheduled aspiration pressures.

Phase I trial on robot assisted retinal vein cannulation with ocriplasmin infusion for central retinal vein occlusion

PURPOSE

To evaluate the safety and feasibility of robot-assisted retinal vein cannulation with Ocriplasmin infusion for central retinal vein occlusion.

METHODS

Prospective phase I trial including four patients suffering from central retinal vein occlusion (CRVO). Diagnosis was confirmed by preoperative fluo-angiography and followed by a standard three-port pars plana vitrectomy. Afterwards, a custom-built microneedle was inserted into a branch retinal vein with robotic assistance and infusion of Ocriplasmin started. Primary outcomes were the occurrence of intra-operative complications and success of cannulation. Secondary outcomes were change in visual acuity, central macular thickness (CMT) and venous filling times (VFT) during fluo-angiography two weeks after the intervention.

RESULTS

Cannulation with infusion of ocriplasmin was successful in all four eyes with a mean total infusion time of 355 ± 204 seconds (range 120-600 seconds). Best corrected visual acuity (BCVA) remained counting fingers (CF) in case 3 and 4, increased in case 1 from CF to 0.9LogMAR and decreased in case 2 from 0.4 to 1.3 LogMAR. CMT and VFT both showed a trend towards significant decrease comparing preoperative measurements with two weeks postintervention (1061 ± 541 μm versus 477 ± 376 μm, p = 0.068) and 24 ll 4 seconds versus 15 ± 1 seconds, p = 0.068, respectively). In one eye a needle tip broke and could be removed with an endoforceps. There were no other intervention-related complications.

CONCLUSION

Robot-assisted retinal vein cannulation is feasible and safe. Local intravenous infusion with Ocriplasmin led to an improved retinal circulation.

A Comparison of Manual and Robot Assisted Retinal Vein Cannulation in Chicken Chorioallantoic Membrane

Retinal vein occlusion (RVO) is a vision threatening condition occurring in the central or the branch retinal veins. Risk factors include but are not limited to hypercoagulability, thrombus or other cause of low blood flow. Current clinically proven treatment options limit complications of vein occlusion without treating the causative occlusion. In recent years, a more direct approach called Retinal Vein Cannulation (RVC) has been explored both in animal and human eye models. Though RVC has demonstrated potential efficacy, it remains a challenging and risky procedure that demands precise needle manipulation to achieve safely. During RVC, a thin cannula (diameter 70-110 µm) is delicately inserted into a retinal vein. Its intraluminal position is maintained for up to 2 minutes while infusion of a therapeutic drug occurs. Because the tool-tissue interaction forces at the needle tip are well below human tactile perception, a robotic assistant combined with a force sensing microneedle could alleviate the challenges of RVC. In this paper we present a comparative study of manual and robot assisted retinal vein cannulation in chicken chorioallantoic membrane (CAM) using a force sensing microneedle tool. The results indicate that the average puncture force and average force during the infusion period are larger in manual mode than in robot assisted mode. Moreover, retinal vein cannulation was more stable during infusion, in robot assisted mode.

Towards securing the sclera against patient involuntary head movement in robotic retinal surgery

Retinal surgery involves manipulating very delicate tissues within the confined area of eyeball. In such demanding practices, patient involuntary head movement might abruptly raise tool-to-eyeball interaction forces which would be detrimental to eye. This study is aimed at implementing different force control strategies and evaluating how they contribute to attaining sclera force safety while patient head drift is present. To simulate patient head movement, a piezoelectric-actuated linear stage is used to produce random motions in a single direction in random time intervals. Having an eye phantom attached to the linear stage then an experienced eye surgeon is asked to manipulate the eye and repeat a mock surgical task both with and without the assist of the Steady-Hand Eye Robot. For the freehand case, warning sounds were provided to the surgeon as auditory feedback to alert him about excessive slclra forces. For the robot-assisted experiments two variants of an adaptive sclera force control and a virtual fixture method were deployed to see how they can maintain eye safety under head drift circumstances. The results indicate that the developed robot control strategies are able to compensate for head drift and keep the sclera forces under safe levels as well as the free hand operation.

Advanced robotic surgical systems in ophthalmology

In this paper, an overview of advanced robotic surgical systems in ophthalmology is provided. The systems are introduced as representative examples of the degree of human vs. robotic control during surgical procedures. The details are presented on each system and the latest advancements of each are described. Future potential applications for surgical robotics in ophthalmology are discussed in detail, with representative examples provided alongside recent progress.

Subretinal surgery: functional and histological consequences of entry into the subretinal space

BACKGROUND AND OBJECTIVES

Gene-therapy, stem-cell transplantation and surgical robots hold the potential for treatment of currently untreatable retinal degenerative diseases. All of the techniques require entry into the subretinal space, which is a potential space located between the retina and the retinal pigment epithelium (RPE). Knowledge about obstacles and critical steps in relation to subretinal procedures is therefore needed. This thesis explores the functional and histological consequences of separation of the retina from the RPE, extensive RPE damage, a large cut in the retina (retinotomy) and RPE phagocytosis in a porcine model.

METHODS

Experiments were performed in 106 female domestic pigs of Danish landrace distributed over five studies. Under general anesthesia, different procedures for expansion of the subretinal space were conducted. Outcomes were visual function measured electrophysiologically with multifocal electroretinogram (mfERG) and retinal morphology examined histologically. Study I: The effect of anesthesia on mfERG was examined by repeated recordings for 3 hr in isoflurane or propofol anesthesia. Outcome was mfERG amplitude. Study II: Consequences of a large separation of the photoreceptors from the RPE were examined by injecting a perfluorocarbon-liquid (decalin) into the subretinal space. Two weeks after, in a second surgery, decalin was withdrawn. Outcomes were mfERG and histology 4 weeks after decalin injection. Study III: Extensive RPE damage was examined by expanding the subretinal space with saline and removing large sheets of RPE-cells through a retinotomy. Outcomes were mfERG and histology 2, 4 and 6 weeks after the procedure. Study IV: Consequences of a large retinotomy were examined by similar procedures as in Study III, but in study IV only a few RPE cells were removed. Outcomes were mfERG and histology 2 and 6 weeks after surgery. Study V: Clearance of the subretinal space was examined by injecting fluorescent latex beads of various sizes into the subretinal space. Outcome was histologic location of the beads at different time intervals after the procedure.

RESULTS

Study I: MfERG amplitudes decreased linearly as a function of time in propofol or isoflurane anesthesia. Duration of mfERG recording could be decreased without compromising quality, and thereby could time in anesthesia be reduced. Study II: MfERG and histology remained normal after reattachment of a large and 2-week long separation of the photoreceptors and RPE. Repeated entry into the subretinal space was well tolerated. Fluid injection into the subretinal space constitutes a risk of RPE-damage. Study III: Removal of large sheets of retinal pigment epithelial cells triggered a widespread rhegmatogenous-like retinal detachment resulting in visual loss. Study IV: A large retinotomy with limited damage of the RPE was well tolerated, and visual function was preserved. Study V: Subretinal latex beads up to 4 μm were phagocytosed by the RPE and passed into the sub-RPE space. Beads up to 2 μm travelled further through the Bruch's membrane and were found in the choroid, sclera and inside blood vessels.

CONCLUSION

A large expansion of the subretinal space, repeated entry, a large retinotomy and limited RPE damage is well tolerated and retinal function is preserved. Subretinal injection of fluid can damage the RPE and extensive RPE damage can induce a rhegmatogenous-like retinal detachment with loss of visual function. Foreign substances exit the subretinal space and can reach the systemic circulation.

Real-Time Sclera Force Feedback for Enabling Safe Robot-Assisted Vitreoretinal Surgery

One of the major yet little recognized challenges in robotic vitreoretinal surgery is the matter of tool forces applied to the sclera. Tissue safety, coordinated tool use and interactions between tool tip and shaft forces are little studied. The introduction of robotic assist has further diminished the surgeon's ability to perceive scleral forces. Microsurgical tools capable of measuring such small forces integrated with robotmanipulators may therefore improve functionality and safety by providing sclera force feedback to the surgeon. In this paper, using a force-sensing tool, we have conducted robotassisted eye manipulation experiments to evaluate the utility of providing scleral force feedback. The work assesses 1) passive audio feedback and 2) active haptic feedback and evaluates the impact of these feedbacks on scleral forces in excess of aboundary. The results show that in presence of passive or active feedback, the duration of experiment increases, while the duration for which scleral forces exceed a safe threshold decreases.

Sclera Force Control in Robot-assisted Eye Surgery: Adaptive Force Control vs. Auditory Feedback

Surgeon hand tremor limits human capability during microsurgical procedures such as those that treat the eye. In contrast, elimination of hand tremor through the introduction of microsurgical robots diminishes the surgeons tactile perception of useful and familiar tool-to-sclera forces. While the large mass and inertia of eye surgical robot prevents surgeon microtremor, loss of perception of small scleral forces may put the sclera at risk of injury. In this paper, we have applied and compared two different methods to assure the safety of sclera tissue during robot-assisted eye surgery. In the active control method, an adaptive force control strategy is implemented on the Steady-Hand Eye Robot in order to control the magnitude of scleral forces when they exceed safe boundaries. This autonomous force compensation is then compared to a passive force control method in which the surgeon performs manual adjustments in response to the provided audio feedback proportional to the magnitude of sclera force. A pilot study with three users indicate that the active control method is potentially more efficient.

EyeSAM: graph-based localization and mapping of retinal vasculature during intraocular microsurgery

PURPOSE

Robot-assisted intraocular microsurgery can improve performance by aiding the surgeon in operating on delicate micron-scale anatomical structures of the eye. In order to account for the eyeball motion that is typical in intraocular surgery, there is a need for fast and accurate algorithms that map the retinal vasculature and localize the retina with respect to the microscope.

METHODS

This work extends our previous work by a graph-based SLAM formulation using a sparse incremental smoothing and mapping (iSAM) algorithm.

RESULTS

The resulting technique, "EyeSAM," performs SLAM for intraoperative vitreoretinal surgical use while avoiding spurious duplication of structures as with the previous simpler technique. The technique also yields reduction in average pixel error in the camera motion estimation.

CONCLUSIONS

This work provides techniques to improve intraoperative tracking of retinal vasculature by handling loop closures and achieving increased robustness to quick shaky motions and drift due to uncertainties in the motion estimation.

Evaluation of a Force-Sensing Handheld Robot for Assisted Retinal Vein Cannulation

Approximately 16.4 million people are affected by retinal vein occlusion (RVO) resulting from hypercoagulability, low blood flow or thrombosis in the central or the branched retinal veins. Most common current treatments for RVO aim to limit the damage. In recent years, an experimental procedure, retinal vein cannulation (RVC) has been studied in animal models as well as human eye models. RVC is a procedure for targeted delivery of a therapeutic agent into the occluded retinal vein for dissolving the thrombi. Although effective treatment has been demonstrated via RVC, performing this procedure manually still remains at the limits of human skills. RVC requires to precisely insert a thin cannula into a delicate thin retinal vein, and to maintain it inside the vein throughout the infusion. The needle-vein interaction forces are too small to sense even by an expert surgeon. In this work, we present an evaluation study of a handheld robotic assistant with a force-sensing microneedle for RVC. The system actively cancels hand tremor, detects venous puncture based on detected tool-tissue forces, and stabilizes the needle after venous puncture for reduced trauma and prolonged infusion. Experiments are performed cannulating the vasculature in fertilized chicken eggs. Results show 100% success in venous puncture detection and significantly reduced cannula position drift via the stabilization aid of the robotic system.

Techniques for robot-aided intraocular surgery using monocular vision

This paper presents techniques for robot-aided intraocular surgery using monocular vision in order to overcome erroneous stereo reconstruction in an intact eye. We propose a new retinal surface estimation method based on a structured-light approach. A handheld robot known as the Micron enables automatic scanning of a laser probe, creating projected beam patterns on the retinal surface. Geometric analysis of the patterns then allows planar reconstruction of the surface. To realize automated surgery in an intact eye, monocular hybrid visual servoing is accomplished through a scheme that incorporates surface reconstruction and partitioned visual servoing. We investigate the sensitivity of the estimation method according to relevant parameters and also evaluate its performance in both dry and wet conditions. The approach is validated through experiments for automated laser photocoagulation in a realistic eye phantom in vitro. Finally, we present the first demonstration of automated intraocular laser surgery in porcine eyes ex vivo.

In-Human Robot-Assisted Retinal Vein Cannulation, A World First

Retinal Vein Occlusion (RVO) is a blinding disease caused by one or more occluded retinal veins. Current treatment methods only focus on symptom mitigation rather than targeting a solution for the root cause of the disorder. Retinal vein cannulation is an experimental eye surgical procedure which could potentially cure RVO. Its goal is to dissolve the occlusion by injecting an anticoagulant directly into the blocked vein. Given the scale and the fragility of retinal veins on one end and surgeons' limited positioning precision on the other, performing this procedure manually is considered to be too risky. The authors have been developing robotic devices and instruments to assist surgeons in performing this therapy in a safe and successful manner. This work reports on the clinical translation of the technology, resulting in the world-first in-human robot-assisted retinal vein cannulation. Four RVO patients have been treated with the technology in the context of a phase I clinical trial. The results show that it is technically feasible to safely inject an anticoagulant into a [Formula: see text]-thick retinal vein of an RVO patient for a period of 10 min with the aid of the presented robotic technology and instrumentation.

A Robotic Diathermy System for Automated Capsulotomy

Background: Cataracts are the leading cause of blindness and are treated surgically. Capsulotomy describes the opening of the lens capsule during this surgery and is most commonly performed by manual tearing, thermal cutting, or laser ablation. This work focuses on the development of a flexible instrument for high precision capsulotomy, whose motion is controlled by a hybrid mechanical-magnetic actuation system. Methods: A flexible instrument with a magnetic tip was directed along a circular path with a hybrid mechanical-magnetic actuation system. The system’s motion control and thermal cutting behavior were tested on ex vivo porcine lenses. Results: Position control of the magnetic tip on a circular path with radius of 2.9[Formula: see text]mm resulted in a relative positioning error of 3% at a motion period of 60[Formula: see text]s. The instrument’s accuracy improves with decreasing speed. A fully automated capsulotomy is achieved on an ex vivo porcine lens capsule by continuously coagulating the tissue under controlled conditions. Conclusions: Robot assisted capsulotomy can be performed with excellent precision in ex vivo conditions.

Towards Robot-Assisted Retinal Vein Cannulation: A Motorized Force-Sensing Microneedle Integrated with a Handheld Micromanipulator †

Retinal vein cannulation is a technically demanding surgical procedure where therapeutic agents are injected into the retinal veins to treat occlusions. The clinical feasibility of this approach has been largely limited by the technical challenges associated with performing the procedure. Among the challenges to successful vein cannulation are identifying the moment of venous puncture, achieving cannulation of the micro-vessel, and maintaining cannulation throughout drug delivery. Recent advances in medical robotics and sensing of tool-tissue interaction forces have the potential to address each of these challenges as well as to prevent tissue trauma, minimize complications, diminish surgeon effort, and ultimately promote successful retinal vein cannulation. In this paper, we develop an assistive system combining a handheld micromanipulator, called "Micron", with a force-sensing microneedle. Using this system, we examine two distinct methods of precisely detecting the instant of venous puncture. This is based on measured tool-tissue interaction forces and also the tracked position of the needle tip. In addition to the existing tremor canceling function of Micron, a new control method is implemented to actively compensate unintended movements of the operator, and to keep the cannulation device securely inside the vein following cannulation. To demonstrate the capabilities and performance of our uniquely upgraded system, we present a multi-user artificial phantom study with subjects from three different surgical skill levels. Results show that our puncture detection algorithm, when combined with the active positive holding feature enables sustained cannulation which is most evident in smaller veins. Notable is that the active holding function significantly attenuates tool motion in the vein, thereby reduces the trauma during cannulation.

Cooperative robot assistant for vitreoretinal microsurgery: development of the RVRMS and feasibility studies in an animal model

PURPOSE

The purpose of the study was to describe the development of a robotic aided surgical system named RVRMS (robotic vitreous retinal microsurgery system) and to evaluate the capability for using it to perform vitreoretinal surgery.

METHODS

The RVRMS was designed and built to include the key components of two independent arms. End-effectors of each arm fix various surgical instruments and perform intraocular manipulation. To evaluate properly the RVRMS, robot-assisted 23-gauge surgical tasks including endolaser for retinal photocoagulation, pars plana vitrectomy (PPV), retinal foreign body removal and retinal vascular cannulation were performed in two different sizes of an animal model. Endolaser was performed in the eye of a living Irish rabbit and the other tasks were done in a harvested porcine eye. For each evaluation, the duration and the successful completion of the task was assessed.

RESULTS

Robot-assisted vitreoretinal operations were successfully performed in nine rabbit eyes and 25 porcine eyes without any iatrogenic complication such as retinal tear or retinal detachment. In the task of using an endolaser, three rows of burns around the induced retinal hole were performed in nine rabbit eyes with half size intervals of laser spots. Nine procine eyes underwent PPV followed by successful posterior vitreous detachment (PVD) induction assisted with triamcinolone acetonide (TA). Nine porcine eyes completed removal of a fine stainless steel wire, which was inserted into prepared retinal tissue. Finally, retinal vascular cannulation with a piece of stainless steel wire (6mm length, 45 μm pipe diameter and one end cut to ∼30° slope) was successfully achieved in seven porcine eyes. The average duration of each procedure was 10.91±1.22 min, 11.68±2.11min, 5.90±0.46 min and 13.5±6.2 min, respectively.

CONCLUSIONS

Maneuverability, accuracy and stability of robot-assisted vitreoretinal microsurgery using the RVRMS were demonstrated in this study. Wider application research of robotic surgery and improvement of a robotic system should be continued.