Active tremor cancellation by a "smart" handheld vitreoretinal microsurgical tool using swept source optical coherence tomography

Robotic Assistance for Peg-and-Hole Alignment by Mimicking Annular Solar Eclipse Process

This study focuses on robotic assistance for peg-and-hole alignment with micrometer-order clearance. The objective of the robotic assistance is to cooperate with a human operator based on a coarse-to-fine strategy in which the human operator conducts coarse alignment and the robotic assistance realizes fine alignment. Robotic-assisted fine alignment is achieved by mimicking the process toward annularity of an annular solar eclipse. The first principal axis of a specified image feature (we call it a eclipse feature) is calculated by subtracting the surfaces of a hole part (a small gear with an inner diameter of 1 mm) and a peg part (a shaft with a diameter of 0.95 mm). Accordingly, control strategy is developed to realize accurate alignment. Moreover, the effectiveness of the proposed method is verified by experimental evaluation.

ColibriDoc: An Eye-in-Hand Autonomous Trocar Docking System

Retinal surgery is a complex medical procedure that requires exceptional expertise and dexterity. For this purpose, several robotic platforms are currently under development to enable or improve the outcome of microsurgical tasks. Since the control of such robots is often designed for navigation inside the eye in proximity to the retina, successful trocar docking and insertion of the instrument into the eye represents an additional cognitive effort, and is therefore one of the open challenges in robotic retinal surgery. For this purpose, we present a platform for autonomous trocar docking that combines computer vision and a robotic setup. Inspired by the Cuban Colibri (hummingbird) aligning its beak to a flower using only vision, we mount a camera onto the endeffector of a robotic system. By estimating the position and pose of the trocar, the robot is able to autonomously align and navigate the instrument towards the Trocar Entry Point (TEP) and finally perform the insertion. Our experiments show that the proposed method is able to accurately estimate the position and pose of the trocar and achieve repeatable autonomous docking. The aim of this work is to reduce the complexity of the robotic setup prior to the surgical task and therefore, increase the intuitiveness of the system integration into clinical workflow.

Robotic Endoscope Control Via Autonomous Instrument Tracking

Many keyhole interventions rely on bi-manual handling of surgical instruments, forcing the main surgeon to rely on a second surgeon to act as a camera assistant. In addition to the burden of excessively involving surgical staff, this may lead to reduced image stability, increased task completion time and sometimes errors due to the monotony of the task. Robotic endoscope holders, controlled by a set of basic instructions, have been proposed as an alternative, but their unnatural handling may increase the cognitive load of the (solo) surgeon, which hinders their clinical acceptance. More seamless integration in the surgical workflow would be achieved if robotic endoscope holders collaborated with the operating surgeon via semantically rich instructions that closely resemble instructions that would otherwise be issued to a human camera assistant, such as “focus on my right-hand instrument.” As a proof of concept, this paper presents a novel system that paves the way towards a synergistic interaction between surgeons and robotic endoscope holders. The proposed platform allows the surgeon to perform a bimanual coordination and navigation task, while a robotic arm autonomously performs the endoscope positioning tasks. Within our system, we propose a novel tooltip localization method based on surgical tool segmentation and a novel visual servoing approach that ensures smooth and appropriate motion of the endoscope camera. We validate our vision pipeline and run a user study of this system. The clinical relevance of the study is ensured through the use of a laparoscopic exercise validated by the European Academy of Gynaecological Surgery which involves bi-manual coordination and navigation. Successful application of our proposed system provides a promising starting point towards broader clinical adoption of robotic endoscope holders.

The Surgeon's Role in Inducing and Controlling Motion Errors During Intraocular Membrane Peeling Procedures

Objectives:

To understand the surgeon’s role in inducing and correcting movement inaccuracies during intraocular membrane peeling procedures.

Materials and Methods:

Optical sensors were used to record movement errors during actuation at the distal tip of 23-gauge pneumatic forceps both when the handle was handheld and when fixed with no human contact. Movements were also recorded at the proximal part of the forceps shaft (near the sclerotomy site) and compared to movement recorded at the distal end. The root mean square (RMS) and range values of the signals obtained from the sensors were calculated before and after applying high (7-13 Hz) and low (<5 Hz) frequency filters.

Results:

Comparison of RMS and range values of movement errors at the distal end of the forceps during actuation when the forceps handle was fixed and handheld showed that without human contact, these values were significantly lower in the X axis at all frequencies and in the Z axis at high frequencies compared to handheld (p<0.05), while there were no significant differences in the Y axis. Comparison of values from the distal and proximal ends of the forceps showed that when the forceps were fixed, RMS and range values were significantly higher for movement errors at the distal end compared to the proximal end at all frequencies (p<0.05). There was significant positive correlation between the extent of actuation and the RMS and range values for high-frequency movement errors but not low-frequency errors in all three axes with the fixed pneumatic handle (r=0.21-0.51, p<0.05).

Conclusion:

Surgeon- and non-surgeon-related errors are apparent in all axes, but skilled surgeons correct these errors through visual feedback, resulting in better correction in the visible planes. Sclerotomy sites provide a pivoting and stabilizing point for the shaft of the forceps and it is likely that skilled surgeons make use of the sclerotomy point to dampen motion errors, a skill worth teaching to beginners.

Investigation of Micro-motion Kinematics of Continuum Robots for Volumetric OCT and OCT-guided Visual Servoing

Continuum robots (CR) have been recently shown capable of micron-scale motion resolutions. Such motions are achieved through equilibrium modulation using indirect actuation for altering either internal preload forces or changing the cross-sectional stiffness along the length of a continuum robot. Previously reported, but unexplained, turning point behavior is modeled using two approaches. An energy minimization approach is first used to explain the source of this behavior. Subsequently, a kinematic model using internal constraints in multi-backbone CRs is used to replicate this turning point behavior. An approach for modeling the micro-motion differential kinematics is presented using experimental data based on the solution of a system of linear matrix equations. This approach provides a closed-form approximation of the empirical micro-motion kinematics and could be easily used for real-time control. A motivating application of image-based biopsy using 3D optical coherence tomography (OCT) is envisioned and demonstrated in this paper. A system integration for generating OCT volumes by sweeping a custom B-mode OCT probe is presented. Results showing high accuracy in obtaining 3D OCT measurements are shown using a commercial OCT probe. Qualitative results using a miniature probe integrated within the robot are also shown. Finally, closed-loop visual servoing using OCT data is demonstrated for guiding a needle into an agar channel. Results of this paper present what we believe is the first embodiment of a continuum robot capable of micro and macro motion control for 3D OCT imaging. This approach can support the development of new technologies for CRs capable of surgical intervention and micro-motion for ultra-precision tasks.

Force and Velocity Based Puncture Detection in Robot Assisted Retinal Vein Cannulation: in-vivo Study

OBJECTIVE

Retinal vein cannulation is a technically demanding surgical procedure and its feasibility may rely on using advanced surgical robots equipped with force-sensing microneedles. Reliable detection of the moment of venous puncture is important, to either alert or prevent the clinician from double puncturing the vessel and damaging the retinal surface beneath. This paper reports the first in-vivo retinal vein cannulation trial on rabbit eyes, using sensorized metal needles, and investigates puncture detection.

METHODS

We utilized total of four indices including two previously demonstrated ones and two new indices, based on the velocity and force of the needle tip and the correlation between the needle-tissue and tool-sclera interaction forces. We also studied the effect of detection timespan on the performance of detecting actual punctures.

RESULTS

The new indices, when used in conjunction with the previous algorithm, improved the detection rate form 75% to 92%, but slightly increased the number of false detections from 37 to 43. Increasing the detection window improved the detection performance, at the cost of adding to the delay.

CONCLUSION

The current algorithm can supplement the surgeons visual feedback and surgical judgment. To achieve automatic puncture detection, more measurements and further analysis are required. Subsequent in-vivo studies in other animals, such as pigs with their more human like eye anatomy, are required, before clinical trials.

SIGNIFICANCE

The study provides promising results and the criteria developed may serve as guidelines for further investigation into puncture detection in in-vivo retinal vein cannulation.

Minimizing OCT quantification error via a surface-tracking imaging probe

OCT-based quantitative tissue optical properties imaging is a promising technique for intraoperative brain cancer assessment. The attenuation coefficient analysis relies on the depth-dependent OCT intensity profile, thus sensitive to tissue surface positions relative to the imaging beam focus. However, it is almost impossible to maintain a steady tissue surface during intraoperative imaging due to the patient's arterial pulsation and breathing, the operator's motion, and the complex tissue surface geometry of the surgical cavity. In this work, we developed an intraoperative OCT imaging probe with a surface-tracking function to minimize the quantification errors in optical attenuation due to the tissue surface position variations. A compact OCT imaging probe was designed and engineered to have a long working distance of ∼ 41 mm and a large field of view of 4 × 4 mm² while keeping the probe diameter small (9 mm) to maximize clinical versatility. A piezo-based linear motor was integrated with the imaging probe and controlled based upon real-time feedback of tissue surface position inferred from OCT images. A GPU-assisted parallel processing algorithm was implemented, enabling detection and tracking of tissue surface in real-time and successfully suppressing more than 90% of the typical physiologically induced motion range. The surface-tracking intraoperative OCT imaging probe could maintain a steady beam focus inside the target tissue regardless of the surface geometry or physiological motions and enabled to obtain tissue optical attenuation reliably for assessing brain cancer margins in challenging intraoperative settings.

A Review of Robotic and OCT-Aided Systems for Vitreoretinal Surgery

The introduction of the intraocular vitrectomy instrument by Machemer et al. has led to remarkable advancements in vitreoretinal surgery enabling the limitations of human physiologic capabilities to be reached. To overcome the barriers of perception, tremor, and dexterity, robotic technologies have been investigated with current advancements nearing the feasibility for clinical use. There are four categories of robotic systems that have emerged through the research: (1) handheld instruments with intrinsic robotic assistance, (2) hand-on-hand robotic systems, (3) teleoperated robotic systems, and (4) magnetic guidance robots. This review covers the improvements and the remaining needs for safe, cost-effective clinical deployment of robotic systems in vitreoretinal surgery.

Real-time tool to layer distance estimation for robotic subretinal injection using intraoperative 4D OCT

The emergence of robotics could enable ophthalmic microsurgical procedures that were previously not feasible due to the precision limits of manual delivery, for example, targeted subretinal injection. Determining the distance between the needle tip, the internal limiting membrane (ILM), and the retinal pigment epithelium (RPE) both precisely and reproducibly is required for safe and successful robotic retinal interventions. Recent advances in intraoperative optical coherence tomography (iOCT) have opened the path for 4D image-guided surgery by providing near video-rate imaging with micron-level resolution to visualize retinal structures, surgical instruments, and tool-tissue interactions. In this work, we present a novel pipeline to precisely estimate the distance between the injection needle and the surface boundaries of two retinal layers, the ILM and the RPE, from iOCT volumes. To achieve high computational efficiency, we reduce the analysis to the relevant area around the needle tip. We employ a convolutional neural network (CNN) to segment the tool surface, as well as the retinal layer boundaries from selected iOCT B-scans within this tip area. This results in the generation and processing of 3D surface point clouds for the tool, ILM and RPE from the B-scan segmentation maps, which in turn allows the estimation of the minimum distance between the resulting tool and layer point clouds. The proposed method is evaluated on iOCT volumes from ex-vivo porcine eyes and achieves an average error of 9.24 µm and 8.61 µm measuring the distance from the needle tip to the ILM and the RPE, respectively. The results demonstrate that this approach is robust to the high levels of noise present in iOCT B-scans and is suitable for the interventional use case by providing distance feedback at an average update rate of 15.66 Hz.

Oblique injection depth correction by a two parallel OCT sensor guided handheld SMART injector

We present a SMART injector with two parallel common-path optical coherence tomography fibers to enable angle measurements and injection depth corrections for oblique subretinal injection. The two optical fibers are attached to opposite sides of a 33 G needle with known offsets and designed to pass through a 23 G trocar that has an inner diameter of 0.65 mm. By attaching a SMART system to a rotational stage, the measured angles are calibrated for minimal error from reference angles. A commercial eye model was used to evaluate the control performance, and injection experiments were performed on a phantom made of agarose gel and a porcine eye.

Optical Coherence Tomography-Guided Robotic Ophthalmic Microsurgery via Reinforcement Learning from Demonstration

Ophthalmic microsurgery is technically difficult because the scale of required surgical tool manipulations challenge the limits of the surgeon's visual acuity, sensory perception, and physical dexterity. Intraoperative optical coherence tomography (OCT) imaging with micrometer-scale resolution is increasingly being used to monitor and provide enhanced real-time visualization of ophthalmic surgical maneuvers, but surgeons still face physical limitations when manipulating instruments inside the eye. Autonomously controlled robots are one avenue for overcoming these physical limitations. We demonstrate the feasibility of using learning from demonstration and reinforcement learning with an industrial robot to perform OCT-guided corneal needle insertions in an ex vivo model of deep anterior lamellar keratoplasty (DALK) surgery. Our reinforcement learning agent trained on ex vivo human corneas, then outperformed surgical fellows in reaching a target needle insertion depth in mock corneal surgery trials. This work shows the combination of learning from demonstration and reinforcement learning is a viable option for performing OCT guided robotic ophthalmic surgery.

Hand-Held Instrument with Integrated Parallel Mechanism for Active Tremor Compensation During Microsurgery

Physiological hand tremor seriously influences the surgical instrument's tip positioning accuracy during microsurgery. To solve this problem, hand-held active tremor compensation instruments are developed to improve tip positioning accuracy during microsurgery. This paper presents the design and performance of a new hand-held instrument that aims to stabilize hand tremors and increase accuracy in microsurgery. The key components are a three degrees of freedom (DOF) integrated parallel manipulator and a high-performance inertial measurement unit (IMU). The IMU was developed to sense the 3-DOF motion of the instrument tip. A customized filter was applied to extract specific hand tremor motion. Then, the instrument was employed to generate the reverse motion simultaneously to reduce tremor motion. Experimental results show that the tremor compensation mechanism is effective. The average RMS reduction ratio of bench test is 56.5% that is a significant tremor reduction ratio. For hand-held test, it has an average RMS reduction ratio of 41.0%. Hence, it could reduce hand tremor magnitudes by 31.7% RMS in 2-DOF.

Unintentional Movements During the Use of Vitreoretinal Forceps

Purpose

Intraocular forceps used in vitreoretinal surgery are actuated by squeezing their handles. We studied the relationship between actuation and any accompanying unintentional movements of the instrument tip, and compared different handle designs and gauges.

Methods

Optical sensors were used to measure involuntary movements of forceps tips while monitoring the extent of actuation. Mean root mean square (RMS) and ranges of signals obtained from sensors were computed before and after applying high (7–13 Hz) and low (<5 Hz) frequency filters. Four handle designs, two gauge sizes, and two users were compared to each other.

Results

In the absence of human contact, mean RMS of noise was 6.47 μ and mean range was 21.67 μ. When the forceps were held by the surgeon but kept motionless (no actuation), mean RMS was 58.01 μ and mean range was 156.66 μ. When the forceps were actuated, mean RMS was 214.71 μ and mean range was 566.11 μ. The differences were statistically significant (P < 0.001). The process of actuation by both users was positively correlated with unintentional movements mainly at low frequencies. No statistically significant differences were found between users and between two gauges (23 and 27) at mixed and low frequencies. Pneumatic handles showed less RMS and range values at higher frequencies compared to conventional handle designs. Eliminating human error by fixing pneumatic forceps to the model did not reduce unintentional movements, but eliminated their correlation with actuation.

Conclusions

Actuating forceps was associated directly with increased unintentional low frequency movements at the tip of the forceps when held by hand.

Translational Relevance

A novel system of measuring unintentional forceps tip movement during actuation is described which could be used to guide improved design.

Robot-assisted tremor control for performance enhancement of retinal microsurgeons

Pars plana vitrectomy is a challenging, minimally invasive microsurgical procedure due to its intrinsic manoeuvres and physiological limits that constrain human capability. An important human limitation is physiological hand tremor, which can significantly increase the risk of iatrogenic retinal damage resulting from unintentional manoeuvres that affect anatomical and functional surgical outcomes. The limitations imposed by normal physiological tremor are more evident and challenging during ‘micron-scale’ manoeuvres such as epiretinal membrane and internal limiting membrane peeling, and delicate procedures requiring coordinated bimanual surgery such as tractional retinal detachment repair. Therefore, over the previous three decades, attention has turned to robot-assisted surgical devices to overcome these challenges. Several systems have been developed to improve microsurgical accuracy by cancelling hand tremor and facilitating faster, safer and more effective microsurgeries. By markedly reducing tremor, microsurgical precision is improved to a level beyond present human capabilities. In conclusion, robotics offers potential advantages over free-hand microsurgery as it is currently performed during ophthalmic surgery and opens the door to a new class of revolutionary microsurgical modalities. The skills transfer that is beyond human capabilities to robotic technology is a logical next step in microsurgical evolution.

Demonstration of Subretinal Injection Using Common-Path Swept Source OCT Guided Microinjector

In this paper, we present the development of a handheld common-path swept source optical coherence tomography (CP-SSOCT) guided microinjector system and demonstrated its utility by precisely injecting fluorescein dye in the subretinal layer of ex vivo bovine eyes. The system enables precise subretinal injection with micron-level injection depth control. This was achieved by using a high-resolution CP-SSOCT distal sensor and signal processing using a graphics-processing unit (GPU), which made a real-time smart motion control algorithm possible. The microinjector performance was first evaluated using a gelatin phantom in terms of its ability for dynamic depth targeting and injection depth. This is followed by using an ex vivo bovine eye model to perform multiple consecutive subretinal injections of fluorescein dye. The results validated the OCT guided injector’s ability to precisely guide and lock in the needle tip to the target depth during injection. The ex vivo evaluation tests demonstrate that an OCT-guided injector can consistently guide the injecting needle to the desired depth and is able to maintain the position with 9.38 μm average root mean square error during the injections.

Combined OCT distance and FBG force sensing cannulation needle for retinal vein cannulation: in vivo animal validation

PURPOSE

Retinal vein cannulation is an experimental procedure during which a clot-dissolving drug is injected into an obstructed retinal vein. However, due to the fragility and minute size of retinal veins, such procedure is considered too risky to perform manually. With the aid of surgical robots, key limiting factors such as: unwanted eye rotations, hand tremor and instrument immobilization can be tackled. However, local instrument anatomy distance and force estimation remain unresolved issues. A reliable, real-time local interaction estimation between instrument tip and the retina could be a solution. This paper reports on the development of a combined force and distance sensing cannulation needle, and its experimental validation during in vivo animal trials.

METHODS

Two prototypes are reported, relying on force and distance measurements based on FBG and OCT A-scan fibres, respectively. Both instruments provide an 80 [Formula: see text] needle tip and have outer shaft diameters of 0.6 and 2.3 mm, respectively.

RESULTS

Both prototypes were characterized and experimentally validated ex vivo. Then, paired with a previously developed surgical robot, in vivo experimental validation was performed. The first prototype successfully demonstrated the feasibility of using a combined force and distance sensing instrument in an in vivo setting.

CONCLUSION

The results demonstrate the feasibility of deploying a combined sensing instrument in an in vivo setting. The performed study provides a foundation for further work on real-time local modelling of the surgical scene. This paper provides initial insights; however, additional processing remains necessary.

Robot-assisted vitreoretinal surgery: current perspectives

Vitreoretinal microsurgery is among the most technically challenging of the minimally invasive surgical techniques. Exceptional precision is required to operate on micron scale targets presented by the retina while also maneuvering in a tightly constrained and fragile workspace. These challenges are compounded by inherent limitations of the unassisted human hand with regard to dexterity, tremor and precision in positioning instruments. The limited human ability to visually resolve targets on the single-digit micron scale is a further limitation. The inherent attributes of robotic approaches therefore, provide logical, strategic and promising solutions to the numerous challenges associated with retinal microsurgery. Robotic retinal surgery is a rapidly emerging technology that has witnessed an exponential growth in capabilities and applications over the last decade. There is now a worldwide movement toward evaluating robotic systems in an expanding number of clinical applications. Coincident with this expanding application is growth in the number of laboratories committed to "robotic medicine". Recent technological advances in conventional retina surgery have also led to tremendous progress in the surgeon's capabilities, enhanced outcomes, a reduction of patient discomfort, limited hospitalization and improved safety. The emergence of robotic technology into this rapidly advancing domain is expected to further enhance important aspects of the retinal surgery experience for the patients, surgeons and society.

Optical coherence tomography for precision brain imaging, neurosurgical guidance and minimally invasive theranostics

This review focuses on optical coherence tomography (OCT)-based neurosurgical application for imaging and treatment of brain tumors. OCT has emerged as one of the most innovative and successful translational biomedical-diagnostic techniques. It is a useful imaging tool for noninvasive, in vivo, in situ and real-time imaging in soft biological tissues, such as brain tumor imaging. OCT can detect the structure of biological tissue in a micrometer scale, and functional OCT has some clinical researches and applications, such as nerve fiber tracts and neurovascular imaging. OCT is able to identify tumor margins, and it gives intraoperative precision identification and resection guidance. OCT-based theranostics is introduced into preclinical neurosurgical resection, such as the integration of OCT and laser ablation. We discuss the challenges and opportunities of OCT-based system in the field of combination of intraoperative structural and functional imaging, neurosurgical guidance and minimally invasive theranostics. We point out that OCT and laser ablation-based theranostics can give more precision and intelligence for intraoperative diagnosis and therapeutics in clinical applications. The theranostics can precisely locate, or specifically target cancerous tissues, and then as much as possiblly eliminate them.

Robotic Vitreoretinal Surgery

PURPOSE

To review the current literature on robotic assistance for ophthalmic surgery, especially vitreoretinal procedures.

METHODS

MEDLINE, Embase, and Web of Science databases were searched from inception to August, 2016, for articles relevant to the review topic. Queries included combinations of the terms: robotic eye surgery, ophthalmology, and vitreoretinal.

RESULTS

In ophthalmology, proof-of-concept papers have shown the feasibility of performing many delicate anterior segment and vitreoretinal surgical procedures accurately with robotic assistance. Multiple surgical platforms have been designed and tested in animal eyes and phantom models. These platforms have the capability to measure forces generated and velocities of different surgical movements. "Smart" instruments have been designed to improve certain tasks such as membrane peeling and retinal vessel cannulations.

CONCLUSION

Ophthalmic surgery, particularly vitreoretinal surgery, might have reached the limits of human physiologic performance. Robotic assistance can help overcome biologic limitations and improve our surgical performance. Clinical studies of robotic-assisted surgeries are needed to determine safety and feasibility of using this technology in patients.

Lamellar keratoplasty using position-guided surgical needle and M-mode optical coherence tomography

Deep anterior lamellar keratoplasty (DALK) is an emerging surgical technique for the restoration of corneal clarity and vision acuity. The big-bubble technique in DALK surgery is the most essential procedure that includes the air injection through a thin syringe needle to separate the dysfunctional region of the cornea. Even though DALK is a well-known transplant method, it is still challenged to manipulate the needle inside the cornea under the surgical microscope, which varies its surgical yield. Here, we introduce the DALK protocol based on the position-guided needle and M-mode optical coherence tomography (OCT). Depth-resolved 26-gage needle was specially designed, fabricated by the stepwise transitional core fiber, and integrated with the swept source OCT system. Since our device is feasible to provide both the position information inside the cornea as well as air injection, it enables the accurate management of bubble formation during DALK. Our results show that real-time feedback of needle end position was intuitionally visualized and fast enough to adjust the location of the needle. Through our research, we realized that position-guided needle combined with M-mode OCT is a very efficient and promising surgical tool, which also to enhance the accuracy and stability of DALK.

Clinical translation of handheld optical coherence tomography: practical considerations and recent advancements

Since the inception of optical coherence tomography (OCT), advancements in imaging system design and handheld probes have allowed for numerous advancements in disease diagnostics and characterization of the structural and optical properties of tissue. OCT system developers continue to reduce form factor and cost, while improving imaging performance (speed, resolution, etc.) and flexibility for applicability in a broad range of fields, and nearly every clinical specialty. An extensive array of components to construct customized systems has also become available, with a range of commercial entities that produce high-quality products, from single components to full systems, for clinical and research use. Many advancements in the development of these miniaturized and portable systems can be linked back to a specific challenge in academic research, or a clinical need in medicine or surgery. Handheld OCT systems are discussed and explored for various applications. Handheld systems are discussed in terms of their relative level of portability and form factor, with mention of the supporting technologies and surrounding ecosystem that bolstered their development. Additional insight from our efforts to implement systems in several clinical environments is provided. The trend toward well-designed, efficient, and compact handheld systems paves the way for more widespread adoption of OCT into point-of-care or point-of-procedure applications in both clinical and commercial settings.

Motorized Micro-Forceps with Active Motion Guidance based on Common-Path SSOCT for Epiretinal Membranectomy

In this study, we built and tested a handheld motion-guided micro-forceps system using common-path swept source optical coherence tomography (CP-SSOCT) for highly accurate depth controlled epiretinal membranectomy. A touch sensor and two motors were used in the forceps design to minimize the inherent motion artifact while squeezing the tool handle to actuate the tool and grasp, and to independently control the depth of the tool-tip. A smart motion monitoring and a guiding algorithm were devised to provide precise and intuitive freehand control. We compared the involuntary tool-tip motion occurring while grasping with a standard manual micro-forceps and our touch sensor activated micro-forceps. The results showed that our touch-sensor-based and motor-actuated tool can significantly attenuate the motion artifact during grasping (119.81 μm with our device versus 330.73 μm with the standard micro-forceps). By activating the CP-SSOCT based depth locking feature, the erroneous tool-tip motion can be further reduced down to 5.11μm. We evaluated the performance of our device in comparison to the standard instrument in terms of the elapsed time, the number of grasping attempts, and the maximum depth of damage created on the substrate surface while trying to pick up small pieces of fibers (Ø 125 μm) from a soft polymer surface. The results indicate that all metrics were significantly improved when using our device; of note, the average elapsed time, the number of grasping attempts, and the maximum depth of damage were reduced by 25%, 31%, and 75%, respectively.

Review of intraoperative optical coherence tomography: technology and applications [Invited]

During microsurgery, en face imaging of the surgical field through the operating microscope limits the surgeon's depth perception and visualization of instruments and sub-surface anatomy. Surgical procedures outside microsurgery, such as breast tumor resections, may also benefit from visualization of the sub-surface tissue structures. The widespread clinical adoption of optical coherence tomography (OCT) in ophthalmology and its growing prominence in other fields, such as cancer imaging, has motivated the development of intraoperative OCT for real-time tomographic visualization of surgical interventions. This article reviews key technological developments in intraoperative OCT and their applications in human surgery. We focus on handheld OCT probes, microscope-integrated OCT systems, and OCT-guided laser treatment platforms designed for intraoperative use. Moreover, we discuss intraoperative OCT adjuncts and processing techniques currently under development to optimize the surgical feedback derivable from OCT data. Lastly, we survey salient clinical studies of intraoperative OCT for human surgery.

Development and preliminary results of bimanual smart micro-surgical system using a ball-lens coupled OCT distance sensor

Bimanual surgery enhances surgical effectiveness and is required to successfully accomplish complex microsurgical tasks. The essential advantage is the ability to simultaneously grasp tissue with one hand to provide counter traction or exposure, while dissecting with the other. Towards enhancing the precision and safety of bimanual microsurgery we present a bimanual SMART micro-surgical system for a preliminary ex-vivo study. To the best of our knowledge, this is the first demonstration of a handheld bimanual microsurgical system. The essential components include a ball-lens coupled common-path swept source optical coherence tomography sensor. This system effectively suppresses asynchronous hand tremor using two PZT motors in feedback control loop and efficiently assists ambidextrous tasks. It allows precise bimanual dissection of biological tissues with a reduction in operating time as compared to the same tasks performed with conventional one-handed approaches.

Development of the dual SMART micro-surgical system using common-path swept source optical coherence tomography

Manual micro-surgical tasks are fundamentally divided into grasping, cutting and injecting maneuvers performed on biological tissues. Efficient dissection of fibrous tissue from the surface of the retina often requires grasping and cutting maneuvers carried out simultaneously. True bimanual surgery requires that the surgeon contend with the innate hand tremor of two hands at once as well as unpredicted patient's movement. In this study, we develop and test a dual SMART micro-surgical system to suppress bimanual hand tremor during micro-surgical dissection.

Dual optical coherence tomography sensor guided, two-motor, horizontal SMART micro-scissors

In microsurgery, the physiological hand tremor of the surgeon remains an important factor affecting procedure efficiency, risk of complications, and ultimately, the efficacy of treatment. The micro-scissors are routinely employed to perform precise sharp dissection of delicate tissues. Here, we present a dual optical coherence tomography (OCT) distance sensor guided, two-motor, horizontal smart micromanipulation aided robotic-surgery tool (SMART) micro-scissors. It is intended to improve surgeon performance by retaining all of the attributes of the horizontal scissors while implementing proof-of-concept use of two functional motors to provide tremor cancellation.

A Compact Telemanipulated Retinal-Surgery System that Uses Commercially Available Instruments with a Quick-Change Adapter

We present a telemanipulation system for retinal surgery that uses a full range of unmodified commercially available instruments. The system is compact and light enough that it could reasonably be made head-mounted to passively compensate for head movements. Two mechanisms are presented that enable the system to use commercial actuated instruments, and an instrument adapter enables quick-change of instruments during surgery. A custom stylus for a haptic interface enables intuitive and ergonomic telemanipulation of actuated instruments. Experimental results with a force-sensitive phantom eye show that telemanipulated surgery results in reduced forces on the retina compared to manual surgery, and training with the system results in improved performance.

Improvement of optical coherence tomography using active handheld micromanipulator in vitreoretinal surgery

An active handheld micromanipulator has been developed to cancel hand tremor during microsurgery. The micromanipulator is also applicable in optical coherence tomography to improve the quality of scanning and minimize surgical risks during the scans. The manipulator can maneuver the tool tip with six degrees of freedom within a cylindrical workspace 4 mm in diameter and 4 mm high. The imaging system is equipped with a 25-gauge Fourier-domain common-path OCT probe. This paper introduces the handheld OCT imaging system and techniques involved and presents stabilized OCT images of A-mode and M-mode scans in air and live rabbit eyes. We show the first demonstration of OCT imaging using the active handheld micromanipulator in vivo.

Automated working distance adjustment enables optical coherence tomography of the human larynx in awake patients

Optical coherence tomography (OCT) provides structural information of laryngeal tissue which is comparable to histopathological analysis of biopsies taken under general anesthesia. In awake patients, movements impede clinically useful OCT acquisition. Therefore, an automatic compensation of movements was implemented into a swept source OCT-laryngoscope. Video and OCT beam path were combined in one tube of 10-mm diameter. Segmented OCT images served as distance sensor and a feedback control adjusted the working distance between 33 and 70 mm by synchronously translating the reference mirror and focusing lens. With this motion compensation, the tissue was properly visible in up to 88% of the acquisition time. During quiet respiration, OCT contrasted epithelium and lamina propria. Mean epithelial thickness was measured to be 109 and [Formula: see text] in female and male, respectively. Furthermore, OCT of mucosal wave movements during phonation enabled estimation of the oscillation frequency and amplitude. Regarding clinical issues, the OCT-laryngoscope with automated working distance adjustment may support the estimation of the depth extent of epithelial lesions and contribute to establish an indication for a biopsy. Moreover, OCT of the vibrating vocal folds provides functional information, possibly giving further insight into mucosal behavior during the vibratory cycle.

Accurate real-time depth control for CP-SSOCT distal sensor based handheld microsurgery tools

This paper presents a novel intuitive targeting and tracking scheme that utilizes a common-path swept source optical coherence tomography (CP-SSOCT) distal sensor integrated handheld microsurgical tool. To achieve micron-order precision control, a reliable and accurate OCT distal sensing method is required; simultaneously, a prediction algorithm is necessary to compensate for the system delay associated with the computational, mechanical and electronic latencies. Due to the multi-layered structure of retina, it is necessary to develop effective surface detection methods rather than simple peak detection. To achieve this, a shifted cross-correlation method is applied for surface detection in order to increase robustness and accuracy in distal sensing. A predictor based on Kalman filter was implemented for more precise motion compensation. The performance was first evaluated using an established dry phantom consisting of stacked cellophane tape. This was followed by evaluation in an ex-vivo bovine retina model to assess system accuracy and precision. The results demonstrate highly accurate depth targeting with less than 5 μm RMSE depth locking.

Injection-depth-locking axial motion guided handheld micro-injector using CP-SSOCT

This paper presents a handheld micro-injector system using common-path swept source optical coherence tomography (CP-SSOCT) as a distal sensor with highly accurate injection-depth-locking. To achieve real-time, highly precise, and intuitive freehand control, the system used graphics processing unit (GPU) to process the oversampled OCT signal with high throughput and a smart customized motion monitoring control algorithm. A performance evaluation was conducted with 60-insertions and fluorescein dye injection tests to show how accurately the system can guide the needle and lock to the target depth. The evaluation tests show our system can guide the injection needle into the desired depth with 4.12 um average deviation error while injecting 50 nl of fluorescein dye.

Development of real-time dual-display handheld and bench-top hybrid-mode SD-OCTs

Development of a dual-display handheld optical coherence tomography (OCT) system for retina and optic-nerve-head diagnosis beyond the volunteer motion constraints is reported. The developed system is portable and easily movable, containing the compact portable OCT system that includes the handheld probe and computer. Eye posterior chambers were diagnosed using the handheld probe, and the probe could be fixed to the bench-top cradle depending on the volunteers' physical condition. The images obtained using this handheld probe were displayed in real time on the computer monitor and on a small secondary built-in monitor; the displayed images were saved using the handheld probe's built-in button. Large-scale signal-processing procedures such as k-domain linearization, fast Fourier transform (FFT), and log-scaling signal processing can be rapidly applied using graphics-processing-unit (GPU) accelerated processing rather than central-processing-unit (CPU) processing. The Labview-based system resolution is 1,024 × 512 pixels, and the frame rate is 56 frames/s, useful for real-time display. The 3D images of the posterior chambers including the retina, optic-nerve head, blood vessels, and optic nerve were composed using real-time displayed images with 500 × 500 × 500 pixel resolution. A handheld and bench-top hybrid mode with a dual-display handheld OCT was developed to overcome the drawbacks of the conventional method.

Fiber-optic OCT sensor guided "SMART" micro-forceps for microsurgery

A handheld Smart Micromanipulation Aided Robotic-surgery Tool (SMART) micro-forceps guided by a fiber-optic common-path optical coherence tomography (CP-OCT) sensor is presented. A fiber-optic CP-OCT distance and motion sensor is integrated into the shaft of a micro-forceps. The tool tip position is manipulated longitudinally through a closed loop control using a piezoelectric motor. This novel forceps design could significantly enhance safety, efficiency and surgical outcomes. The basic grasping and peeling functions of the micro-forceps are evaluated in dry phantoms and in a biological tissue model. As compared to freehand use, targeted grasping and peeling performance assisted by active tremor compensation, significantly improves micro-forceps user performance.

Fiber-optic OCT sensor guided "SMART" micro-forceps for microsurgery

A handheld Smart Micromanipulation Aided Robotic-surgery Tool (SMART) micro-forceps guided by a fiber-optic common-path optical coherence tomography (CP-OCT) sensor is presented. A fiber-optic CP-OCT distance and motion sensor is integrated into the shaft of a micro-forceps. The tool tip position is manipulated longitudinally through a closed loop control using a piezoelectric motor. This novel forceps design could significantly enhance safety, efficiency and surgical outcomes. The basic grasping and peeling functions of the micro-forceps are evaluated in dry phantoms and in a biological tissue model. As compared to freehand use, targeted grasping and peeling performance assisted by active tremor compensation, significantly improves micro-forceps user performance.

Motion-compensated hand-held common-path Fourier-domain optical coherence tomography probe for image-guided intervention

A motion-compensated, hand-held, common-path, Fourier-domain optical coherence tomography imaging probe has been developed for image-guided intervention during microsurgery. A hand-held prototype instrument was achieved by integrating an imaging fiber probe inside a stainless steel needle and attached to the ceramic shaft of a piezoelectric motor housed in an aluminum handle. The fiber probe obtains A-scan images. The distance information was extracted from the A-scans to track the sample surface distance and a fixed distance was maintained by a feedback motor control which effectively compensated hand tremor and target movements in the axial direction. Real-time data acquisition, processing, motion compensation, and image visualization and saving were implemented on a custom CPU-GPU hybrid architecture. We performed 10× zero padding to the raw spectrum to obtain 0.16 µm position accuracy with a compensation rate of 460 Hz. The root-mean-square error of hand-held distance variation from target position was measured to be 2.93 µm. We used a cross-correlation maximization-based shift correction algorithm for topology correction. To validate the system, we performed free-hand OCT M-scan imaging using various samples.