Novel imaging using a touchless display for computer-assisted hepato-biliary surgery

Advances in the development and application of non-contact intraoperative image access systems

This article provides an overview of recent progress in the achievement of non-contact intraoperative image control through the use of vision and sensor technologies in operating room (OR) environments. A discussion of approaches to improving and optimizing associated technologies is also provided, together with a survey of important challenges and directions for future development aimed at improving the use of non-contact intraoperative image access systems.

Development of an Eye-Tracking Image Manipulation System for Angiography: A Comparative Study

RATIONALE AND OBJECTIVES

Appropriate image manipulation of angiographic image display systems during interventional radiology is performed by radiological technologists and/or nurses given instructions from radiologists. However, appropriate images might not be displayed because of communication errors. Therefore, we developed a manipulation system that uses an eye tracker. The study aimed to determine if an angiographic image display system can be manipulated as well by using an eye tracker as by using a mouse.

MATERIALS AND METHODS

An angiographic image display system using an eye tracker to calculate the gaze position on the screen and state of fixation was developed. Fourteen radiological technologists participated in an observer study by manipulating 10 images for each of 5 typical cases frequently performed in angiography, such as renal tumor, cerebral aneurysm, liver tumor, uterine bleeding, and hypersplenism. We measured the time from the start to the end of manipulating a series of images required when using the eye tracker and the conventional mouse. In this study, the statistical processing was done using Excel and R and R studio.

RESULTS

The average time required for all observers for completing all cases was significantly shorter when using the eye tracker than when using the mouse (10.4 ± 2.1 s and 16.9 ± 2.6 s, respectively; p< 0.001 by paired t test).

CONCLUSION

Radiologists were able to manipulate an angiographic image display system directly by using the newly developed eye tracker system without touching contact devices, such as a mouse or angiography console. Therefore, communication error could be avoided.

Up-to-date intraoperative computer assisted solutions for liver surgery

Computer assisted surgical planning allowed for a better selection of patients, evaluation of operative strategy, appropriate volumetric measurements, identification of anatomical risks, definition of tumour resection margins and choice of surgical approach in liver oncologic resections and living donor liver transplantations. Although preoperative computer surgical analysis has been widely used in daily clinical practice, intraoperative computer assisted solutions for risk analysis and navigation in liver surgery are not widely available or still under clinical evaluation. Computer science technology can efficiently assist modern surgeons during complex liver operations, mainly by providing image guidance with individualized 2D images and 3D models of the various anatomical and pathological structures of interest. Intraoperative computer assisted liver surgery is particularly useful in complex parenchyma-sparing hepatectomies, for intraoperative risk analysis and for the effective treatment of colorectal metastases after neoadjuvant therapy or when they are multiple. In laparoscopic liver surgery, intraoperative computer aid is definitively more important as, apart from a restricted field of view, there is also loss of the fine haptic feedback. Intraoperative computer assisted developments face challenges that prevent their application in daily clinical practice. There is a vast variety of studies regarding intraoperative computer assisted liver surgery but there are no clear objective measurements in order to compare them and select the most effective solutions. An overview of up-to-date intraoperative computer assisted solutions for liver surgery will be discussed.