3D stereo interactive medical visualization

Comparative observer effects in 2D and 3D localization tasks

Purpose: Three-dimensional "volumetric" imaging methods are now a common component of medical imaging across many imaging modalities. Relatively little is known about how human observers localize targets masked by noise and clutter as they scroll through a 3D image and how it compares to a similar task confined to a single 2D slice. Approach: Gaussian random textures were used to represent noisy volumetric medical images. Subjects were able to freely inspect the images, including scrolling through 3D images as part of their search process. A total of eight experimental conditions were evaluated (2D versus 3D images, large versus small targets, power-law versus white noise). We analyze performance in these experiments using task efficiency and the classification image technique. Results: In 3D tasks, median response times were roughly nine times longer than 2D, with larger relative differences for incorrect trials. The efficiency data show a dissociation in which subjects perform with higher statistical efficiency in 2D tasks for large targets and higher efficiency in 3D tasks with small targets. The classification images suggest that a critical mechanism behind this dissociation is an inability to integrate across multiple slices to form a 3D localization response. The central slices of 3D classification images are remarkably similar to the corresponding 2D classification images. Conclusions: 2D and 3D tasks show similar weighting patterns between 2D images and the central slice of 3D images. There is relatively little weighting across slices in the 3D tasks, leading to lower task efficiency with respect to the ideal observer.

3D gaze tracking system for NVidia 3D Vision®

Inappropriate parallax setting in stereoscopic content generally causes visual fatigue and visual discomfort. To optimize three dimensional (3D) effects in stereoscopic content by taking into account health issue, understanding how user gazes at 3D direction in virtual space is currently an important research topic. In this paper, we report the study of developing a novel 3D gaze tracking system for Nvidia 3D Vision(®) to be used in desktop stereoscopic display. We suggest an optimized geometric method to accurately measure the position of virtual 3D object. Our experimental result shows that the proposed system achieved better accuracy compared to conventional geometric method by average errors 0.83 cm, 0.87 cm, and 1.06 cm in X, Y, and Z dimensions, respectively.

Vessel target location estimation during the TIPS procedure

Creation of a transjugular intrahepatic portosystemic shunt (TIPS) requires passage of a needle toward a moving target that is only seen transiently by X-ray prior to needle passage. Intraoperative, 3D target localization would facilitate target access and improve the safety of the procedure. The clinical assumption is that patients undergoing the TIPS procedure possess rigid, cirrhotic livers that undergo only intraoperative translation without significant deformation or rotation. Based upon this assumption, we hypothesize that the position of any unseen, 3D target point within the liver can be determined intraoperatively by precalculation of the relative positions of the target point to a different 3D point that can be tracked intraoperatively. This paper examines this hypothesis using intraoperatively acquired, biplane, X-ray images of seven patients. In six, we tracked the effects of cardiac and respiratory motion, and in three the effects of needle pressure. Methods involved reconstruction of 3D vessel bifurcation and other trackable intrahepatic points from biplane angiograms, measurement of liver deformation by examining changing distances between these 3D points over time, and comparison of expected to actual displacements of these points with respect to a fixed reference point in the liver. We conclude that, for the rigid livers associated with patients undergoing TIPS, that there is less intraoperative deformation than previously reported by other groups addressing healthy liver deformation, and that the location of an unseen target can be predicted within 3mm accuracy.