Lumbar spine segmentation using a statistical multi-vertebrae anatomical shape+pose model

Ultrasound-Guided Spine Anesthesia: Feasibility Study of a Guidance System

Spinal needle injections are guided by fluoroscopy or palpation, resulting in radiation exposure and/or multiple needle re-insertions. Consequently, guiding these procedures with live ultrasound has become more popular, but images are still challenging to interpret. We introduce a guidance system based on augmentation of ultrasound images with a patient-specific 3-D surface model of the lumbar spine. We assessed the feasibility of the system in a study on 12 patients. The system could accurately provide augmentations of the epidural space and the facet joint for all subjects. Following conventional, fluoroscopy-guided needle placement, augmentation accuracy was determined according to the electromagnetically tracked final position of the needle. In 9 of 12 cases, the accuracy was considered sufficient for successfully delivering anesthesia. The unsuccessful cases can be attributed to errors in the electromagnetic tracking reference, which can be avoided by a setup reducing the influence of the metal C-arm.

Automatic Segmentation of Wrist Bones in CT Using a Statistical Wrist Shape + Pose Model

Segmentation of the wrist bones in CT images has been frequently used in different clinical applications including arthritis evaluation, bone age assessment and image-guided interventions. The major challenges include non-uniformity and spongy textures of the bone tissue as well as narrow inter-bone spaces. In this work, we propose an automatic wrist bone segmentation technique for CT images based on a statistical model that captures the shape and pose variations of the wrist joint across 60 example wrists at nine different wrist positions. To establish the correspondences across the training shapes at neutral positions, the wrist bone surfaces are jointly aligned using a group-wise registration framework based on a Gaussian Mixture Model. Principal component analysis is then used to determine the major modes of shape variations. The variations in poses not only across the population but also across different wrist positions are incorporated in two pose models. An intra-subject pose model is developed by utilizing the similarity transforms at all wrist positions across the population. Further, an inter-subject pose model is used to model the pose variations across different wrist positions. For segmentation of the wrist bones in CT images, the developed model is registered to the edge point cloud extracted from the CT volume through an expectation maximization based probabilistic approach. Residual registration errors are corrected by application of a non-rigid registration technique. We validate the proposed segmentation method by registering the wrist model to a total of 66 unseen CT volumes of average voxel size of 0.38 mm. We report a mean surface distance error of 0.33 mm and a mean Jaccard index of 0.86.

Vertebra segmentation based on two-step refinement

Knowledge of vertebra location, shape, and orientation is crucial in many medical applications such as orthopedics or interventional procedures. Computed tomography (CT) offers a high contrast between bone and soft tissues, but automatic vertebra segmentation remains difficult. Hence, the wide range of shapes, aging, and degenerative joint disease alterations as well as the variety of pathological cases encountered in an aging population make automatic segmentation sometimes challenging. Besides, daily practice implies a need for affordable computation time.

This paper aims to present a new automated vertebra segmentation method (using a first bounding box for initialization) for CT 3D data which tackles these problems. This method is based on two consecutive steps. The first one is a new coarse-to-fine method efficiently reducing the data amount to obtain a coarse shape of the vertebra. The second step consists in a hidden Markov chain (HMC) segmentation using a specific volume transformation within a Bayesian framework. Our method does not introduce any prior on the expected shape of the vertebra within the bounding box and thus deals with the most frequent pathological cases encountered in daily practice.

We experiment this method on a set of standard lumbar, thoracic, and cervical vertebrae and on a public dataset, on pathological cases, and in a simple integration example. Quantitative and qualitative results show that our method is robust to changes in shapes and luminance and provides correct segmentation with respect to pathological cases.

Automatic Lumbar Spondylolisthesis Measurement in CT Images

Lumbar spondylolisthesis is one of the most common spinal diseases. It is caused by the anterior shift of a lumbar vertebrae relative to subjacent vertebrae. In current clinical practices, staging of spondylolisthesis is often conducted in a qualitative way. Although meyerding grading opens the door to stage spondylolisthesis in a more quantitative way, it relies on the manual measurement, which is time consuming and irreproducible. Thus, an automatic measurement algorithm becomes desirable for spondylolisthesis diagnosis and staging. However, there are two challenges. 1) Accurate detection of the most anterior and posterior points on the superior and inferior surfaces of each lumbar vertebrae. Due to the small size of the vertebrae, slight errors of detection may lead to significant measurement errors, hence, wrong disease stages. 2) Automatic localize and label each lumbar vertebrae is required to provide the semantic meaning of the measurement. It is difficult since different lumbar vertebraes have high similarity of both shape and image appearance. To resolve these challenges, a new auto measurement framework is proposed with two major contributions: First, a learning based spine labeling method that integrates both the image appearance and spine geometry information is designed to detect lumbar vertebrae. Second, a hierarchical method using both the population information from atlases and domain-specific information in the target image is proposed for most anterior and posterior points positioning. Validated on 258 CT spondylolisthesis patients, our method shows very similar results to manual measurements by radiologists and significantly increases the measurement efficiency.

Augmenting Surgery via Multi-scale Modeling and Translational Systems Biology in the Era of Precision Medicine: A Multidisciplinary Perspective

In this era of tremendous technological capabilities and increased focus on improving clinical outcomes, decreasing costs, and increasing precision, there is a need for a more quantitative approach to the field of surgery. Multiscale computational modeling has the potential to bridge the gap to the emerging paradigms of Precision Medicine and Translational Systems Biology, in which quantitative metrics and data guide patient care through improved stratification, diagnosis, and therapy. Achievements by multiple groups have demonstrated the potential for (1) multiscale computational modeling, at a biological level, of diseases treated with surgery and the surgical procedure process at the level of the individual and the population; along with (2) patient-specific, computationally-enabled surgical planning, delivery, and guidance and robotically-augmented manipulation. In this perspective article, we discuss these concepts, and cite emerging examples from the fields of trauma, wound healing, and cardiac surgery.

Registration of a statistical model to intraoperative ultrasound for scaphoid screw fixation

PURPOSE

Volar percutaneous scaphoid fracture fixation is conventionally performed under fluoroscopy-based guidance, where surgeons need to mentally determine a trajectory for the insertion of the screw and its depth based on a series of 2D projection images. In addition to challenges associated with mapping 2D information to a 3D space, the process involves exposure to ionizing radiation. Three-dimensional ultrasound has been suggested as an alternative imaging tool for this procedure; however, it has not yet been integrated into clinical routine since ultrasound only provides a limited view of the scaphoid and its surrounding anatomy.

METHODS

We propose a registration of a statistical wrist shape + scale + pose model to a preoperative CT and intraoperative ultrasound to derive a patient-specific 3D model for guiding scaphoid fracture fixation. The registered model is then used to determine clinically important intervention parameters, including the screw length and the trajectory of screw insertion in the scaphoid bone.

RESULTS

Feasibility experiments are performed using 13 cadaver wrists. In 10 out of 13 cases, the trajectory of screw suggested by the registered model meets all clinically important intervention parameters. Overall, an average 94 % of maximum allowable screw length is obtained based on the measurements from gold standard CT. Also, we obtained an average 92 % successful volar accessibility, which indicates that the trajectory is not obstructed by the surrounding trapezium bone.

CONCLUSIONS

These promising results indicate that determining clinically important screw insertion parameters for scaphoid fracture fixation is feasible using 3D ultrasound imaging. This suggests the potential of this technology in replacing fluoroscopic guidance for this procedure in future applications.

A multi-center milestone study of clinical vertebral CT segmentation

A multiple center milestone study of clinical vertebra segmentation is presented in this paper. Vertebra segmentation is a fundamental step for spinal image analysis and intervention. The first half of the study was conducted in the spine segmentation challenge in 2014 International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) Workshop on Computational Spine Imaging (CSI 2014). The objective was to evaluate the performance of several state-of-the-art vertebra segmentation algorithms on computed tomography (CT) scans using ten training and five testing dataset, all healthy cases; the second half of the study was conducted after the challenge, where additional 5 abnormal cases are used for testing to evaluate the performance under abnormal cases. Dice coefficients and absolute surface distances were used as evaluation metrics. Segmentation of each vertebra as a single geometric unit, as well as separate segmentation of vertebra substructures, was evaluated. Five teams participated in the comparative study. The top performers in the study achieved Dice coefficient of 0.93 in the upper thoracic, 0.95 in the lower thoracic and 0.96 in the lumbar spine for healthy cases, and 0.88 in the upper thoracic, 0.89 in the lower thoracic and 0.92 in the lumbar spine for osteoporotic and fractured cases. The strengths and weaknesses of each method as well as future suggestion for improvement are discussed. This is the first multi-center comparative study for vertebra segmentation methods, which will provide an up-to-date performance milestone for the fast growing spinal image analysis and intervention.

Intraoperative CT as a registration benchmark for intervertebral motion compensation in image-guided open spinal surgery

PURPOSE

An accurate and reliable benchmark of registration accuracy and intervertebral motion compensation is important for spinal image guidance. In this study, we evaluated the utility of intraoperative CT (iCT) in place of bone-implanted screws as the ground-truth registration and illustrated its use to benchmark the performance of intraoperative stereovision (iSV).

METHODS

A template-based, multi-body registration scheme was developed to individually segment and pair corresponding vertebrae between preoperative CT and iCT of the spine. Intervertebral motion was determined from the resulting vertebral pair-wise registrations. The accuracy of the image-driven registration was evaluated using surface-to-surface distance error (SDE) based on segmented bony features and was independently verified using point-to-point target registration error (TRE) computed from bone-implanted mini-screws. Both SDE and TRE were used to assess the compensation accuracy using iSV.

RESULTS

The iCT-based technique was evaluated on four explanted porcine spines (20 vertebral pairs) with artificially induced motion. We report a registration accuracy of 0.57 [Formula: see text] 0.32 mm (range 0.34-1.14 mm) and 0.29 [Formula: see text] 0.15 mm (range 0.14-0.78 mm) in SDE and TRE, respectively, for all vertebrae pooled, with an average intervertebral rotation of [Formula: see text] (range 1.5[Formula: see text]-7.9[Formula: see text]). The iSV-based compensation accuracy for one sample (four vertebrae) was 1.32 [Formula: see text] 0.19 mm and 1.72 [Formula: see text] 0.55 mm in SDE and TRE, respectively, exceeding the recommended accuracy of 2 mm.

CONCLUSION

This study demonstrates the effectiveness of iCT in place of invasive fiducials as a registration ground truth. These findings are important for future development of on-demand spinal image guidance using radiation-free images such as stereovision and ultrasound on human subjects.

Statistical Biomechanical Surface Registration: Application to MR-TRUS Fusion for Prostate Interventions

A common challenge when performing surface-based registration of images is ensuring that the surfaces accurately represent consistent anatomical boundaries. Image segmentation may be difficult in some regions due to either poor contrast, low slice resolution, or tissue ambiguities. To address this, we present a novel non-rigid surface registration method designed to register two partial surfaces, capable of ignoring regions where the anatomical boundary is unclear. Our probabilistic approach incorporates prior geometric information in the form of a statistical shape model (SSM), and physical knowledge in the form of a finite element model (FEM). We validate results in the context of prostate interventions by registering pre-operative magnetic resonance imaging (MRI) to 3D transrectal ultrasound (TRUS). We show that both the geometric and physical priors significantly decrease net target registration error (TRE), leading to TREs of 2.35 ± 0.81 mm and 2.81 ± 0.66 mm when applied to full and partial surfaces, respectively. We investigate robustness in response to errors in segmentation, varying levels of missing data, and adjusting the tunable parameters. Results demonstrate that the proposed surface registration method is an efficient, robust, and effective solution for fusing data from multiple modalities.

Accurate Segmentation of Vertebral Bodies and Processes Using Statistical Shape Decomposition and Conditional Models

Detailed segmentation of the vertebrae is an important pre-requisite in various applications of image-based spine assessment, surgery and biomechanical modeling. In particular, accurate segmentation of the processes is required for image-guided interventions, for example for optimal placement of bone grafts between the transverse processes. Furthermore, the geometry of the processes is now required in musculoskeletal models due to their interaction with the muscles and ligaments. In this paper, we present a new method for detailed segmentation of both the vertebral bodies and processes based on statistical shape decomposition and conditional models. The proposed technique is specifically developed with the aim to handle the complex geometry of the processes and the large variability between individuals. The key technical novelty in this work is the introduction of a part-based statistical decomposition of the vertebrae, such that the complexity of the subparts is effectively reduced, and model specificity is increased. Subsequently, in order to maintain the statistical and anatomic coherence of the ensemble, conditional models are used to model the statistical inter-relationships between the different subparts. For shape reconstruction and segmentation, a robust model fitting procedure is used to exclude improbable inter-part relationships in the estimation of the shape parameters. Segmentation results based on a dataset of 30 healthy CT scans and a dataset of 10 pathological scans show a point-to-surface error improvement of 20% and 17% respectively, and the potential of the proposed technique for detailed vertebral modeling.

A Framework for Automated Spine and Vertebrae Interpolation-Based Detection and Model-Based Segmentation

Automated and semi-automated detection and segmentation of spinal and vertebral structures from computed tomography (CT) images is a challenging task due to a relatively high degree of anatomical complexity, presence of unclear boundaries and articulation of vertebrae with each other, as well as due to insufficient image spatial resolution, partial volume effects, presence of image artifacts, intensity variations and low signal-to-noise ratio. In this paper, we describe a novel framework for automated spine and vertebrae detection and segmentation from 3-D CT images. A novel optimization technique based on interpolation theory is applied to detect the location of the whole spine in the 3-D image and, using the obtained location of the whole spine, to further detect the location of individual vertebrae within the spinal column. The obtained vertebra detection results represent a robust and accurate initialization for the subsequent segmentation of individual vertebrae, which is performed by an improved shape-constrained deformable model approach. The framework was evaluated on two publicly available CT spine image databases of 50 lumbar and 170 thoracolumbar vertebrae. Quantitative comparison against corresponding reference vertebra segmentations yielded an overall mean centroid-to-centroid distance of 1.1 mm and Dice coefficient of 83.6% for vertebra detection, and an overall mean symmetric surface distance of 0.3 mm and Dice coefficient of 94.6% for vertebra segmentation. The results indicate that by applying the proposed automated detection and segmentation framework, vertebrae can be successfully detected and accurately segmented in 3-D from CT spine images.

A Predictive Model of Vertebral Trabecular Anisotropy From Ex Vivo Micro-CT

Spine-related disorders are amongst the most frequently encountered problems in clinical medicine. For several applications such as 1) to improve the assessment of the strength of the spine, as well as 2) to optimize the personalization of spinal interventions, image-based biomechanical modeling of the vertebrae is expected to play an important predictive role. However, this requires the construction of computational models that are subject-specific and comprehensive. In particular, they need to incorporate information about the vertebral anisotropic micro-architecture, which plays a central role in the biomechanical function of the vertebrae. In practice, however, accurate personalization of the vertebral trabeculae has proven to be difficult as its imaging in vivo is currently infeasible. Consequently, this paper presents a statistical approach for accurate prediction of the vertebral fabric tensors based on a training sample of ex vivo micro-CT images. To the best of our knowledge, this is the first predictive model proposed and validated for vertebral datasets. The method combines features selection and partial least squares regression in order to derive optimal latent variables for the prediction of the fabric tensors based on the more easily extracted shape and density information. Detailed validation with 20 ex vivo T12 vertebrae demonstrates the accuracy and consistency of the approach for the personalization of trabecular anisotropy.

Multi-Modality Vertebra Recognition in Arbitrary Views Using 3D Deformable Hierarchical Model

Computer-aided diagnosis of spine problems relies on the automatic identification of spine structures in images. The task of automatic vertebra recognition is to identify the global spine and local vertebra structural information such as spine shape, vertebra location and pose. Vertebra recognition is challenging due to the large appearance variations in different image modalities/views and the high geometric distortions in spine shape. Existing vertebra recognitions are usually simplified as vertebrae detections, which mainly focuses on the identification of vertebra locations and labels but cannot support further spine quantitative assessment. In this paper, we propose a vertebra recognition method using 3D deformable hierarchical model (DHM) to achieve cross-modality local vertebra location+pose identification with accurate vertebra labeling, and global 3D spine shape recovery. We recast vertebra recognition as deformable model matching, fitting the input spine images with the 3D DHM via deformations. The 3D model-matching mechanism provides a more comprehensive vertebra location+pose+label simultaneous identification than traditional vertebra location+label detection, and also provides an articulated 3D mesh model for the input spine section. Moreover, DHM can conduct versatile recognition on volume and multi-slice data, even on single slice. Experiments show our method can successfully extract vertebra locations, labels, and poses from multi-slice T1/T2 MR and volume CT, and can reconstruct 3D spine model on different image views such as lumbar, cervical, even whole spine. The resulting vertebra information and the recovered shape can be used for quantitative diagnosis of spine problems and can be easily digitalized and integrated in modern medical PACS systems.

Statistical Interspace Models (SIMs): Application to Robust 3D Spine Segmentation

Statistical shape models (SSM) are used to introduce shape priors in the segmentation of medical images. However, such models require large training datasets in the case of multi-object structures, since it is required to obtain not only the individual shape variations but also the relative position and orientation among objects. A solution to overcome this limitation is to model each individual shape independently. However, this approach does not take into account the relative position, orientations and shapes among the parts of an articulated object, which may result in unrealistic geometries, such as with object overlaps. In this article, we propose a new Statistical Model, the Statistical Interspace Model (SIM), which provides information about the interaction of all the individual structures by modeling the interspace between them. The SIM is described using relative position vectors between pair of points that belong to different objects that are facing each other. These vectors are divided into their magnitude and direction, each of these groups modeled as independent manifolds. The SIM was included in a segmentation framework that contains an SSM per individual object. This framework was tested using three distinct types of datasets of CT images of the spine. Results show that the SIM completely eliminated the inter-process overlap while improving the segmentation accuracy.

Bone enhancement in ultrasound using local spectrum variations for guiding percutaneous scaphoid fracture fixation procedures

PURPOSE

The scaphoid bone is the most frequently fractured bone in the wrist. When fracture fixation is indicated, a screw is inserted into the bone either in an open surgical procedure or percutaneously under fluoroscopic guidance. Due to the complex geometry of the wrist, fracture fixation is a challenging task. Fluoroscopic guidance exposes both the patient and the physician to ionizing radiation. Ultrasound-based guidance has been suggested as a real-time, radiation-free alternative. The main challenge of using ultrasound is the difficulty in interpreting the images due to the low contrast and noisy nature of the data.

METHODS

We propose a bone enhancement method that exploits local spectrum features of the ultrasound image. These features are utilized to design a set of quadrature band-pass filters and subsequently estimate the local phase symmetry, where high symmetry is expected at the bone locations. We incorporate the shadow information below the bone surfaces to further enhance the bone responses. The extracted bone surfaces are then used to register a statistical wrist model to ultrasound volumes, allowing the localization and interpretation of the scaphoid bone in the volumes.

RESULTS

Feasibility experiments were performed using phantom and in vivo data. For phantoms, we obtain a surface distance error 1.08 mm and an angular deviation from the main axis of the scaphoid bone smaller than 5°, which are better compared to previously presented approaches.

CONCLUSION

The results are promising for further development of a surgical guidance system to enable accurate anatomy localization for guiding percutaneous scaphoid fracture fixations.

Automatic segmentation of the spine by means of a probabilistic atlas with a special focus on ribs suppression. Preliminary results

Spine is a structure commonly involved in several prevalent diseases. In clinical diagnosis, therapy, and surgical intervention, the identification and segmentation of the vertebral bodies are crucial steps. However, automatic and detailed segmentation of vertebrae is a challenging task, especially due to the proximity of the vertebrae to the corresponding ribs and other structures such as blood vessels. In this study, to overcome these problems, a probabilistic atlas of the spine, including cervical, thoracic and lumbar vertebrae has been built to introduce anatomical knowledge in the segmentation process, aiming to deal with overlapping gray levels and the proximity to other structures. From a set of 3D images manually segmented by a physician (training data), a 3D volume indicating the probability of each voxel of belonging to the spine has been developed, being necessary the generation of a probability map and its deformation to adapt to each patient. To validate the improvement of the segmentation using the atlas developed in the testing data, we computed the Hausdorff distance between the manually-segmented ground truth and an automatic segmentation and also between the ground truth and the automatic segmentation refined with the atlas. The results are promising, obtaining a higher improvement especially in the thoracic region, where the ribs can be found and appropriately eliminated.

Automatic labeling of vertebral levels using a robust template-based approach

Context. MRI of the spinal cord provides a variety of biomarkers sensitive to white matter integrity and neuronal function. Current processing methods are based on manual labeling of vertebral levels, which is time consuming and prone to user bias. Although several methods for automatic labeling have been published; they are not robust towards image contrast or towards susceptibility-related artifacts. Methods. Intervertebral disks are detected from the 3D analysis of the intensity profile along the spine. The robustness of the disk detection is improved by using a template of vertebral distance, which was generated from a training dataset. The developed method has been validated using T1- and T2-weighted contrasts in ten healthy subjects and one patient with spinal cord injury. Results. Accuracy of vertebral labeling was 100%. Mean absolute error was 2.1 ± 1.7 mm for T2-weighted images and 2.3 ± 1.6 mm for T1-weighted images. The vertebrae of the spinal cord injured patient were correctly labeled, despite the presence of artifacts caused by metallic implants. Discussion. We proposed a template-based method for robust labeling of vertebral levels along the whole spinal cord for T1- and T2-weighted contrasts. The method is freely available as part of the spinal cord toolbox.

PLUS: open-source toolkit for ultrasound-guided intervention systems

A variety of advanced image analysis methods have been under the development for ultrasound-guided interventions. Unfortunately, the transition from an image analysis algorithm to clinical feasibility trials as part of an intervention system requires integration of many components, such as imaging and tracking devices, data processing algorithms, and visualization software. The objective of our paper is to provide a freely available open-source software platform-PLUS: Public software Library for Ultrasound-to facilitate rapid prototyping of ultrasound-guided intervention systems for translational clinical research. PLUS provides a variety of methods for interventional tool pose and ultrasound image acquisition from a wide range of tracking and imaging devices, spatial and temporal calibration, volume reconstruction, simulated image generation, and recording and live streaming of the acquired data. This paper introduces PLUS, explains its functionality and architecture, and presents typical uses and performance in ultrasound-guided intervention systems. PLUS fulfills the essential requirements for the development of ultrasound-guided intervention systems and it aspires to become a widely used translational research prototyping platform. PLUS is freely available as open source software under BSD license and can be downloaded from http://www.plustoolkit.org.