1
|
Jia T, Taylor ZA, Chen X. Density-adaptive registration of pointclouds based on Dirichlet Process Gaussian Mixture Models. Phys Eng Sci Med 2023; 46:719-734. [PMID: 37014577 DOI: 10.1007/s13246-023-01245-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2022] [Accepted: 03/12/2023] [Indexed: 04/05/2023]
Abstract
We propose an algorithm for rigid registration of pre- and intra-operative patient anatomy, represented as pointclouds, during minimally invasive surgery. This capability is essential for development of augmented reality systems for guiding such interventions. Key challenges in this context are differences in the point density in the pre- and intra-operative pointclouds, and potentially low spatial overlap between the two. Solutions, correspondingly, must be robust to both of these phenomena. We formulated a pointclouds registration approach which considers the pointclouds after rigid transformation to be observations of a global non-parametric probabilistic model named Dirichlet Process Gaussian Mixture Model. The registration problem is solved by minimizing the Kullback-Leibler divergence in a variational Bayesian inference framework. By this means, all unknown parameters are recursively inferred, including, importantly, the optimal number of mixture model components, which ensures the model complexity efficiently matches that of the observed data. By presenting the pointclouds as KDTrees, both the data and model are expanded in a coarse-to-fine style. The scanning weight of each point is estimated by its neighborhood, imparting the algorithm with robustness to point density variations. Experiments on several datasets with different levels of noise, outliers and pointcloud overlap show that our method has a comparable accuracy, but higher efficiency than existing Gaussian Mixture Model methods, whose performance is sensitive to the number of model components.
Collapse
Affiliation(s)
- Tingting Jia
- School of Biomedical Engineering, Shanghai Jiao Tong University, 800 Dongchuan Road, Shanghai, 200240, China
- School of Mechanical Engineering, Shanghai Jiao Tong University, 800 Dongchuan Road, Shanghai, 200240, China
| | - Zeike A Taylor
- CISTIB Centre for Computational Imaging and Simulation Technologies in Biomedicine and the Institute of Medical and Biological Engineering, University of Leeds, Woodhouse Lane, Leeds, LS2 9JT, UK
| | - Xiaojun Chen
- School of Mechanical Engineering, Shanghai Jiao Tong University, 800 Dongchuan Road, Shanghai, 200240, China.
- Institute of Medical Robotics, Shanghai Jiao Tong University, 800 Dongchuan Road, Shanghai, 200240, China.
| |
Collapse
|
2
|
Zhang J, Li Y, Gao Y, Hu J, Huang B, Rong S, Chen J, Zhang Y, Wang L, Feng S, Wang L, Nie K. An SBM-based machine learning model for identifying mild cognitive impairment in patients with Parkinson's disease. J Neurol Sci 2020; 418:117077. [PMID: 32798842 DOI: 10.1016/j.jns.2020.117077] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2019] [Revised: 07/28/2020] [Accepted: 07/30/2020] [Indexed: 11/29/2022]
Abstract
OBJECTIVE To identify Parkinson's disease with mild cognitive impairment (PD-MCI) through surface-based morphometry (SBM) based machine learning model. METHODS 93 patients with parkinson's disease (35 PD with normal cognition, 58 PD-MCI) were examined, obtaining 276 SBM variables per subject. 20 healthy control subjects were used as the reference. After extracting features with statistically significance, support vector machine (SVM) model with grid search method was applied to identify patients with PD-MCI. Accuracy, matthews correlation coefficient (MCC), receiver operating characteristic curve (ROC), precision-recall curve (PR), AUC-ROC, AUC-PR and leave-one-out cross validation (LOOCV) strategy were employed for model evaluation. RESULTS PD-MCI is characterized by widespread structural abnormality. SVM model with SBM features achieved an accuracy of 80.00% and area under the ROC of 0.86 for identifying PD-MCI. MCC, AUC-PR, and LOOCV classification accuracy were 0.56, 0.89, and 78.08%, respectively. CONCLUSION Automatic identification of PD-MCI could be realized by SBM-based machine learning model.
Collapse
Affiliation(s)
- Jiahui Zhang
- Department of Neurology, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Guangdong Neuroscience Institute, No. 106 Zhongshan Er Road, Guangzhou 510080, China
| | - You Li
- Department of Neurology, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Guangdong Neuroscience Institute, No. 106 Zhongshan Er Road, Guangzhou 510080, China
| | - Yuyuan Gao
- Department of Neurology, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Guangdong Neuroscience Institute, No. 106 Zhongshan Er Road, Guangzhou 510080, China
| | - Jinlong Hu
- School of Computer Science & Engineering, Guangzhou Higher Education Mega Centre South China University of Technology, No.381 Wushan Road, Guangzhou, China
| | - Biao Huang
- Department of Radiology, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, No. 106 Zhongshan Er Road, Guangzhou 510080, China
| | - Siming Rong
- Department of Neurology, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Guangdong Neuroscience Institute, No. 106 Zhongshan Er Road, Guangzhou 510080, China
| | - Jianing Chen
- Department of Neurology, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Guangdong Neuroscience Institute, No. 106 Zhongshan Er Road, Guangzhou 510080, China
| | - Yuhu Zhang
- Department of Neurology, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Guangdong Neuroscience Institute, No. 106 Zhongshan Er Road, Guangzhou 510080, China
| | - Limin Wang
- Department of Neurology, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Guangdong Neuroscience Institute, No. 106 Zhongshan Er Road, Guangzhou 510080, China
| | - Shujun Feng
- Department of Neurology, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Guangdong Neuroscience Institute, No. 106 Zhongshan Er Road, Guangzhou 510080, China
| | - Lijuan Wang
- Department of Neurology, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Guangdong Neuroscience Institute, No. 106 Zhongshan Er Road, Guangzhou 510080, China.
| | - Kun Nie
- Department of Neurology, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Guangdong Neuroscience Institute, No. 106 Zhongshan Er Road, Guangzhou 510080, China.
| |
Collapse
|
3
|
Abadi E, Segars WP, Tsui BMW, Kinahan PE, Bottenus N, Frangi AF, Maidment A, Lo J, Samei E. Virtual clinical trials in medical imaging: a review. J Med Imaging (Bellingham) 2020; 7:042805. [PMID: 32313817 PMCID: PMC7148435 DOI: 10.1117/1.jmi.7.4.042805] [Citation(s) in RCA: 95] [Impact Index Per Article: 19.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2019] [Accepted: 03/23/2020] [Indexed: 12/13/2022] Open
Abstract
The accelerating complexity and variety of medical imaging devices and methods have outpaced the ability to evaluate and optimize their design and clinical use. This is a significant and increasing challenge for both scientific investigations and clinical applications. Evaluations would ideally be done using clinical imaging trials. These experiments, however, are often not practical due to ethical limitations, expense, time requirements, or lack of ground truth. Virtual clinical trials (VCTs) (also known as in silico imaging trials or virtual imaging trials) offer an alternative means to efficiently evaluate medical imaging technologies virtually. They do so by simulating the patients, imaging systems, and interpreters. The field of VCTs has been constantly advanced over the past decades in multiple areas. We summarize the major developments and current status of the field of VCTs in medical imaging. We review the core components of a VCT: computational phantoms, simulators of different imaging modalities, and interpretation models. We also highlight some of the applications of VCTs across various imaging modalities.
Collapse
Affiliation(s)
- Ehsan Abadi
- Duke University, Department of Radiology, Durham, North Carolina, United States
| | - William P. Segars
- Duke University, Department of Radiology, Durham, North Carolina, United States
| | - Benjamin M. W. Tsui
- Johns Hopkins University, Department of Radiology, Baltimore, Maryland, United States
| | - Paul E. Kinahan
- University of Washington, Department of Radiology, Seattle, Washington, United States
| | - Nick Bottenus
- Duke University, Department of Biomedical Engineering, Durham, North Carolina, United States
- University of Colorado Boulder, Department of Mechanical Engineering, Boulder, Colorado, United States
| | - Alejandro F. Frangi
- University of Leeds, School of Computing, Leeds, United Kingdom
- University of Leeds, School of Medicine, Leeds, United Kingdom
| | - Andrew Maidment
- University of Pennsylvania, Department of Radiology, Philadelphia, Pennsylvania, United States
| | - Joseph Lo
- Duke University, Department of Radiology, Durham, North Carolina, United States
| | - Ehsan Samei
- Duke University, Department of Radiology, Durham, North Carolina, United States
| |
Collapse
|
4
|
Bayer S, Zhai Z, Strumia M, Tong X, Gao Y, Staring M, Stoel B, Fahrig R, Nabavi A, Maier A, Ravikumar N. Registration of vascular structures using a hybrid mixture model. Int J Comput Assist Radiol Surg 2019; 14:1507-1516. [PMID: 31175535 DOI: 10.1007/s11548-019-02007-y] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2019] [Accepted: 05/28/2019] [Indexed: 11/25/2022]
Abstract
PURPOSE Morphological changes to anatomy resulting from invasive surgical procedures or pathology, typically alter the surrounding vasculature. This makes it useful as a descriptor for feature-driven image registration in various clinical applications. However, registration of vasculature remains challenging, as vessels often differ in size and shape, and may even miss branches, due to surgical interventions or pathological changes. Furthermore, existing vessel registration methods are typically designed for a specific application. To address this limitation, we propose a generic vessel registration approach useful for a variety of clinical applications, involving different anatomical regions. METHODS A probabilistic registration framework based on a hybrid mixture model, with a refinement mechanism to identify missing branches (denoted as HdMM+) during vasculature matching, is introduced. Vascular structures are represented as 6-dimensional hybrid point sets comprising spatial positions and centerline orientations, using Student's t-distributions to model the former and Watson distributions for the latter. RESULTS The proposed framework is evaluated for intraoperative brain shift compensation, and monitoring changes in pulmonary vasculature resulting from chronic lung disease. Registration accuracy is validated using both synthetic and patient data. Our results demonstrate, HdMM+ is able to reduce more than [Formula: see text] of the initial error for both applications, and outperforms the state-of-the-art point-based registration methods such as coherent point drift and Student's t-distribution mixture model, in terms of mean surface distance, modified Hausdorff distance, Dice and Jaccard scores. CONCLUSION The proposed registration framework models complex vascular structures using a hybrid representation of vessel centerlines, and accommodates intricate variations in vascular morphology. Furthermore, it is generic and flexible in its design, enabling its use in a variety of clinical applications.
Collapse
Affiliation(s)
- Siming Bayer
- Pattern Recognition Lab, Friedrich-Alexander University, Martenstraße 3, 91058, Erlangen, Germany.
| | - Zhiwei Zhai
- Leiden University Medical Center, Albinusdreef 2, 2333 ZA, Leiden, The Netherlands
| | | | - Xiaoguang Tong
- Tianjin Huanhu Hospital, Nankai University, Jizhao Road 6, Tianjin, 300350, China
| | - Ying Gao
- Siemens Healthineers Ltd, Wanjing Zhonghuan Nanlu, Beijing, 100102, China
| | - Marius Staring
- Leiden University Medical Center, Albinusdreef 2, 2333 ZA, Leiden, The Netherlands
| | - Berend Stoel
- Leiden University Medical Center, Albinusdreef 2, 2333 ZA, Leiden, The Netherlands
| | - Rebecca Fahrig
- Siemens Healthcare GmbH, Siemensstraße 1, 91301, Forchheim, Germany
| | - Arya Nabavi
- Department of Neurosurgery, Nordstadt Hospital, KRH, Haltenhoffstr 41, 30167, Hannover, Germany
| | - Andreas Maier
- Pattern Recognition Lab, Friedrich-Alexander University, Martenstraße 3, 91058, Erlangen, Germany
| | - Nishant Ravikumar
- Pattern Recognition Lab, Friedrich-Alexander University, Martenstraße 3, 91058, Erlangen, Germany
| |
Collapse
|