1
|
Qu B, Cao J, Qian C, Wu J, Lin J, Wang L, Ou-Yang L, Chen Y, Yan L, Hong Q, Zheng G, Qu X. Current development and prospects of deep learning in spine image analysis: a literature review. Quant Imaging Med Surg 2022; 12:3454-3479. [PMID: 35655825 PMCID: PMC9131328 DOI: 10.21037/qims-21-939] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Accepted: 03/04/2022] [Indexed: 10/07/2023]
Abstract
BACKGROUND AND OBJECTIVE As the spine is pivotal in the support and protection of human bodies, much attention is given to the understanding of spinal diseases. Quick, accurate, and automatic analysis of a spine image greatly enhances the efficiency with which spine conditions can be diagnosed. Deep learning (DL) is a representative artificial intelligence technology that has made encouraging progress in the last 6 years. However, it is still difficult for clinicians and technicians to fully understand this rapidly evolving field due to the diversity of applications, network structures, and evaluation criteria. This study aimed to provide clinicians and technicians with a comprehensive understanding of the development and prospects of DL spine image analysis by reviewing published literature. METHODS A systematic literature search was conducted in the PubMed and Web of Science databases using the keywords "deep learning" and "spine". Date ranges used to conduct the search were from 1 January, 2015 to 20 March, 2021. A total of 79 English articles were reviewed. KEY CONTENT AND FINDINGS The DL technology has been applied extensively to the segmentation, detection, diagnosis, and quantitative evaluation of spine images. It uses static or dynamic image information, as well as local or non-local information. The high accuracy of analysis is comparable to that achieved manually by doctors. However, further exploration is needed in terms of data sharing, functional information, and network interpretability. CONCLUSIONS The DL technique is a powerful method for spine image analysis. We believe that, with the joint efforts of researchers and clinicians, intelligent, interpretable, and reliable DL spine analysis methods will be widely applied in clinical practice in the future.
Collapse
Affiliation(s)
- Biao Qu
- Department of Instrumental and Electrical Engineering, Xiamen University, Xiamen, China
| | - Jianpeng Cao
- Department of Electronic Science, Biomedical Intelligent Cloud R&D Center, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, National Institute for Data Science in Health and Medicine, Xiamen University, Xiamen, China
| | - Chen Qian
- Department of Electronic Science, Biomedical Intelligent Cloud R&D Center, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, National Institute for Data Science in Health and Medicine, Xiamen University, Xiamen, China
| | - Jinyu Wu
- Department of Electronic Science, Biomedical Intelligent Cloud R&D Center, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, National Institute for Data Science in Health and Medicine, Xiamen University, Xiamen, China
| | - Jianzhong Lin
- Department of Radiology, Zhongshan Hospital of Xiamen University, Xiamen, China
| | - Liansheng Wang
- Department of Computer Science, School of Informatics, Xiamen University, Xiamen, China
| | - Lin Ou-Yang
- Department of Medical Imaging of Southeast Hospital, Medical College of Xiamen University, Zhangzhou, China
| | - Yongfa Chen
- Department of Pediatric Orthopedic Surgery, The First Affiliated Hospital of Xiamen University, Xiamen, China
| | - Liyue Yan
- Department of Information & Computational Mathematics, Xiamen University, Xiamen, China
| | - Qing Hong
- Biomedical Intelligent Cloud R&D Center, China Mobile Group, Xiamen, China
| | - Gaofeng Zheng
- Department of Instrumental and Electrical Engineering, Xiamen University, Xiamen, China
| | - Xiaobo Qu
- Department of Electronic Science, Biomedical Intelligent Cloud R&D Center, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, National Institute for Data Science in Health and Medicine, Xiamen University, Xiamen, China
| |
Collapse
|
2
|
Jalalian A, Arastehfar S, Gibson I, Tay FEH, Liu G. How Can Biomechanical Multibody Models of Scoliosis Be Accurate in Simulating Spine Movement Behavior While Neglecting the Changes of Spinal Length? J Biomech Eng 2021; 143:081004. [PMID: 33764411 DOI: 10.1115/1.4050636] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2020] [Indexed: 11/08/2022]
Abstract
This paper studies how biomechanical multibody models of scoliosis can neglect the changes of spinal length and yet be accurate in reconstructing spinal columns. As these models with fixed length comprise rigid links interconnected by rotary joints, they resemble polygonal chains that approximate spine curves with a finite number of line segments. In mathematics, using more segments with shorter lengths can result in more accurate curve approximations. This raises the question of whether more accurate spine curve approximations by increasing the number of links/joints can yield more accurate spinal column reconstructions. For this, the accuracy of spine curve approximation was improved consistently by increasing the number of links/joints, and its effects on the accuracy of spinal column reconstruction were assessed. Positive correlation was found between the accuracy of spine reconstruction and curve approximation. It was shown that while increasing the accuracy of curve approximations, the representation of scoliosis concavity and its side-to-side deviations were improved. Moreover, reconstruction errors of the spine regions separated by the inflection vertebrae had minimal impacts on each other. Overall, multibody scoliosis models with fixed spinal lengths can benefit from the extra rotational joints that contribute toward the accuracy of spine curve approximation. The outcome of this study leads to concurrent accuracy improvement and simplification of multibody models; joint-link configurations can be independently defined for the regions separated by the inflection vertebrae, enabling local optimization of the models for higher accuracy without unnecessary added complexity to the whole model.
Collapse
Affiliation(s)
- Athena Jalalian
- Faculty of Engineering Technology, University of Twente, P.O. BOX 217, Enschede 7500 AE, The Netherlands
| | - Soheil Arastehfar
- Faculty of Engineering Technology, University of Twente, P.O. BOX 217, Enschede 7500 AE, The Netherlands
| | - Ian Gibson
- Faculty of Engineering Technology, University of Twente, P.O. BOX 217, Enschede, 7500 AE The Netherlands
| | - Francis E H Tay
- Faculty of Engineering, National University of Singapore, 21 Lower Kent Ridge Road, Singapore 119077, Singapore
| | - Gabriel Liu
- Department of Orthopedic Surgery, National University Hospital, 5 Lower Kent Ridge Road, Singapore 119074, Singapore
| |
Collapse
|
3
|
Joseph SS, Dennisan A. Three Dimensional Reconstruction Models for Medical Modalities: A Comprehensive Investigation and Analysis. Curr Med Imaging 2020; 16:653-668. [PMID: 32723236 DOI: 10.2174/1573405615666190124165855] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2018] [Revised: 12/14/2018] [Accepted: 01/03/2019] [Indexed: 11/22/2022]
Abstract
BACKGROUND Image reconstruction is the mathematical process which converts the signals obtained from the scanning machine into an image. The reconstructed image plays a fundamental role in the planning of surgery and research in the medical field. DISCUSSION This paper introduces the first comprehensive survey of the literature about medical image reconstruction related to diseases, presenting a categorical study about the techniques and analyzing advantages and disadvantages of each technique. The images obtained by various imaging modalities like MRI, CT, CTA, Stereo radiography and Light field microscopy are included. A comparison on the basis of the reconstruction technique, Imaging Modality and Visualization, Disease, Metrics for 3D reconstruction accuracy, Dataset and Execution time, Evaluation of the technique is also performed. CONCLUSION The survey makes an assessment of the suitable reconstruction technique for an organ, draws general conclusions and discusses the future directions.
Collapse
Affiliation(s)
- Sushitha Susan Joseph
- School of Computer Science and Engineering, Vellore Institute of Technology, Vellore 632014, India
| | - Aju Dennisan
- School of Computer Science and Engineering, Vellore Institute of Technology, Vellore 632014, India
| |
Collapse
|
4
|
Quasi-automatic 3D reconstruction of the full spine from low-dose biplanar X-rays based on statistical inferences and image analysis. EUROPEAN SPINE JOURNAL : OFFICIAL PUBLICATION OF THE EUROPEAN SPINE SOCIETY, THE EUROPEAN SPINAL DEFORMITY SOCIETY, AND THE EUROPEAN SECTION OF THE CERVICAL SPINE RESEARCH SOCIETY 2018; 28:658-664. [PMID: 30382429 DOI: 10.1007/s00586-018-5807-6] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/06/2018] [Accepted: 10/24/2018] [Indexed: 12/17/2022]
Abstract
PURPOSE To design a quasi-automated three-dimensional reconstruction method of the spine from biplanar X-rays as the daily used method in clinical routine is based on manual adjustments of a trained operator and the reconstruction time is more than 10 min per patient. METHODS The proposed method of 3D reconstruction of the spine (C3-L5) relies first on a new manual input strategy designed to fit clinicians' skills. Then, a parametric model of the spine is computed using statistical inferences, image analysis techniques and fast manual rigid registration. RESULTS An agreement study with the clinically used method on a cohort of 57 adolescent scoliotic subjects has shown that both methods have similar performance on vertebral body position and axial rotation (null bias in both cases and standard deviation of signed differences of 1 mm and 3.5° around, respectively). In average, the solution could be computed in less than 5 min of operator time, even for severe scoliosis. CONCLUSION The proposed method allows fast and accurate 3D reconstruction of the spine for wide clinical applications and represents a significant step towards full automatization of 3D reconstruction of the spine. Moreover, it is to the best of our knowledge the first method including also the cervical spine. These slides can be retrieved under electronic supplementary material.
Collapse
|
5
|
Moura DC, Barbosa JG. Real-scale 3D models of the scoliotic spine from biplanar radiography without calibration objects. Comput Med Imaging Graph 2014; 38:580-5. [PMID: 24908193 DOI: 10.1016/j.compmedimag.2014.05.007] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2013] [Revised: 04/03/2014] [Accepted: 05/06/2014] [Indexed: 10/25/2022]
Abstract
This paper presents a new method for modelling the spines of subjects and making accurate 3D measurements using standard radiologic systems without requiring calibration objects. The method makes use of the focal distance and statistical models for estimating the geometrical parameters of the system. A dataset of 32 subjects was used to assess this method. The results show small errors for the main clinical indices, such as an RMS error of 0.49° for the Cobb angle, 0.50° for kyphosis, 0.38° for lordosis, and 2.62mm for the spinal length. This method is the first to achieve this level of accuracy without requiring the use of calibration objects when acquiring radiographs. We conclude that the proposed method allows for the evaluation of scoliosis with a much simpler setup than currently available methods.
Collapse
Affiliation(s)
- Daniel C Moura
- Instituto de Telecomunicações, Departamento de Engenharia Electrotécnica e de Computadores, Faculdade de Engenharia, Universidade do Porto, Porto, Portugal.
| | - Jorge G Barbosa
- Departamento de Engenharia Informática, Faculdade de Engenharia, Universidade do Porto, Porto, Portugal; Laboratório de Intelegência Artificial e Ciência dos Computadores, Porto, Portugal
| |
Collapse
|