1
|
Xu J, Zhang D, Wang C, Zhou H, Li Y, Chen X. Automatic segmentation of orbital wall from CT images via a thin wall region supervision-based multi-scale feature search network. Int J Comput Assist Radiol Surg 2023; 18:2051-2062. [PMID: 37219805 DOI: 10.1007/s11548-023-02924-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Accepted: 04/14/2023] [Indexed: 05/24/2023]
Abstract
PURPOSE Orbital wall segmentation is critical for orbital measurement and reconstruction. However, the orbital floor and medial wall are made up of thin walls (TW) with low gradient values, making it difficult to segment the blurred areas of the CT images. Clinically, doctors have to manually repair the missing parts of TW, which is time-consuming and laborious. METHODS To address these issues, this paper proposes an automatic orbital wall segmentation method based on TW region supervision using a multi-scale feature search network. First of all, in the encoding branch, the densely connected atrous spatial pyramid pooling based on the residual connection is adopted to achieve a multi-scale feature search. Then, for feature enhancement, multi-scale up-sampling and residual connection are applied to perform skip connection of features in multi-scale convolution. Finally, we explore a strategy for improving the loss function based on the TW region supervision, which effectively increases the TW region segmentation accuracy. RESULTS The test results show that the proposed network performs well in terms of automatic segmentation. For the whole orbital wall region, the Dice coefficient (Dice) of segmentation accuracy reaches 96.086 ± 1.049%, the Intersection over Union (IOU) reaches 92.486 ± 1.924%, and the 95% Hausdorff distance (HD) reaches 0.509 ± 0.166 mm. For the TW region, the Dice reaches 91.470 ± 1.739%, the IOU reaches 84.327 ± 2.938%, and the 95% HD reaches 0.481 ± 0.082 mm. Compared with other segmentation networks, the proposed network improves the segmentation accuracy while filling the missing parts in the TW region. CONCLUSION In the proposed network, the average segmentation time of each orbital wall is only 4.05 s, obviously improving the segmentation efficiency of doctors. In the future, it may have a practical significance in clinical applications such as preoperative planning for orbital reconstruction, orbital modeling, orbital implant design, and so on.
Collapse
Affiliation(s)
- Jiangchang Xu
- Institute of Biomedical Manufacturing and Life Quality Engineering, State Key Laboratory of Mechanical System and Vibration, Room 925, School of Mechanical Engineering, Shanghai Jiao Tong University, Dongchuan Road 800, Minhang District, Shanghai, 200240, China
| | - Dingzhong Zhang
- Institute of Biomedical Manufacturing and Life Quality Engineering, State Key Laboratory of Mechanical System and Vibration, Room 925, School of Mechanical Engineering, Shanghai Jiao Tong University, Dongchuan Road 800, Minhang District, Shanghai, 200240, China
| | - Chunliang Wang
- Department of Biomedical Engineering and Health Systems, KTH Royal Institute of Technology, Stockholm, Sweden
| | - Huifang Zhou
- Department of Ophthalmology, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
- Shanghai Key Laboratory of Orbital Diseases and Ocular Oncology, Shanghai, China
| | - Yinwei Li
- Department of Ophthalmology, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
- Shanghai Key Laboratory of Orbital Diseases and Ocular Oncology, Shanghai, China.
| | - Xiaojun Chen
- Institute of Biomedical Manufacturing and Life Quality Engineering, State Key Laboratory of Mechanical System and Vibration, Room 925, School of Mechanical Engineering, Shanghai Jiao Tong University, Dongchuan Road 800, Minhang District, Shanghai, 200240, China.
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China.
| |
Collapse
|
2
|
Maken P, Gupta A, Gupta MK. A systematic review of the techniques for automatic segmentation of the human upper airway using volumetric images. Med Biol Eng Comput 2023; 61:1901-1927. [PMID: 37248380 DOI: 10.1007/s11517-023-02842-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Accepted: 04/20/2023] [Indexed: 05/31/2023]
Abstract
The human upper airway is comprised of many anatomical volumes. The obstructions in the upper airway volumes are needed to be diagnosed which requires volumetric segmentation. Manual segmentation is time-consuming and requires expertise in the field. Automatic segmentation provides reliable results and also saves time and effort for the expert. The objective of this study is to systematically review the literature to study various techniques used for the automatic segmentation of the human upper airway regions in volumetric images. PRISMA guidelines were followed to conduct the systematic review. Four online databases Scopus, Google Scholar, PubMed, and JURN were used for the searching of the relevant papers. The relevant papers were shortlisted using inclusion and exclusion eligibility criteria. Three review questions were made and explored to find their answers. The best technique among all the literature studies based on the Dice coefficient and precision was identified and justified through the analysis. This systematic review provides insight to the researchers so that they shall be able to overcome the prominent issues in the field identified from the literature. The outcome of the review is based on several parameters, e.g., accuracy, techniques, challenges, datasets, and segmentation of different sub-regions. Flowchart of the search process as per PRISMA guidelines along with inclusion and exclusion criteria.
Collapse
Affiliation(s)
- Payal Maken
- School of Computer Science and Engineering, Shri Mata Vaishno Devi University, Katra, India
| | - Abhishek Gupta
- Biomedical Application Division, CSIR-Central Scientific Instruments Organisation, Chandigarh, 160030, India.
| | - Manoj Kumar Gupta
- School of Computer Science and Engineering, Shri Mata Vaishno Devi University, Katra, India
| |
Collapse
|
3
|
Chang-Gonzalez AC, Gibbs HC, Lekven AC, Yeh AT, Hwang W. Building a three-dimensional model of early-stage zebrafish embryo brain. ACTA ACUST UNITED AC 2021; 1. [PMID: 34693392 PMCID: PMC8535780 DOI: 10.1016/j.bpr.2021.100003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
We introduce a computational approach to build three-dimensional (3D) surface mesh models of the early-stage zebrafish brain primordia from time-series microscopy images. The complexity of the early-stage brain primordia and lack of recognizable landmarks pose a distinct challenge for feature segmentation and 3D modeling. Additional difficulty arises because of noise and variations in pixel intensity. We overcome these by using a hierarchical approach in which simple geometric elements, such as "beads" and "bonds," are assigned to represent local features and their connectivity is used to smoothen the surface while retaining high-curvature regions. We apply our method to build models of two zebrafish embryo phenotypes at discrete time points between 19 and 28 h post-fertilization and collect measurements to quantify development. Our approach is fast and applicable to building models of other biological systems, as demonstrated by models from magnetic resonance images of the human fetal brain. The source code, input scripts, sample image files, and generated outputs are publicly available on GitHub.
Collapse
Affiliation(s)
- Ana C Chang-Gonzalez
- Department of Biomedical Engineering, Texas A&M University, College Station, Texas
| | - Holly C Gibbs
- Department of Biomedical Engineering, Texas A&M University, College Station, Texas.,Microscopy and Imaging Center, Texas A&M University, College Station, Texas
| | - Arne C Lekven
- Department of Biology and Biochemistry, University of Houston, Houston, Texas
| | - Alvin T Yeh
- Department of Biomedical Engineering, Texas A&M University, College Station, Texas
| | - Wonmuk Hwang
- Department of Biomedical Engineering, Texas A&M University, College Station, Texas.,Department of Materials Science & Engineering, Texas A&M University, College Station, Texas.,Department of Physics & Astronomy, Texas A&M University, College Station, Texas.,School of Computational Sciences, Korea Institute for Advanced Study, Seoul, Korea
| |
Collapse
|
4
|
Schreurs R, Klop C, Maal TJJ. Advanced Diagnostics and Three-dimensional Virtual Surgical Planning in Orbital Reconstruction. Atlas Oral Maxillofac Surg Clin North Am 2020; 29:79-96. [PMID: 33516541 DOI: 10.1016/j.cxom.2020.11.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Affiliation(s)
- Ruud Schreurs
- Department of Oral and Maxillofacial Surgery, Amsterdam University Medical Centres (location AMC), Meibergdreef 9, Amsterdam, AZ 1105, The Netherlands; Academic Center for Dentistry Amsterdam (ACTA), University of Amsterdam, Gustav Mahlerlaan 3004, 1081 LA, Amsterdam, The Netherlands; Department of Oral and Maxillofacial Surgery, Radboud University Medical Centre Nijmegen, Nijmegen, The Netherlands.
| | - Cornelis Klop
- Department of Oral and Maxillofacial Surgery, Amsterdam University Medical Centres (location AMC), Meibergdreef 9, Amsterdam, AZ 1105, The Netherlands; Academic Center for Dentistry Amsterdam (ACTA), University of Amsterdam, Gustav Mahlerlaan 3004, 1081 LA, Amsterdam, The Netherlands
| | - Thomas J J Maal
- Department of Oral and Maxillofacial Surgery, Amsterdam University Medical Centres (location AMC), Meibergdreef 9, Amsterdam, AZ 1105, The Netherlands; Academic Center for Dentistry Amsterdam (ACTA), University of Amsterdam, Gustav Mahlerlaan 3004, 1081 LA, Amsterdam, The Netherlands; Department of Oral and Maxillofacial Surgery, Radboud University Medical Centre Nijmegen, Nijmegen, The Netherlands
| |
Collapse
|
5
|
Langner S, Beller E, Streckenbach F. Artificial Intelligence and Big Data. Klin Monbl Augenheilkd 2020; 237:1438-1441. [PMID: 33212517 DOI: 10.1055/a-1303-6482] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/08/2023]
Abstract
Medical images play an important role in ophthalmology and radiology. Medical image analysis has greatly benefited from the application of "deep learning" techniques in clinical and experimental radiology. Clinical applications and their relevance for radiological imaging in ophthalmology are presented.
Collapse
Affiliation(s)
- Soenke Langner
- Institut für Diagnostische und Interventionelle Radiologie, Kinder- und Neuroradiologie, Universitätsmedizin Rostock, Deutschland
| | - Ebba Beller
- Institut für Diagnostische und Interventionelle Radiologie, Kinder- und Neuroradiologie, Universitätsmedizin Rostock, Deutschland
| | - Felix Streckenbach
- Institut für Diagnostische und Interventionelle Radiologie, Kinder- und Neuroradiologie, Universitätsmedizin Rostock, Deutschland
| |
Collapse
|
6
|
Kim H, Son TG, Lee J, Kim HA, Cho H, Jeong WS, Choi JW, Kim Y. Three-dimensional orbital wall modeling using paranasal sinus segmentation. J Craniomaxillofac Surg 2019; 47:959-967. [PMID: 31027858 DOI: 10.1016/j.jcms.2019.03.028] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2018] [Revised: 02/11/2019] [Accepted: 03/25/2019] [Indexed: 10/27/2022] Open
Abstract
PURPOSE Three-dimensional orbital wall modeling is a time-consuming process because of the presence of pseudoforamina. We developed an automated three-dimensional modeling software to characterize the orbital wall, and evaluated it using data from fracture patients. METHODS We first characterized the air and face regions using multiphase segmentation; the sinuses were segmented by applying morphological operations to air regions. Pseudoforamina of the orbital wall were offset with the segmented sinuses. Finally, the three-dimensional facial bone model, with orbital wall, was reconstructed from the segmented images. RESULTS Ten computed tomography data sets were used to evaluate the proposed method. Results were compared with those obtained using the active contour model and manual segmentation. The process took 31.7 ± 8.0 s, which was 30-60 times faster than other methods. The average distances between surfaces obtained with the proposed method and those obtained with manual segmentation (normal side: 0.20 ± 0.06 mm; fractured side: 0.28 ± 0.10 mm) were approximately half those obtained using the active contour model. CONCLUSIONS Three-dimensional orbital wall models, which were very similar to the manually segmented models, were archived within 1 min using the developed software, regardless of fracture presence. The proposed method might improve the safety and accuracy of surgical procedures.
Collapse
Affiliation(s)
- Hannah Kim
- Center for Bionics, Korea Institute of Science and Technology, Seoul, Republic of Korea; Division of Bio-Medical Science & Technology, KIST School, Korea University of Science and Technology, Seoul, Republic of Korea.
| | - Tae-Geun Son
- Center for Bionics, Korea Institute of Science and Technology, Seoul, Republic of Korea.
| | - Jeonghwan Lee
- Center for Bionics, Korea Institute of Science and Technology, Seoul, Republic of Korea.
| | - Hyeun A Kim
- Center for Bionics, Korea Institute of Science and Technology, Seoul, Republic of Korea.
| | - Hyunchul Cho
- Center for Bionics, Korea Institute of Science and Technology, Seoul, Republic of Korea.
| | - Woo Shik Jeong
- Department of Plastic and Reconstructive Surgery, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea.
| | - Jong Woo Choi
- Department of Plastic and Reconstructive Surgery, University of Ulsan College of Medicine, Asan Medical Center, Seoul, Republic of Korea; Biomedical Engineering Research Center, Asan Medical Center, Seoul, Republic of Korea.
| | - Youngjun Kim
- Center for Bionics, Korea Institute of Science and Technology, Seoul, Republic of Korea; Division of Bio-Medical Science & Technology, KIST School, Korea University of Science and Technology, Seoul, Republic of Korea.
| |
Collapse
|