1
|
Khatun Z, Jónsson H, Tsirilaki M, Maffulli N, Oliva F, Daval P, Tortorella F, Gargiulo P. Beyond pixel: Superpixel-based MRI segmentation through traditional machine learning and graph convolutional network. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2024; 256:108398. [PMID: 39236562 DOI: 10.1016/j.cmpb.2024.108398] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/06/2024] [Revised: 08/21/2024] [Accepted: 08/25/2024] [Indexed: 09/07/2024]
Abstract
BACKGROUND AND OBJECTIVE Tendon segmentation is crucial for studying tendon-related pathologies like tendinopathy, tendinosis, etc. This step further enables detailed analysis of specific tendon regions using automated or semi-automated methods. This study specifically aims at the segmentation of Achilles tendon, the largest tendon in the human body. METHODS This study proposes a comprehensive end-to-end tendon segmentation module composed of a preliminary superpixel-based coarse segmentation preceding the final segmentation task. The final segmentation results are obtained through two distinct approaches. In the first approach, the coarsely generated superpixels are subjected to classification using Random Forest (RF) and Support Vector Machine (SVM) classifiers to classify whether each superpixel belongs to a tendon class or not (resulting in tendon segmentation). In the second approach, the arrangements of superpixels are converted to graphs instead of being treated as conventional image grids. This classification process uses a graph-based convolutional network (GCN) to determine whether each superpixel corresponds to a tendon class or not. RESULTS All experiments are conducted on a custom-made ankle MRI dataset. The dataset comprises 76 subjects and is divided into two sets: one for training (Dataset 1, trained and evaluated using leave-one-group-out cross-validation) and the other as unseen test data (Dataset 2). Using our first approach, the final test AUC (Area Under the ROC Curve) scores using RF and SVM classifiers on the test data (Dataset 2) are 0.992 and 0.987, respectively, with sensitivities of 0.904 and 0.966. On the other hand, using our second approach (GCN-based node classification), the AUC score for the test set is 0.933 with a sensitivity of 0.899. CONCLUSIONS Our proposed pipeline demonstrates the efficacy of employing superpixel generation as a coarse segmentation technique for the final tendon segmentation. Whether utilizing RF, SVM-based superpixel classification, or GCN-based classification for tendon segmentation, our system consistently achieves commendable AUC scores, especially the non-graph-based approach. Given the limited dataset, our graph-based method did not perform as well as non-graph-based superpixel classifications; however, the results obtained provide valuable insights into how well the models can distinguish between tendons and non-tendons. This opens up opportunities for further exploration and improvement.
Collapse
Affiliation(s)
- Zakia Khatun
- Department of Information and Electrical Engineering and Applied Mathematics, University of Salerno, Salerno, Italy; Institute of Biomedical and Neural Engineering, Department of Engineering, Reykjavik University, Reykjavik, Iceland.
| | - Halldór Jónsson
- Department of Orthopaedics, Landspitali University Hospital, Reykjavik, Iceland
| | - Mariella Tsirilaki
- Department of Radiology, Landspitali University Hospital, Reykjavik, Iceland
| | - Nicola Maffulli
- Department of Trauma and Orthopaedic Surgery, Faculty of Medicine and Psychology, University Hospital Sant'Andrea, University La Sapienza, Rome, Italy; School of Pharmacy and Bioengineering, Faculty of Medicine, Keele University, ST4 7QB Stoke on Trent, England; Queen Mary University of London, Barts and the London School of Medicine and Dentistry, Centre for Sports and Exercise Medicine, Mile End Hospital, London, England
| | - Francesco Oliva
- Department of Human Sciences and Promotion of the Quality of Life, San Raffaele Roma Open University, Rome, Italy
| | - Pauline Daval
- Biomedical Department, École Polytechnique Universitaire d'Aix-Marseille, Marseille, France
| | - Francesco Tortorella
- Department of Information and Electrical Engineering and Applied Mathematics, University of Salerno, Salerno, Italy
| | - Paolo Gargiulo
- Institute of Biomedical and Neural Engineering, Department of Engineering, Reykjavik University, Reykjavik, Iceland; Department of Science, Landspitali University Hospital, Reykjavik, Iceland
| |
Collapse
|
2
|
Zeng P, Liu S, He S, Zheng Q, Wu J, Liu Y, Lyu G, Liu P. TUSPM-NET: A multi-task model for thyroid ultrasound standard plane recognition and detection of key anatomical structures of the thyroid. Comput Biol Med 2023; 163:107069. [PMID: 37364531 DOI: 10.1016/j.compbiomed.2023.107069] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Revised: 04/21/2023] [Accepted: 05/27/2023] [Indexed: 06/28/2023]
Abstract
The thyroid gland is a vital gland located in the anterior part of the neck. Ultrasound imaging of the thyroid gland is a non-invasive and widely used technique for diagnosing nodular growth, inflammation, and enlargement of the thyroid gland. In ultrasonography, the acquisition of ultrasound standard planes is crucial for disease diagnosis. However, the acquisition of standard planes in ultrasound examinations can be subjective, laborious and heavily reliant on the sonographer's clinical experience. To overcome these challenges, we design a multi-task model TUSP Multi-task Network (TUSPM-NET) that can recognize Thyroid Ultrasound Standard Plane (TUSP) and detect key anatomical structures in TUSPs in real-time. To improve TUSPM-NET's accuracy and learn prior knowledge in medical images, we proposed the plane target classes loss function and the plane targets position filter. Additionally, we collected 9778 TUSP images of 8 standard planes to train and validate the model. Experiments have shown that TUSPM-NET can accurately detect anatomical structures in TUSPs and recognize TUSP images. Compared to current models with better performance, TUSPM-NET's object detection map@0.5:0.95 improves by 9.3%; the precision and recall of plane recognition improve by 3.49% and 4.39%, respectively. Furthermore, TUSPM-NET recognizes and detects a TUSP image in just 19.9 ms, which means that the method is well suited to the needs of real-time clinical scanning.
Collapse
Affiliation(s)
- Pan Zeng
- School of Medicine, Huaqiao University, Quanzhou, 362021, China
| | - Shunlan Liu
- Department of Ultrasonics, The Second Affiliated Hospital of Fujian Medical University, Quanzhou, China
| | - Shaozheng He
- Department of Ultrasonics, The Second Affiliated Hospital of Fujian Medical University, Quanzhou, China
| | - Qingyu Zheng
- Department of Ultrasonics, The Second Affiliated Hospital of Fujian Medical University, Quanzhou, China
| | - Jiaxiang Wu
- Quanzhou Medical College, Quanzhou, 362000, China
| | - Yao Liu
- College of Scienceand Engineering, National Quemoy University, Kinmen, 89250, Taiwan.
| | - Guorong Lyu
- Department of Ultrasonics, The Second Affiliated Hospital of Fujian Medical University, Quanzhou, China; Quanzhou Medical College, Quanzhou, 362000, China.
| | - Peizhong Liu
- School of Medicine, Huaqiao University, Quanzhou, 362021, China; Quanzhou Medical College, Quanzhou, 362000, China; College of Engineering, Huaqiao University, Quanzhou, 362021, China.
| |
Collapse
|
3
|
A survey on regional level set image segmentation models based on the energy functional similarity measure. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2020.07.141] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
|
4
|
Yin J, Zhu X. Research on Sensitivity of Speckle Center Coordinate Values by Contour and Background Noise and Elimination Method. INT J PATTERN RECOGN 2020. [DOI: 10.1142/s0218001420550149] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
The accuracy of measuring the target object displacement is greatly influenced by the offset of central coordinate value in a laser speckle contour (CCVLSC) due to the defects obtained in background or on measuring surface, as a measuring combination of both monocular vision and laser speckle is used. In this paper, the theoretical principle of displacement measurement is first presented by a combination of monocular vision and laser speckle. Then, a model between object displacement and CCVLSC (particularly, [Formula: see text] coordinate value) is derived. Finally, a denoising algorithm with competitive protection of contour effective points is proposed, on the basis of effects of noises coming from background and contour edge on CCVLSC. The algorithm includes ellipse fitting to laser speckle contour, calculating offsets between all contour points and the fitted eclipse, eliminating noise points with higher deviation (generally about 5% of all contour points) by using competitive strategy, ellipse refitting, and recalculating and re-eliminating until the deviation is below a specified threshold. It is shown that the algorithm can not only eliminate the fixed noise points in each round but also protect the number of effective points to the greatest extent. Finally, the feasibility of the algorithm is verified by two ways. One is an ideal data validation. It proves that the algorithm can guarantee the convergence towards the ideal center coordinate value. Another is an experimental verification. An experimental system is built up based on the relationship between object displacement and Y coordinate value of CCVLSC for obtaining relevant dada. It is shown by the comparison between predictions and experimental data that the algorithm has a better robustness and a higher accuracy of distance measurement than other typical algorithms.
Collapse
Affiliation(s)
- Junyao Yin
- College of Mechanical Engineering, Yangzhou University, West Road 196, Huayang, Yangzhou 225127, P. R. China
| | - Xinglong Zhu
- College of Mechanical Engineering, Yangzhou University, West Road 196, Huayang, Yangzhou 225127, P. R. China
| |
Collapse
|
5
|
Kuok CP, Yang TH, Tsai BS, Jou IM, Horng MH, Su FC, Sun YN. Segmentation of finger tendon and synovial sheath in ultrasound image using deep convolutional neural network. Biomed Eng Online 2020; 19:24. [PMID: 32321523 PMCID: PMC7178953 DOI: 10.1186/s12938-020-00768-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2019] [Accepted: 04/11/2020] [Indexed: 01/08/2023] Open
Abstract
BACKGROUND Trigger finger is a common hand disease, which is caused by a mismatch in diameter between the tendon and the pulley. Ultrasound images are typically used to diagnose this disease, which are also used to guide surgical treatment. However, background noise and unclear tissue boundaries in the images increase the difficulty of the process. To overcome these problems, a computer-aided tool for the identification of finger tissue is needed. RESULTS Two datasets were used for evaluation: one comprised different cases of individual images and another consisting of eight groups of continuous images. Regarding result similarity and contour smoothness, our proposed deeply supervised dilated fully convolutional DenseNet (D2FC-DN) is better than ATASM (the state-of-art segmentation method) and representative CNN methods. As a practical application, our proposed method can be used to build a tendon and synovial sheath model that can be used in a training system for ultrasound-guided trigger finger surgery. CONCLUSION We proposed a D2FC-DN for finger tendon and synovial sheath segmentation in ultrasound images. The segmentation results were remarkably accurate for two datasets. It can be applied to assist the diagnosis of trigger finger by highlighting the tissues and generate models for surgical training systems in the future. METHODS We propose a novel finger tendon segmentation method for use with ultrasound images that can also be used for synovial sheath segmentation that yields a more complete description for analysis. In this study, a hybrid of effective convolutional neural network techniques are applied, resulting in a deeply supervised dilated fully convolutional DenseNet (D2FC-DN), which displayed excellent segmentation performance on the tendon and synovial sheath.
Collapse
Affiliation(s)
- Chan-Pang Kuok
- Department of Computer Science and Information Engineering, 1 University Road, Tainan, 701, Taiwan
- MOST AI Biomedical Research Center, 1 University Road, Tainan, 701, Taiwan
| | - Tai-Hua Yang
- Department of Biomedical Engineering, National Cheng Kung University, 1 University Road, Tainan, 701, Taiwan
- Department of Orthopaedic Surgery, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, 1 University Road, Tainan, Taiwan
- Medical Device Innovation Center, National Cheng Kung University, 1 University Road, Tainan, 701, Taiwan
| | - Bo-Siang Tsai
- Department of Computer Science and Information Engineering, 1 University Road, Tainan, 701, Taiwan
| | - I-Ming Jou
- Department of Orthopedics, E-Da Hospital, 1 Yida Road, Jiaosu Village, Yanchao District, Kaohsiung City, 82445, Taiwan
| | - Ming-Huwi Horng
- Department of Computer Science and Information Engineering, National Pingtung University, 4-18 Minsheng Road, Pingtung City, Pingtung County, 90003, Taiwan
- MOST AI Biomedical Research Center, 1 University Road, Tainan, 701, Taiwan
| | - Fong-Chin Su
- Department of Biomedical Engineering, National Cheng Kung University, 1 University Road, Tainan, 701, Taiwan
| | - Yung-Nien Sun
- Department of Computer Science and Information Engineering, 1 University Road, Tainan, 701, Taiwan.
- MOST AI Biomedical Research Center, 1 University Road, Tainan, 701, Taiwan.
| |
Collapse
|