1
|
Moradi M, Du X, Huan T, Chen Y. Feasibility of the soft attention-based models for automatic segmentation of OCT kidney images. BIOMEDICAL OPTICS EXPRESS 2022; 13:2728-2738. [PMID: 35774323 PMCID: PMC9203082 DOI: 10.1364/boe.449942] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/29/2021] [Revised: 01/22/2022] [Accepted: 02/18/2022] [Indexed: 06/15/2023]
Abstract
Clinically, optical coherence tomography (OCT) has been utilized to obtain the images of the kidney's proximal convoluted tubules (PCTs), which can be used to quantify the morphometric parameters such as tubular density and diameter. Such parameters are useful for evaluating the status of the donor kidney for transplant. Quantifying PCTs from OCT images by human readers is a time-consuming and tedious process. Despite the fact that conventional deep learning models such as conventional neural networks (CNNs) have achieved great success in the automatic segmentation of kidney OCT images, gaps remain regarding the segmentation accuracy and reliability. Attention-based deep learning model has benefits over regular CNNs as it is intended to focus on the relevant part of the image and extract features for those regions. This paper aims at developing an Attention-based UNET model for automatic image analysis, pattern recognition, and segmentation of kidney OCT images. We evaluated five methods including the Residual-Attention-UNET, Attention-UNET, standard UNET, Residual UNET, and fully convolutional neural network using 14403 OCT images from 169 transplant kidneys for training and testing. Our results show that Residual-Attention-UNET outperformed the other four methods in segmentation by showing the highest values of all the six metrics including dice score (0.81 ± 0.01), intersection over union (IOU, 0.83 ± 0.02), specificity (0.84 ± 0.02), recall (0.82 ± 0.03), precision (0.81 ± 0.01), and accuracy (0.98 ± 0.08). Our results also show that the performance of the Residual-Attention-UNET is equivalent to the human manual segmentation (dice score = 0.84 ± 0.05). Residual-Attention-UNET and Attention-UNET also demonstrated good performance when trained on a small dataset (3456 images) whereas the performance of the other three methods dropped dramatically. In conclusion, our results suggested that the soft Attention-based models and specifically Residual-Attention-UNET are powerful and reliable methods for tubule lumen identification and segmentation and can help clinical evaluation of transplant kidney viability as fast and accurate as possible.
Collapse
Affiliation(s)
- Mousa Moradi
- Department of Biomedical Engineering, University of Massachusetts, Amherst, MA 01003, USA
- Institute for Applied Life Sciences, University of Massachusetts, Amherst, MA 01003, USA
| | - Xian Du
- Institute for Applied Life Sciences, University of Massachusetts, Amherst, MA 01003, USA
- Department of Mechanical and Industrial Engineering, University of Massachusetts, Amherst, MA 01003, USA
| | - Tianxiao Huan
- Department of Ophthalmology & Visual Sciences, University of Massachusetts Chan Medical School, Worcester, MA 01655, USA
| | - Yu Chen
- Department of Biomedical Engineering, University of Massachusetts, Amherst, MA 01003, USA
- Institute for Applied Life Sciences, University of Massachusetts, Amherst, MA 01003, USA
| |
Collapse
|
2
|
Liang X, Xu X, Wang Z, He L, Zhang K, Liang B, Ye J, Shi J, Wu X, Dai M, Yang W. StomataScorer: a portable and high-throughput leaf stomata trait scorer combined with deep learning and an improved CV model. PLANT BIOTECHNOLOGY JOURNAL 2022; 20:577-591. [PMID: 34717024 PMCID: PMC8882810 DOI: 10.1111/pbi.13741] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/08/2021] [Revised: 09/26/2021] [Accepted: 10/16/2021] [Indexed: 05/05/2023]
Abstract
To measure stomatal traits automatically and nondestructively, a new method for detecting stomata and extracting stomatal traits was proposed. Two portable microscopes with different resolutions (TipScope with a 40× lens attached to a smartphone and ProScope HR2 with a 400× lens) are used to acquire images of living stomata in maize leaves. FPN model was used to detect stomata in the TipScope images and measure the stomata number and stomatal density. Faster RCNN model was used to detect opening and closing stomata in the ProScope HR2 images, and the number of opening and closing stomata was measured. An improved CV model was used to segment pores of opening stomata, and a total of 6 pore traits were measured. Compared to manual measurements, the square of the correlation coefficient (R2 ) of the 6 pore traits was higher than 0.85, and the mean absolute percentage error (MAPE) of these traits was 0.02%-6.34%. The dynamic stomata changes between wild-type B73 and mutant Zmfab1a were explored under drought and re-watering condition. The results showed that Zmfab1a had a higher resilience than B73 on leaf stomata. In addition, the proposed method was tested to measure the leaf stomatal traits of other nine species. In conclusion, a portable and low-cost stomata phenotyping method that could accurately and dynamically measure the characteristic parameters of living stomata was developed. An open-access and user-friendly web portal was also developed which has the potential to be used in the stomata phenotyping of large populations in the future.
Collapse
Affiliation(s)
- Xiuying Liang
- National Key Laboratory of Crop Genetic ImprovementNational Center of Plant Gene Research (Wuhan)College of EngineeringHuazhong Agricultural UniversityWuhanChina
| | - Xichen Xu
- National Key Laboratory of Crop Genetic ImprovementNational Center of Plant Gene Research (Wuhan)College of EngineeringHuazhong Agricultural UniversityWuhanChina
| | - Zhiwei Wang
- National Key Laboratory of Crop Genetic ImprovementNational Center of Plant Gene Research (Wuhan)College of EngineeringHuazhong Agricultural UniversityWuhanChina
| | - Lei He
- National Key Laboratory of Crop Genetic ImprovementNational Center of Plant Gene Research (Wuhan)College of EngineeringHuazhong Agricultural UniversityWuhanChina
| | - Kaiqi Zhang
- National Key Laboratory of Crop Genetic ImprovementNational Center of Plant Gene Research (Wuhan)College of EngineeringHuazhong Agricultural UniversityWuhanChina
| | - Bo Liang
- National Key Laboratory of Crop Genetic ImprovementNational Center of Plant Gene Research (Wuhan)College of EngineeringHuazhong Agricultural UniversityWuhanChina
| | - Junli Ye
- National Key Laboratory of Crop Genetic ImprovementNational Center of Plant Gene Research (Wuhan)College of EngineeringHuazhong Agricultural UniversityWuhanChina
| | - Jiawei Shi
- National Key Laboratory of Crop Genetic ImprovementNational Center of Plant Gene Research (Wuhan)College of EngineeringHuazhong Agricultural UniversityWuhanChina
| | - Xi Wu
- National Key Laboratory of Crop Genetic ImprovementNational Center of Plant Gene Research (Wuhan)College of EngineeringHuazhong Agricultural UniversityWuhanChina
| | - Mingqiu Dai
- National Key Laboratory of Crop Genetic ImprovementNational Center of Plant Gene Research (Wuhan)College of EngineeringHuazhong Agricultural UniversityWuhanChina
| | - Wanneng Yang
- National Key Laboratory of Crop Genetic ImprovementNational Center of Plant Gene Research (Wuhan)College of EngineeringHuazhong Agricultural UniversityWuhanChina
- Shenzhen BranchGuangdong Laboratory for Lingnan Modern AgricultureGenome Analysis Laboratory of the Ministry of AgricultureAgricultural Genomics Institute at ShenzhenChinese Academy of Agricultural SciencesShenzhenChina
| |
Collapse
|
3
|
Abdurashitov AS, Prikhozhdenko ES, Mayorova OA, Plastun VO, Gusliakova OI, Shushunova NA, Kulikov OA, Tuchin VV, Sukhorukov GB, Sindeeva OA. Optical coherence microangiography of the mouse kidney for diagnosis of circulatory disorders. BIOMEDICAL OPTICS EXPRESS 2021; 12:4467-4477. [PMID: 34457426 PMCID: PMC8367229 DOI: 10.1364/boe.430393] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/30/2021] [Revised: 06/17/2021] [Accepted: 06/20/2021] [Indexed: 05/02/2023]
Abstract
Optical coherence tomography (OCT) has become widespread in clinical applications in which precise three-dimensional functional imaging of living organs is required. Nevertheless, the kidney is inaccessible for the high resolution OCT imaging due to a high light attenuation coefficient of skin and soft tissues that significantly limits the penetration depth of the probing laser beam. Here, we introduce a surgical protocol and fixation scheme that enables functional visualization of kidney's peritubular capillaries via OCT microangiography. The model of reversible/irreversible glomerulus embolization using drug microcarriers confirms the ability of OCT to detect circulatory disorders. This approach can be used for choosing optimal carriers, their dosages and diagnosis of other blood flow pathologies.
Collapse
Affiliation(s)
- Arkady S Abdurashitov
- Skolkovo Institute of Science and Technology, Skolkovo Innovation Center, 3 Nobel str., Moscow 143005, Russia
| | | | - Oksana A Mayorova
- Science Medical Center, Saratov State University, 83 Astrakhanskaya str., Saratov 410012, Russia
| | - Valentina O Plastun
- Science Medical Center, Saratov State University, 83 Astrakhanskaya str., Saratov 410012, Russia
| | - Olga I Gusliakova
- Science Medical Center, Saratov State University, 83 Astrakhanskaya str., Saratov 410012, Russia
| | - Natalia A Shushunova
- Science Medical Center, Saratov State University, 83 Astrakhanskaya str., Saratov 410012, Russia
| | - Oleg A Kulikov
- Ogarev Mordovia State University, 68 Bolshevistskaya str., Saransk 430005, Russia
| | - Valery V Tuchin
- Science Medical Center, Saratov State University, 83 Astrakhanskaya str., Saratov 410012, Russia
- Interdisciplinary Laboratory of Biophotonics, National Research Tomsk State University, 36 Lenina Avenue, Tomsk 634050, Russia
- Laboratory of Laser Diagnostics of Technical and Living Systems, Institute of Precision Mechanics and Control of the Russian Academy of Science, 24 Rabochaya Str., Saratov 410028, Russia
| | - Gleb B Sukhorukov
- Skolkovo Institute of Science and Technology, Skolkovo Innovation Center, 3 Nobel str., Moscow 143005, Russia
- School of Engineering and Materials Science, Queen Mary University of London, Mile End, Eng, 215, London E1 4NS, United Kingdom
| | - Olga A Sindeeva
- Skolkovo Institute of Science and Technology, Skolkovo Innovation Center, 3 Nobel str., Moscow 143005, Russia
- Science Medical Center, Saratov State University, 83 Astrakhanskaya str., Saratov 410012, Russia
| |
Collapse
|