1
|
Arok M, Brkljač B, Lugonja P, Ivošević B, Vukotić M, Nikolić Lugonja T. High resolution descriptors for UAV mapping in biodiversity conservation - A case study of sandy steppe habitat renewal. PLoS One 2025; 20:e0315399. [PMID: 40080738 PMCID: PMC11906168 DOI: 10.1371/journal.pone.0315399] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2024] [Accepted: 11/25/2024] [Indexed: 03/15/2025] Open
Abstract
Due to the large-scale disappearance of grasslands there is an urgent need for revitalization. It calls for consistent and accessible monitoring and mapping plans, and an integrated management approach. However, revitalization efforts often focus solely on the vegetation component, and skip the link to other animal species that perform vital functions as ecosystem engineers and umbrella species. In this study, we combine an in-situ standard phytocoenological survey with an UAV-based technology in the effort to improve the monitoring and mapping of the sandy steppe habitat of the European ground squirrel (Spermophilus citellus; EGS), undergoing revitalization in the northern Serbia. It is a model organism of an animal species that enables identifying habitat quality and quantity indicators to understand the broader implications of the ecosystem revitalization efforts on the wildlife populations. The proposed approach tested whether the commercially available RGB sensor and a relatively high flight height of the UAV have discriminative capacity to aid site managers by mapping identified steppe development stages (specific plant assemblages, reflecting different habitat types). Thus, a novel set of high-resolution image descriptors that are capable of discriminating plant mixtures corresponding to Fallow land, Forest steppe and shrubs, Young steppe I and II, was proposed. Despite high resolution imaging, the method solves a challenging problem of UAV vegetation mapping in the case of limited spectral and spatial information in the image (by using only RGB camera and multitemporal approach). Although the lack of visual information that would allow identification of individual plant parts and shapes prevented the use of usual object-based image analysis, proposed pixel-based descriptors and feature selection were able to provide the extent of the targeted areas and their compositional carriers. Presented holistic approach enables implementation of effective management strategies that support the entire ecological community.
Collapse
Affiliation(s)
- Maja Arok
- BioSense Institute - Research and Development Institute for Information Technologies in Biosystems, University of Novi Sad, Novi Sad, Republic of Serbia
| | - Branko Brkljač
- Department of Power, Electronic and Telecommunication Engineering, Faculty of Technical Sciences, University of Novi Sad, Novi Sad, Republic of Serbia
| | - Predrag Lugonja
- BioSense Institute - Research and Development Institute for Information Technologies in Biosystems, University of Novi Sad, Novi Sad, Republic of Serbia
| | - Bojana Ivošević
- BioSense Institute - Research and Development Institute for Information Technologies in Biosystems, University of Novi Sad, Novi Sad, Republic of Serbia
| | - Milan Vukotić
- Ranger service, Public enterprise Palić-Ludaš, Palić, Republic of Serbia
| | - Tijana Nikolić Lugonja
- BioSense Institute - Research and Development Institute for Information Technologies in Biosystems, University of Novi Sad, Novi Sad, Republic of Serbia
| |
Collapse
|
2
|
Carreras J. Celiac Disease Deep Learning Image Classification Using Convolutional Neural Networks. J Imaging 2024; 10:200. [PMID: 39194989 DOI: 10.3390/jimaging10080200] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2024] [Revised: 08/09/2024] [Accepted: 08/10/2024] [Indexed: 08/29/2024] Open
Abstract
Celiac disease (CD) is a gluten-sensitive immune-mediated enteropathy. This proof-of-concept study used a convolutional neural network (CNN) to classify hematoxylin and eosin (H&E) CD histological images, normal small intestine control, and non-specified duodenal inflammation (7294, 11,642, and 5966 images, respectively). The trained network classified CD with high performance (accuracy 99.7%, precision 99.6%, recall 99.3%, F1-score 99.5%, and specificity 99.8%). Interestingly, when the same network (already trained for the 3 class images), analyzed duodenal adenocarcinoma (3723 images), the new images were classified as duodenal inflammation in 63.65%, small intestine control in 34.73%, and CD in 1.61% of the cases; and when the network was retrained using the 4 histological subtypes, the performance was above 99% for CD and 97% for adenocarcinoma. Finally, the model added 13,043 images of Crohn's disease to include other inflammatory bowel diseases; a comparison between different CNN architectures was performed, and the gradient-weighted class activation mapping (Grad-CAM) technique was used to understand why the deep learning network made its classification decisions. In conclusion, the CNN-based deep neural system classified 5 diagnoses with high performance. Narrow artificial intelligence (AI) is designed to perform tasks that typically require human intelligence, but it operates within limited constraints and is task-specific.
Collapse
Affiliation(s)
- Joaquim Carreras
- Department of Pathology, School of Medicine, Tokai University, 143 Shimokasuya, Isehara 259-1193, Japan
| |
Collapse
|
3
|
Sharif K, David P, Omar M, Sharif Y, Patt YS, Klang E, Lahat A. Deep Learning in Coeliac Disease: A Systematic Review on Novel Diagnostic Approaches to Disease Diagnosis. J Clin Med 2023; 12:7386. [PMID: 38068436 PMCID: PMC10706988 DOI: 10.3390/jcm12237386] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Revised: 11/25/2023] [Accepted: 11/27/2023] [Indexed: 01/03/2025] Open
Abstract
BACKGROUND Coeliac disease affects approximately 1% of the global population with the diagnosis often relying on invasive and time-demanding methods. Deep learning, a powerful tool in medical science, shows potential for non-invasive, accurate coeliac disease diagnosis, though challenges remain. OBJECTIVE This systematic review aimed to evaluate the current state of deep-learning applications in coeliac disease diagnosis and identify potential areas for future research that could enhance diagnostic accuracy, sensitivity, and specificity. METHODS A systematic review was conducted using the following databases: PubMed, Embase, Web of Science, and Scopus. PRISMA guidelines were applied. Two independent reviewers identified research articles using deep learning for coeliac disease diagnosis and severity assessment. Only original research articles with performance metrics data were included. The quality of the diagnostic accuracy studies was assessed using the QUADAS-2 tool, categorizing studies based on risk of bias and concerns about applicability. Due to heterogeneity, a narrative synthesis was conducted to describe the applications and efficacy of the deep-learning techniques (DLT) in coeliac disease diagnosis. RESULTS The initial search across four databases yielded 417 studies with 195 being removed due to duplicity. Finally, eight studies were found to be suitable for inclusion after rigorous evaluation. They were all published between 2017 and 2023 and focused on using DLT for coeliac disease diagnosis or assessing disease severity. Different deep-learning architectures were applied. Accuracy levels ranged from 84% to 95.94% with the GoogLeNet model achieving 100% sensitivity and specificity for video capsule endoscopy images. CONCLUSIONS DLT hold substantial potential in coeliac disease diagnosis. They offer improved accuracy and the prospect of mitigating clinician bias. However, key challenges persist, notably the requirement for more extensive and diverse datasets, especially to detect milder forms of coeliac disease. These methods are in their nascent stages, underscoring the need of integrating multiple data sources to achieve comprehensive coeliac disease diagnosis.
Collapse
Affiliation(s)
- Kassem Sharif
- Department of Gastroenterology, Sheba Medical Centre, Ramat Gan 52621, Israel;
- Department of Internal Medicine B, Sheba Medical Centre, Ramat Gan 52621, Israel; (P.D.); (Y.S.P.)
- Faculty of Medicine, Tel Aviv University, Tel Aviv 69978, Israel; (M.O.)
| | - Paula David
- Department of Internal Medicine B, Sheba Medical Centre, Ramat Gan 52621, Israel; (P.D.); (Y.S.P.)
- Faculty of Medicine, Tel Aviv University, Tel Aviv 69978, Israel; (M.O.)
| | - Mahmud Omar
- Faculty of Medicine, Tel Aviv University, Tel Aviv 69978, Israel; (M.O.)
| | - Yousra Sharif
- Department of Internal Medicine C, Haddasah Medical Centre, Hebrew University of Jerusalem, Jerusalem 9112102, Israel;
| | - Yonatan Shneor Patt
- Department of Internal Medicine B, Sheba Medical Centre, Ramat Gan 52621, Israel; (P.D.); (Y.S.P.)
- Faculty of Medicine, Tel Aviv University, Tel Aviv 69978, Israel; (M.O.)
| | - Eyal Klang
- Faculty of Medicine, Tel Aviv University, Tel Aviv 69978, Israel; (M.O.)
- Division of Data-Driven and Digital Medicine (D3M), Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
- The Charles Bronfman Institute of Personalized Medicine, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA
- ARC Innovation Center, Sheba Medical Center, Tel Hashomer, Ramat Gan 52621, Israel
| | - Adi Lahat
- Department of Gastroenterology, Sheba Medical Centre, Ramat Gan 52621, Israel;
- Faculty of Medicine, Tel Aviv University, Tel Aviv 69978, Israel; (M.O.)
| |
Collapse
|
4
|
Detection and Classification of Colorectal Polyp Using Deep Learning. BIOMED RESEARCH INTERNATIONAL 2022; 2022:2805607. [PMID: 35463989 PMCID: PMC9033358 DOI: 10.1155/2022/2805607] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/03/2022] [Revised: 03/05/2022] [Accepted: 03/11/2022] [Indexed: 11/17/2022]
Abstract
Colorectal Cancer (CRC) is the third most dangerous cancer in the world and also increasing day by day. So, timely and accurate diagnosis is required to save the life of patients. Cancer grows from polyps which can be either cancerous or noncancerous. So, if the cancerous polyps are detected accurately and removed on time, then the dangerous consequences of cancer can be reduced to a large extent. The colonoscopy is used to detect the presence of colorectal polyps. However, manual examinations performed by experts are prone to various errors. Therefore, some researchers have utilized machine and deep learning-based models to automate the diagnosis process. However, existing models suffer from overfitting and gradient vanishing problems. To overcome these problems, a convolutional neural network- (CNN-) based deep learning model is proposed. Initially, guided image filter and dynamic histogram equalization approaches are used to filter and enhance the colonoscopy images. Thereafter, Single Shot MultiBox Detector (SSD) is used to efficiently detect and classify colorectal polyps from colonoscopy images. Finally, fully connected layers with dropouts are used to classify the polyp classes. Extensive experimental results on benchmark dataset show that the proposed model achieves significantly better results than the competitive models. The proposed model can detect and classify colorectal polyps from the colonoscopy images with 92% accuracy.
Collapse
|
5
|
Saeed T, Kiong Loo C, Shahreeza Safiruz Kassim M. Ensembles of Deep Learning Framework for Stomach Abnormalities Classification. COMPUTERS, MATERIALS & CONTINUA 2022; 70:4357-4372. [DOI: 10.32604/cmc.2022.019076] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/01/2021] [Accepted: 06/18/2021] [Indexed: 09/01/2023]
|
6
|
Tabacchi ME, Tegolo D, Cascio D, Valenti C, Sorce S, Gentile V, Taormina V, Brusca I, Magazzu G, Giuliano A, Raso G. A Fuzzy-Based Clinical Decision Support System for Coeliac Disease. IEEE ACCESS 2022; 10:102223-102236. [DOI: 10.1109/access.2022.3208903] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/03/2025]
Affiliation(s)
- M. E. Tabacchi
- Dipartimento di Matematica e Informatica, Università degli Studi di Palermo, Palermo, Italy
| | - D. Tegolo
- Dipartimento di Matematica e Informatica, Università degli Studi di Palermo, Palermo, Italy
| | - D. Cascio
- Dipartimento di Fisica e Chimica, Università degli Studi di Palermo, Palermo, Italy
| | - C. Valenti
- Dipartimento di Matematica e Informatica, Università degli Studi di Palermo, Palermo, Italy
| | - S. Sorce
- Facoltà di Ingegneria e Architettura, Università degli Studi di Enna ‘‘Kore,’’, Enna, Italy
| | - V. Gentile
- Dipartimento di Fisica e Chimica, Università degli Studi di Palermo, Palermo, Italy
| | - V. Taormina
- Dipartimento di Matematica e Informatica, Università degli Studi di Palermo, Palermo, Italy
| | - I. Brusca
- Ospedale Fatebenefratelli, Buccheri La Ferla, Palermo, Italy
| | - G. Magazzu
- Dipartimento di Patologia Umana dell’adulto e dell’età evolutiva, Università di Messina, Messina, Italy
| | | | - G. Raso
- Dipartimento di Fisica e Chimica, Università degli Studi di Palermo, Palermo, Italy
| |
Collapse
|
7
|
Yang Y, Li YX, Yao RQ, Du XH, Ren C. Artificial intelligence in small intestinal diseases: Application and prospects. World J Gastroenterol 2021; 27:3734-3747. [PMID: 34321840 PMCID: PMC8291013 DOI: 10.3748/wjg.v27.i25.3734] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/25/2021] [Revised: 04/09/2021] [Accepted: 05/08/2021] [Indexed: 02/06/2023] Open
Abstract
The small intestine is located in the middle of the gastrointestinal tract, so small intestinal diseases are more difficult to diagnose than other gastrointestinal diseases. However, with the extensive application of artificial intelligence in the field of small intestinal diseases, with its efficient learning capacities and computational power, artificial intelligence plays an important role in the auxiliary diagnosis and prognosis prediction based on the capsule endoscopy and other examination methods, which improves the accuracy of diagnosis and prediction and reduces the workload of doctors. In this review, a comprehensive retrieval was performed on articles published up to October 2020 from PubMed and other databases. Thereby the application status of artificial intelligence in small intestinal diseases was systematically introduced, and the challenges and prospects in this field were also analyzed.
Collapse
Affiliation(s)
- Yu Yang
- Department of General Surgery, Chinese People’s Liberation Army General Hospital, Beijing 100853, China
| | - Yu-Xuan Li
- Department of General Surgery, Chinese People’s Liberation Army General Hospital, Beijing 100853, China
| | - Ren-Qi Yao
- Trauma Research Center, The Fourth Medical Center and Medical Innovation Research Division of the Chinese People‘s Liberation Army General Hospital, Beijing 100048, China
- Department of Burn Surgery, Changhai Hospital, Naval Medical University, Shanghai 200433, China
| | - Xiao-Hui Du
- Department of General Surgery, Chinese People’s Liberation Army General Hospital, Beijing 100853, China
| | - Chao Ren
- Trauma Research Center, The Fourth Medical Center and Medical Innovation Research Division of the Chinese People‘s Liberation Army General Hospital, Beijing 100048, China
| |
Collapse
|
8
|
Wimmer G, Häfner M, Uhl A. Improving CNN training on endoscopic image data by extracting additionally training data from endoscopic videos. Comput Med Imaging Graph 2020; 86:101798. [PMID: 33075676 DOI: 10.1016/j.compmedimag.2020.101798] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2019] [Revised: 06/23/2020] [Accepted: 09/24/2020] [Indexed: 02/07/2023]
Abstract
In this work we present a technique to deal with one of the biggest problems for the application of convolutional neural networks (CNNs) in the area of computer assisted endoscopic image diagnosis, the insufficient amount of training data. Based on patches from endoscopic images of colonic polyps with given label information, our proposed technique acquires additional (labeled) training data by tracking the area shown in the patches through the corresponding endoscopic videos and by extracting additional image patches from frames of these areas. So similar to the widely used augmentation strategies, additional training data is produced by adding images with different orientations, scales and points of view than the original images. However, contrary to augmentation techniques, we do not artificially produce image data but use real image data from videos under different image recording conditions (different viewpoints and image qualities). By means of our proposed method and by filtering out all extracted images with insufficient image quality, we are able to increase the amount of labeled image data by factor 39. We will show that our proposed method clearly and continuously improves the performance of CNNs.
Collapse
Affiliation(s)
- Georg Wimmer
- University of Salzburg, Department of Computer Sciences, Jakob-Haringerstrasse 2, Salzburg 5020, Austria.
| | - Michael Häfner
- Department of Gastroenterologie and Hepatologie, St. Elisabeth Hospital, Landstraßer Hauptstraße 4a, Wien A-1030, Austria
| | - Andreas Uhl
- University of Salzburg, Department of Computer Sciences, Jakob-Haringerstrasse 2, Salzburg 5020, Austria
| |
Collapse
|
9
|
Molder A, Balaban DV, Jinga M, Molder CC. Current Evidence on Computer-Aided Diagnosis of Celiac Disease: Systematic Review. Front Pharmacol 2020; 11:341. [PMID: 32372947 PMCID: PMC7179080 DOI: 10.3389/fphar.2020.00341] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2019] [Accepted: 03/09/2020] [Indexed: 02/05/2023] Open
Abstract
Celiac disease (CD) is a chronic autoimmune disease that occurs in genetically predisposed individuals in whom the ingestion of gluten leads to damage of the small bowel. It is estimated to affect 1 in 100 people worldwide, but is severely underdiagnosed. Currently available guidelines require CD-specific serology and atrophic histology in duodenal biopsy samples for the diagnosis of adult CD. In pediatric CD, but in recent years in adults also, nonbioptic diagnostic strategies have become increasingly popular. In this setting, in order to increase the diagnostic rate of this pathology, endoscopy itself has been thought of as a case finding strategy by use of digital image processing techniques. Research focused on computer aided decision support used as database video capsule, endoscopy and even biopsy duodenal images. Early automated methods for diagnosis of celiac disease used feature extraction methods like spatial domain features, transform domain features, scale-invariant features and spatio-temporal features. Recent artificial intelligence (AI) techniques using deep learning (DL) methods such as convolutional neural network (CNN), support vector machines (SVM) or Bayesian inference have emerged as a breakthrough computer technology which can be used for computer aided diagnosis of celiac disease. In the current review we summarize methods used in clinical studies for classification of CD from feature extraction methods to AI techniques.
Collapse
Affiliation(s)
- Adriana Molder
- Carol Davila University of Medicine and Pharmacy, Bucharest, Romania
- Center of Excellence in Robotics and Autonomous Systems, Military Technical Academy Ferdinand I, Bucharest, Romania
| | - Daniel Vasile Balaban
- Carol Davila University of Medicine and Pharmacy, Bucharest, Romania
- Gastroenterology Department, Dr. Carol Davila Central Military Emergency University Hospital, Bucharest, Romania
| | - Mariana Jinga
- Carol Davila University of Medicine and Pharmacy, Bucharest, Romania
- Gastroenterology Department, Dr. Carol Davila Central Military Emergency University Hospital, Bucharest, Romania
| | - Cristian-Constantin Molder
- Center of Excellence in Robotics and Autonomous Systems, Military Technical Academy Ferdinand I, Bucharest, Romania
| |
Collapse
|
10
|
Ye S, Nedzvedz A, Ye F, Ablameyko S. Segmentation and Feature Extraction of Endoscopic Images for Making Diagnosis of Acute Appendicitis. PATTERN RECOGNITION AND IMAGE ANALYSIS 2019. [DOI: 10.1134/s1054661819040205] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|