Integrating deep learning with non-destructive thermal imaging for precision guava ripeness determination

BACKGROUND

To mitigate post-harvest losses and inform harvesting decisions at the same time as ensuring fruit quality, precise ripeness determination is essential. The complexity arises in assessing guava ripeness as a result of subtle alterations in some varieties during the ripening process, making visual assessment less reliable. The present study proposes a non-destructive method employing thermal imaging for guava ripeness assessment, involving obtaining thermal images of guava samples at different ripeness stages, followed by data pre-processing. Five deep learning models (AlexNet, Inception-v3, GoogLeNet, ResNet-50 and VGGNet-16) were applied, and their performances were systematically evaluated and compared.

RESULTS

VGGNet-16 demonstrated outstanding performance, achieving average precision of 0.92, average sensitivity of 0.93, average specificity of 0.96, average F1-score of 0.92 and accuracy of 0.92 within a training duration of 484 s.

CONCLUSION

The present study presents a scalable and non-destructive approach for guava ripeness determination, contributing to waste reduction and enhancing efficiency in supply chains and fruit production. These initiatives align with environmentally friendly practices in agriculture. © 2024 Society of Chemical Industry.

Development of an Automated Morphometric Approach to Assess Vascular Outcomes following Exposure to Environmental Chemicals in Zebrafish

BACKGROUND

Disruptions in vascular formation attributable to chemical insults is a pivotal risk factor or potential etiology of developmental defects and various disease settings. Among the thousands of chemicals threatening human health, the highly concerning groups prevalent in the environment and detected in biological monitoring in the general population ought to be prioritized because of their high exposure risks. However, the impacts of a large number of environmental chemicals on vasculature are far from understood. The angioarchitecture complexity and technical limitations make it challenging to analyze the entire vasculature efficiently and identify subtle changes through a high-throughput in vivo assay.

OBJECTIVES

We aimed to develop an automated morphometric approach for the vascular profile and assess the vascular morphology of health-concerning environmental chemicals.

METHODS

High-resolution images of the entire vasculature in Tg(fli1a:eGFP) zebrafish were collected using a high-content imaging platform. We established a deep learning-based quantitative framework, ECA-ResXUnet, combined with MATLAB to segment the vascular networks and extract features. Vessel scores based on the rates of morphological changes were calculated to rank vascular toxicity. Potential biomarkers were identified by vessel-endothelium-gene-disease integrative analysis.

RESULTS

Whole-trunk blood vessels and the cerebral vasculature in larvae exposed to 150 representative chemicals were automatically segmented as comparable to human-level accuracy, with sensitivity and specificity of 95.56% and 95.81%, respectively. Chemical treatments led to heterogeneous vascular patterns manifested by 31 architecture indexes, and the common cardinal vein (CCV) was the most affected vessel. The antipsychotic medicine haloperidol, flame retardant 2,2-bis(chloromethyl)trimethylenebis[bis(2-chloroethyl) phosphate], and tert-butylphenyl diphenyl phosphate ranked as the top three in vessel scores. Pesticides accounted for the largest group, with a vessel score of ≥ 1 , characterized by a remarkable inhibition of subintestinal venous plexus and delayed development of CCV. Multiple-concentration evaluation of nine per- and polyfluoroalkyl substances (PFAS) indicated a low-concentration effect on vascular impairment and a positive association between carbon chain length and benchmark concentration. Target vessel-directed single-cell RNA sequencing of f l i 1 a + cells from larvae treated with λ -cyhalothrin , perfluorohexanesulfonic acid, or benzylbutyl phthalate, along with vessel-endothelium-gene-disease integrative analysis, uncovered potential associations with vascular disorders and identified biomarker candidates.

DISCUSSION

This study provides a novel paradigm for phenotype-driven screenings of vascular-disrupting chemicals by converging morphological and transcriptomic profiles at a high-resolution level, serving as a powerful tool for large-scale toxicity tests. Our approach and the high-quality morphometric data facilitate the precise evaluation of vascular effects caused by environmental chemicals. https://doi.org/10.1289/EHP13214.

TMM: A comprehensive CAD system for hepatic fibrosis 5-grade METAVIR staging based on liver MRI

BACKGROUND

Precise staging of hepatic fibrosis with MRI is necessary as it can assist precision medicine. Computer aided diagnosis (CAD) system with distinguishing radiomics features and radiologists domain knowledge is expected to obtain 5-grade meta-analysis of histological data in viral hepatitis (METAVIR) staging.

PURPOSE

This study aims to obtain the precise staging of hepatic fibrosis based on MRI as it predicts the risk of future liver-related morbidity and the need for treatment, monitoring and surveillance. Based on METAVIR score, fibrosis can be divided into five stages. Most previous researches focus on binary classification, such as cirrhosis versus non-cirrhosis, early versus advanced fibrosis, and substantial fibrosis or not. In this paper, a comprehensive CAD system TMM is proposed to precisely class hepatic fibrosis into five stages for precision medicine instead of the common binary classification.

METHODS

We propose a novel hepatic fibrosis staging CAD system TMM which includes three modules, Two-level Image Statistical Radiomics Feature (TISRF), Monotonic Error Correcting Output Codes (MECOC) and Monotone Multiclassification with Deep Forest (MMDF). TISRF extracts radiomics features for distinguishing different hepatic fibrosis stages. MECOC is proposed to encode monotonic multiclass by making full use of the progressive severity of hepatic fibrosis and increase the fault tolerance and error correction ability. MMDF combines multiple Deep Forest network to ensure the final five-class classification, which can achieve more precise classification than the common binary classification. The performance of the proposed hepatic fibrosis CAD system is tested on the hepatic data collected from our rabbits models of fibrosis.

RESULTS

A total of 140 regions of interest (ROI) are selected from MRI T1W of liver fibrosis models in 35 rabbits with F0(n = 16), F1(n = 28), F2(n = 29), F3(n = 44) and F4(n = 23). The performance is evaluated by five-fold cross-validation. TMM can achieve the highest total accuracy of 72.14% for five fibrosis stages compared with other popular classifications. To make a comprehensive comparison, a binary classification experiment have been carried out.

CONCLUSIONS

T1WI can obtain precise staging of hepatic fibrosis with the help of comprehensive CAD including radiomics features extraction inspired by radiologists, monotonic multiclass according to the severity of hepatic fibrosis, and deep learning classification.

Wavelet radiomics features from multiphase CT images for screening hepatocellular carcinoma: analysis and comparison

Early detection of liver malignancy based on medical image analysis plays a crucial role in patient prognosis and personalized treatment. This task, however, is challenging due to several factors, including medical data scarcity and limited training samples. This paper presents a study of three important aspects of radiomics feature from multiphase computed tomography (CT) for classifying hepatocellular carcinoma (HCC) and other focal liver lesions: wavelet-transformed feature extraction, relevant feature selection, and radiomics features-based classification under the inadequate training samples. Our analysis shows that combining radiomics features extracted from the wavelet and original CT domains enhance the classification performance significantly, compared with using those extracted from the wavelet or original domain only. To facilitate the multi-domain and multiphase radiomics feature combination, we introduce a logistic sparsity-based model for feature selection with Bayesian optimization and find that the proposed model yields more discriminative and relevant features than several existing methods, including filter-based, wrapper-based, or other model-based techniques. In addition, we present analysis and performance comparison with several recent deep convolutional neural network (CNN)-based feature models proposed for hepatic lesion diagnosis. The results show that under the inadequate data scenario, the proposed wavelet radiomics feature model produces comparable, if not higher, performance metrics than the CNN-based feature models in terms of area under the curve.

Performance and clinical applicability of machine learning in liver computed tomography imaging: a systematic review

OBJECTIVES

Machine learning (ML) for medical imaging is emerging for several organs and image modalities. Our objectives were to provide clinicians with an overview of this field by answering the following questions: (1) How is ML applied in liver computed tomography (CT) imaging? (2) How well do ML systems perform in liver CT imaging? (3) What are the clinical applications of ML in liver CT imaging?

METHODS

A systematic review was carried out according to the guidelines from the PRISMA-P statement. The search string focused on studies containing content relating to artificial intelligence, liver, and computed tomography.

RESULTS

One hundred ninety-one studies were included in the study. ML was applied to CT liver imaging by image analysis without clinicians' intervention in majority of studies while in newer studies the fusion of ML method with clinical intervention have been identified. Several were documented to perform very accurately on reliable but small data. Most models identified were deep learning-based, mainly using convolutional neural networks. Potentially many clinical applications of ML to CT liver imaging have been identified through our review including liver and its lesion segmentation and classification, segmentation of vascular structure inside the liver, fibrosis and cirrhosis staging, metastasis prediction, and evaluation of chemotherapy.

CONCLUSION

Several studies attempted to provide transparent result of the model. To make the model convenient for a clinical application, prospective clinical validation studies are in urgent call. Computer scientists and engineers should seek to cooperate with health professionals to ensure this.

KEY POINTS

• ML shows great potential for CT liver image tasks such as pixel-wise segmentation and classification of liver and liver lesions, fibrosis staging, metastasis prediction, and retrieval of relevant liver lesions from similar cases of other patients. • Despite presenting the result is not standardized, many studies have attempted to provide transparent results to interpret the machine learning method performance in the literature. • Prospective studies are in urgent call for clinical validation of ML method, preferably carried out by cooperation between clinicians and computer scientists.

Classification of metastatic hepatic carcinoma and hepatocellular carcinoma lesions using contrast-enhanced CT based on EI-CNNet

BACKGROUND

For hepatocellular carcinoma and metastatic hepatic carcinoma, imaging is one of the main diagnostic methods. In clinical practice, diagnosis mainly relied on experienced imaging physicians, which was inefficient and cannot met the demand for rapid and accurate diagnosis. Therefore, how to efficiently and accurately classify the two types of liver cancer based on imaging is an urgent problem to be solved at present.

PURPOSE

The purpose of this study was to use the deep learning classification model to help radiologists classify the single metastatic hepatic carcinoma and hepatocellular carcinoma based on the enhanced features of enhanced CT (Computer Tomography) portal phase images of the liver site.

METHODS

In this retrospective study, 52 patients with metastatic hepatic carcinoma and 50 patients with hepatocellular carcinoma were among the patients who underwent preoperative enhanced CT examinations from 2017-2020. A total of 565 CT slices from these patients were used to train and validate the classification network (EI-CNNet, training/validation: 452/113). First, the EI block was used to extract edge information from CT slices to enrich fine-grained information and classify them. Then, ROC (Receiver Operating Characteristic) curve was used to evaluate the performance, accuracy, and recall of the EI-CNNet. Finally, the classification results of EI-CNNet were compared with popular classification models.

RESULTS

By utilizing 80% data for model training and 20% data for model validation, the average accuracy of this experiment was 98.2% ± 0.62 (mean ± standard deviation (SD)), the recall rate was 97.23% ± 2.77, the precision rate was 98.02% ± 2.07, the network parameters were 11.83 MB, and the validation time was 9.83 s/sample. The classification accuracy was improved by 20.98% compared to the base CNN network and the validation time was 10.38 s/sample. Compared with other classification networks, the InceptionV3 network showed improved classification results, but the number of parameters was increased and the validation time was 33 s/sample, and the classification accuracy was improved by 6.51% using this method.

CONCLUSION

EI-CNNet demonstrated promised diagnostic performance and has potential to reduce the workload of radiologists and may help distinguish whether the tumor is primary or metastatic in time; otherwise, it may be missed or misjudged.

A multi-modal deep neural network for multi-class liver cancer diagnosis

Liver disease is a potentially asymptomatic clinical entity that may progress to patient death. This study proposes a multi-modal deep neural network for multi-class malignant liver diagnosis. In parallel with the portal venous computed tomography (CT) scans, pathology data is utilized to prognosticate primary liver cancer variants and metastasis. The processed CT scans are fed to the deep dilated convolution neural network to explore salient features. The residual connections are further added to address vanishing gradient problems. Correspondingly, five pathological features are learned using a wide and deep network that gives a benefit of memorization with generalization. The down-scaled hierarchical features from CT scan and pathology data are concatenated to pass through fully connected layers for classification between liver cancer variants. In addition, the transfer learning of pre-trained deep dilated convolution layers assists in handling insufficient and imbalanced dataset issues. The fine-tuned network can predict three-class liver cancer variants with an average accuracy of 96.06% and an Area Under Curve (AUC) of 0.832. To the best of our knowledge, this is the first study to classify liver cancer variants by integrating pathology and image data, hence following the medical perspective of malignant liver diagnosis. The comparative analysis on the benchmark dataset shows that the proposed multi-modal neural network outperformed most of the liver diagnostic studies and is comparable to others.

Deep learning techniques in liver tumour diagnosis using CT and MR imaging - A systematic review

Deep learning has become a thriving force in the computer aided diagnosis of liver cancer, as it solves extremely complicated challenges with high accuracy over time and facilitates medical experts in their diagnostic and treatment procedures. This paper presents a comprehensive systematic review on deep learning techniques applied for various applications pertaining to liver images, challenges faced by the clinicians in liver tumour diagnosis and how deep learning bridges the gap between clinical practice and technological solutions with an in-depth summary of 113 articles. Since, deep learning is an emerging revolutionary technology, recent state-of-the-art research implemented on liver images are reviewed with more focus on classification, segmentation and clinical applications in the management of liver diseases. Additionally, similar review articles in literature are reviewed and compared. The review is concluded by presenting the contemporary trends and unaddressed research issues in the field of liver tumour diagnosis, offering directions for future research in this field.

Deep-Learning Model of ResNet Combined with CBAM for Malignant-Benign Pulmonary Nodules Classification on Computed Tomography Images

Background and Objectives: Lung cancer remains a leading cause of cancer mortality worldwide. Accurately classifying benign pulmonary nodules and malignant ones is crucial for early diagnosis and improved patient outcomes. The purpose of this study is to explore the deep-learning model of ResNet combined with a convolutional block attention module (CBAM) for the differentiation between benign and malignant lung cancer, based on computed tomography (CT) images, morphological features, and clinical information. Methods and materials: In this study, 8241 CT slices containing pulmonary nodules were retrospectively included. A random sample comprising 20% (n = 1647) of the images was used as the test set, and the remaining data were used as the training set. ResNet combined CBAM (ResNet-CBAM) was used to establish classifiers on the basis of images, morphological features, and clinical information. Nonsubsampled dual-tree complex contourlet transform (NSDTCT) combined with SVM classifier (NSDTCT-SVM) was used as a comparative model. Results: The AUC and the accuracy of the CBAM-ResNet model were 0.940 and 0.867, respectively, in test set when there were only images as inputs. By combining the morphological features and clinical information, CBAM-ResNet shows better performance (AUC: 0.957, accuracy: 0.898). In comparison, a radiomic analysis using NSDTCT-SVM achieved AUC and accuracy values of 0.807 and 0.779, respectively. Conclusions: Our findings demonstrate that deep-learning models, combined with additional information, can enhance the classification performance of pulmonary nodules. This model can assist clinicians in accurately diagnosing pulmonary nodules in clinical practice.

PILN: A posterior information learning network for blind reconstruction of lung CT images

BACKGROUND AND OBJECTIVE

Computer tomography (CT) imaging technology has played significant roles in the diagnosis and treatment of various lung diseases, but the degradations in CT images usually cause the loss of detailed structural information and interrupt the judgement from clinicians. Therefore, reconstructing noise-free, high-resolution CT images with sharp details from degraded ones is of great importance for the computer-assisted diagnosis (CAD) system. However, current image reconstruction methods suffer from unknown parameters of multiple degradations in actual clinical images.

METHODS

To solve these problems, we propose a unified framework, so called Posterior Information Learning Network (PILN), for blind reconstruction of lung CT images. The framework consists of two stages: Firstly, a noise level learning (NLL) network is proposed to quantify the Gaussian and artifact noise degradations into different levels. Inception-residual modules are designed to extract multi-scale deep features from the noisy image, and residual self-attention structures are proposed to refine deep features to essential representations of noise. Secondly, by taking the estimated noise levels as prior information, a cyclic collaborative super-resolution (CyCoSR) network is proposed to iteratively reconstruct the high-resolution CT image and estimate the blur kernel. Two convolutional modules are designed based on cross-attention transformer structure, named as Reconstructor and Parser. The high-resolution image is restored from the degraded image by the Reconstructor under the guidance of the predicted blur kernel, while the blur kernel is estimated by the Parser according to the reconstructed image and the degraded one. The NLL and CyCoSR networks are formulated as an end-to-end framework to handle multiple degradations simultaneously.

RESULTS

The proposed PILN is applied to the Cancer Imaging Archive (TCIA) dataset and the Lung Nodule Analysis 2016 Challenge (LUNA16) dataset to evaluate its ability in reconstructing lung CT images. Compared with the state-of-the-art image reconstruction algorithms, it can provide high-resolution images with less noise and sharper details with respect to quantitative benchmarks.

CONCLUSIONS

Extensive experimental results demonstrate that our proposed PILN can achieve better performance on blind reconstruction of lung CT images, providing noise-free, detail-sharp and high-resolution images without knowing the parameters of multiple degradation sources.

Radiomics: A radiological evidence-based artificial intelligence technique to facilitate personalized precision medicine in hepatocellular carcinoma

The high postoperative recurrence rates in hepatocellular carcinoma (HCC) remain a major hurdle in its management. Appropriate staging and treatment selection may alleviate the extent of fatal recurrence. However, effective methods to preoperatively evaluate pathophysiologic and molecular characteristics of HCC are lacking. Imaging plays a central role in HCC diagnosis and stratification due to the non-invasive diagnostic criteria. Vast and crucial information is hidden within image data. Other than providing a morphological sketch for lesion diagnosis, imaging could provide new insights to describe the pathophysiological and genetic landscape of HCC. Radiomics aims to facilitate diagnosis and prognosis of HCC using artificial intelligence techniques to harness the immense information contained in medical images. Radiomics produces a set of archetypal and robust imaging features that are correlated to key pathological or molecular biomarkers to preoperatively risk-stratify HCC patients. Inferred with outcome data, comprehensive combination of radiomic, clinical and/or multi-omics data could also improve direct prediction of response to treatment and prognosis. The evolution of radiomics is changing our understanding of personalized precision medicine in HCC management. Herein, we review the key techniques and clinical applications in HCC radiomics and discuss current limitations and future opportunities to improve clinical decision making.

Identify Hard-to-Place Kidneys for Early Engagement in Accelerated Placement With a Deep Learning Optimization Approach

Recommended practices that follow match-run sequences for hard-to-place kidneys succumb to many declines, accruing cold ischemic time and exacerbating kidney quality that may lead to unnecessary kidney discard. Hard-to-place deceased donor kidneys accepted and transplanted later in the match-run sequence may threaten higher graft failure rates. Accelerated placement is a practice for organ procurement organizations (OPOs) to allocate high-risk kidneys out of sequence and reach patients at aggressive transplant centers. The current practice of assessing hard-to-place kidneys and engaging in accelerated kidney placements relies heavily on the kidney donor profile index (KDPI) and the number of declines. Although this practice is reasonable, it also accrues cold ischemic time and increases the risk for kidney discard. We use a deep learning optimization approach to quickly identify kidneys at risk for discard. This approach uses Organ Procurement and Transplantation Network data to model kidney disposition. We filter discards and develop a model to predict transplant and discard of recovered and not transplanted kidneys. Kidneys with a higher probability of discard are deemed hard-to-place kidneys, which require early engagement for accelerated placement. Our approach will aid in identifying hard-to-place kidneys before or after procurement and support OPOs to deviate from the match-run for accelerated placement. Compared with the KDPI-only prediction of the kidney disposition, our approach demonstrates a 10% increase in correctly predicting kidneys at risk for discard. Future work will include developing models to identify candidates with an increased benefit from using hard-to-place kidneys.

Artificial Intelligence in the Diagnosis of Hepatocellular Carcinoma: A Systematic Review

Hepatocellular carcinoma ranks fifth amongst the most common malignancies and is the third most common cause of cancer-related death globally. Artificial Intelligence is a rapidly growing field of interest. Following the PRISMA reporting guidelines, we conducted a systematic review to retrieve articles reporting the application of AI in HCC detection and characterization. A total of 27 articles were included and analyzed with our composite score for the evaluation of the quality of the publications. The contingency table reported a statistically significant constant improvement over the years of the total quality score (p = 0.004). Different AI methods have been adopted in the included articles correlated with 19 articles studying CT (41.30%), 20 studying US (43.47%), and 7 studying MRI (15.21%). No article has discussed the use of artificial intelligence in PET and X-ray technology. Our systematic approach has shown that previous works in HCC detection and characterization have assessed the comparability of conventional interpretation with machine learning using US, CT, and MRI. The distribution of the imaging techniques in our analysis reflects the usefulness and evolution of medical imaging for the diagnosis of HCC. Moreover, our results highlight an imminent need for data sharing in collaborative data repositories to minimize unnecessary repetition and wastage of resources.

Detection of COVID-19 and its pulmonary stage using Bayesian hyperparameter optimization and deep feature selection methods

Since the first case of COVID-19 was reported in December 2019, many studies have been carried out on artificial intelligence for the rapid diagnosis of the disease to support health services. Therefore, in this study, we present a powerful approach to detect COVID-19 and COVID-19 findings from computed tomography images using pre-trained models using two different datasets. COVID-19, influenza A (H1N1) pneumonia, bacterial pneumonia and healthy lung image classes were used in the first dataset. Consolidation, crazy-paving pattern, ground-glass opacity, ground-glass opacity and consolidation, ground-glass opacity and nodule classes were used in the second dataset. The study consists of four steps. In the first two steps, distinctive features were extracted from the final layers of the pre-trained ShuffleNet, GoogLeNet and MobileNetV2 models trained with the datasets. In the next steps, the most relevant features were selected from the models using the Sine-Cosine optimization algorithm. Then, the hyperparameters of the Support Vector Machines were optimized with the Bayesian optimization algorithm and used to reclassify the feature subset that achieved the highest accuracy in the third step. The overall accuracy obtained for the first and second datasets is 99.46% and 99.82%, respectively. Finally, the performance of the results visualized with Occlusion Sensitivity Maps was compared with Gradient-weighted class activation mapping. The approach proposed in this paper outperformed other methods in detecting COVID-19 from multiclass viral pneumonia. Moreover, detecting the stages of COVID-19 in the lungs was an innovative and successful approach.

Practical utility of liver segmentation methods in clinical surgeries and interventions

Clinical imaging (e.g., magnetic resonance imaging and computed tomography) is a crucial adjunct for clinicians, aiding in the diagnosis of diseases and planning of appropriate interventions. This is especially true in malignant conditions such as hepatocellular carcinoma (HCC), where image segmentation (such as accurate delineation of liver and tumor) is the preliminary step taken by the clinicians to optimize diagnosis, staging, and treatment planning and intervention (e.g., transplantation, surgical resection, radiotherapy, PVE, embolization, etc). Thus, segmentation methods could potentially impact the diagnosis and treatment outcomes. This paper comprehensively reviews the literature (during the year 2012–2021) for relevant segmentation methods and proposes a broad categorization based on their clinical utility (i.e., surgical and radiological interventions) in HCC. The categorization is based on the parameters such as precision, accuracy, and automation.

Deep learning in multimedia healthcare applications: a review

The increase in chronic diseases has affected the countries' health system and economy. With the recent COVID-19 virus, humanity has experienced a great challenge, which has led to make efforts to detect it and prevent its spread. Hence, it is necessary to develop new solutions that are based on technology and low cost, to satisfy the citizens' needs. Deep learning techniques is a technological solution that has been used in healthcare lately. Nowadays, with the increase in chips processing capabilities, increase size of data, and the progress in deep learning research, healthcare applications have been proposed to provide citizens' health needs. In addition, a big amount of data is generated every day. Development in Internet of Things, gadgets, and phones has allowed the access to multimedia data. Data such as images, video, audio and text are used as input of applications based on deep learning methods to support healthcare system to diagnose, predict, or treat patients. This review pretends to give an overview of proposed healthcare solutions based on deep learning techniques using multimedia data. We show the use of deep learning in healthcare, explain the different types of multimedia data, show some relevant deep learning multimedia applications in healthcare, and highlight some challenges in this research area.

A New Deep Learning Model for the Classification of Poisonous and Edible Mushrooms Based on Improved AlexNet Convolutional Neural Network

The difficulty involved in distinguishing between edible and poisonous mushrooms stems from their similar appearances. In this study, we attempted to classify five common species of poisonous and edible mushrooms found in Thailand, Inocybe rimosa, Amanita phalloides, Amanita citrina, Russula delica, and Phaeogyroporus portentosus, using the convolutional neural network (CNN) and region convolutional neural network (R-CNN). This study was motivated by the yearly death toll from eating poisonous mushrooms in Thailand. In this research, a method for the classification of edible and poisonous mushrooms was proposed and the testing time and accuracy of three pretrained models, AlexNet, ResNet-50, and GoogLeNet, were compared. The proposed model was found to reduce the duration required for training and testing while retaining a high level of accuracy. In the mushroom classification experiments using CNN and R-CNN, the proposed model demonstrated accuracy levels of 98.50% and 95.50%, respectively.

Application of logistic regression and convolutional neural network in prediction and diagnosis of high-risk populations of lung cancer

OBJECTIVES

The early detection, early diagnosis, and early treatment of lung cancer are the best strategies to improve the 5-year survival rate. Logistic regression analysis can be a helpful tool in the early detection of high-risk groups of lung cancer. Convolutional neural network (CNN) could distinguish benign from malignant pulmonary nodules, which is critical for early precise diagnosis and treatment. Here, we developed a risk assessment model of lung cancer and a high-precision classification diagnostic model using these technologies so as to provide a basis for early screening of lung cancer and for intelligent differential diagnosis.

METHODS

A total of 355 lung cancer patients, 444 patients with benign lung disease and 472 healthy people from The First Affiliated Hospital of Zhengzhou University were included in this study. Moreover, the dataset of 607 lung computed tomography images was collected from the above patients. The logistic regression method was employed to screen the high-risk groups of lung cancer, and the CNN model was designed to classify pulmonary nodules into benign or malignant nodules.

RESULTS

The area under the curve of the lung cancer risk assessment model in the training set and the testing set were 0.823 and 0.710, respectively. After finely optimizing the settings of the CNN, the area under the curve could reach 0.984.

CONCLUSIONS

This performance demonstrated that the lung cancer risk assessment model could be used to screen for high-risk individuals with lung cancer and the CNN framework was suitable for the differential diagnosis of pulmonary nodules.

Pneumoconiosis computer aided diagnosis system based on X-rays and deep learning

PURPOSE

The objective of this study is to construct a computer aided diagnosis system for normal people and pneumoconiosis using X-raysand deep learning algorithms.

MATERIALS AND METHODS

1760 anonymous digital X-ray images of real patients between January 2017 and June 2020 were collected for this experiment. In order to concentrate the feature extraction ability of the model more on the lung region and restrain the influence of external background factors, a two-stage pipeline from coarse to fine was established. First, the U-Net model was used to extract the lung regions on each sides of the collection images. Second, the ResNet-34 model with transfer learning strategy was implemented to learn the image features extracted in the lung region to achieve accurate classification of pneumoconiosis patients and normal people.

RESULTS

Among the 1760 cases collected, the accuracy and the area under curve of the classification model were 92.46% and 89% respectively.

CONCLUSION

The successful application of deep learning in the diagnosis of pneumoconiosis further demonstrates the potential of medical artificial intelligence and proves the effectiveness of our proposed algorithm. However, when we further classified pneumoconiosis patients and normal subjects into four categories, we found that the overall accuracy decreased to 70.1%. We will use the CT modality in future studies to provide more details of lung regions.

Classification of focal liver lesions in CT images using convolutional neural networks with lesion information augmented patches and synthetic data augmentation

PURPOSE

We propose a deep learning method that classifies focal liver lesions (FLLs) into cysts, hemangiomas, and metastases from portal phase abdominal CT images. We propose a synthetic data augmentation process to alleviate the class imbalance and the Lesion INformation Augmented (LINA) patch to improve the learning efficiency.

METHODS

A dataset of 502 portal phase CT scans of 1,290 FLLs was used. First, to alleviate the class imbalance and to diversify the training data patterns, we suggest synthetic training data augmentation using DCGAN-based lesion mask synthesis and pix2pix-based mask-to-image translation. Second, to improve the learning efficiency of convolutional neural networks (CNNs) for the small lesions, we propose a novel type of input patch termed the LINA patch to emphasize the lesion texture information while also maintaining the lesion boundary information in the patches. Third, we construct a multi-scale CNN through a model ensemble of ResNet-18 CNNs trained on LINA patches of various mini-patch sizes.

RESULTS

The experiments demonstrate that (a) synthetic data augmentation method shows characteristics different but complementary to those in conventional real data augmentation in augmenting data distributions, (b) the proposed LINA patches improve classification performance compared to those by existing types of CNN input patches due to the enhanced texture and boundary information in the small lesions, and (c) through an ensemble of LINA patch-trained CNNs with different mini-patch sizes, the multi-scale CNN further improves overall classification performance. As a result, the proposed method achieved an accuracy of 87.30%, showing improvements of 10.81%p and 15.0%p compared to the conventional image patch-trained CNN and texture feature-trained SVM, respectively.

CONCLUSIONS

The proposed synthetic data augmentation method shows promising results in improving the data diversity and class imbalance, and the proposed LINA patches enhance the learning efficiency compared to the existing input image patches.

Medical image analysis based on deep learning approach

Medical imaging plays a significant role in different clinical applications such as medical procedures used for early detection, monitoring, diagnosis, and treatment evaluation of various medical conditions. Basicsof the principles and implementations of artificial neural networks and deep learning are essential for understanding medical image analysis in computer vision. Deep Learning Approach (DLA) in medical image analysis emerges as a fast-growing research field. DLA has been widely used in medical imaging to detect the presence or absence of the disease. This paper presents the development of artificial neural networks, comprehensive analysis of DLA, which delivers promising medical imaging applications. Most of the DLA implementations concentrate on the X-ray images, computerized tomography, mammography images, and digital histopathology images. It provides a systematic review of the articles for classification, detection, and segmentation of medical images based on DLA. This review guides the researchers to think of appropriate changes in medical image analysis based on DLA.

Computer-aided diagnosis of liver lesions using CT images: A systematic review

BACKGROUND

Medical image processing has a strong footprint in radio diagnosis for the detection of diseases from the images. Several computer-aided systems were researched in the recent past to assist the radiologist in diagnosing liver diseases and reducing the interpretation time. The aim of this paper is to provide an overview of the state-of-the-art techniques in computer-assisted diagnosis systems to predict benign and malignant lesions using computed tomography images.

METHODS

The research articles published between 1998 and 2020 obtained from various standard databases were considered for preparing the review. The research papers include both conventional as well as deep learning-based systems for liver lesion diagnosis. The paper initially discusses the various hepatic lesions that are identifiable on computed tomography images, then the computer-aided diagnosis systems and their workflow. The conventional and deep learning-based systems are presented in stages wherein the various methods used for preprocessing, liver and lesion segmentation, radiological feature extraction and classification are discussed.

CONCLUSION

The review suggests the scope for future, work as efficient and effective segmentation methods that work well with diverse images have not been developed. Furthermore, unsupervised and semi-supervised deep learning models were not investigated for liver disease diagnosis in the reviewed papers. Other areas to be explored include image fusion and inclusion of essential clinical features along with the radiological features for better classification accuracy.