Segmentation of histological images and fibrosis identification with a convolutional neural network

Histology-based quantification of boiling histotripsy outcomes via ResNet-18 network: Towards mechanical dose metrics

This work was focused on the newly developed ultrasonic approach for non-invasive surgery - boiling histotripsy (BH) - recently proposed for mechanical ablation of tissues using pulsed high intensity focused ultrasound (HIFU). The BH lesion is known to depend in size and shape on exposure parameters and mechanical properties, structure and composition of tissue being treated. The aim of this work was to advance the concept of BH dose by investigating quantitative relationships between the parameters of the lesion, pulsing protocols, and targeted tissue properties. A HIFU focus of a 1.5 MHz 256-element array driven by power-enhanced Verasonics system was electronically steered along the grid within 12 × 4 × 12 mm volume to produce volumetric lesions in porcine liver (soft, with abundant collagenous structures) and bovine myocardium (stiff, homogenous cellular) ex vivo tissues with various pulsing protocols (1-10 ms pulses, 1-15 pulses per point). Quantification of the lesion size and completeness was performed through serial histological sectioning, and a computer vision approach using a combination of manual and automated detection of fully fractionated and residual tissue based on neural network ResNet-18 was developed. Histological sample fixation led to underestimation of BH ablation rate compared to the ultrasound-based estimations, and provided similar qualitative feedback as did gross inspection. This suggests that gross observation may be sufficient for qualitatively evaluating the BH treatment completeness. BH efficiency in liver tissue was shown to be insensitive to the changes in pulsing protocol within the tested parameter range, whereas in bovine myocardium the efficiency increased with either increasing pulse length or number of pulses per point or both. The results imply that one universal mechanical dose metric applicable to an arbitrary tissue type is unlikely to be established. The dose metric as a product of the BH pulse duration and the number of pulses per sonication point (BHD1) was shown to be more relevant for initial planning of fractionation of collagenous tissues. The dose metric as a number of pulses per point (BHD2) is more suitable for the treatment planning of softer targets primarily containing cellular tissue, allowing for significant acceleration of treatment using shorter pulses.

A Survey on AI Techniques for Thoracic Diseases Diagnosis Using Medical Images

Thoracic diseases refer to disorders that affect the lungs, heart, and other parts of the rib cage, such as pneumonia, novel coronavirus disease (COVID-19), tuberculosis, cardiomegaly, and fracture. Millions of people die every year from thoracic diseases. Therefore, early detection of these diseases is essential and can save many lives. Earlier, only highly experienced radiologists examined thoracic diseases, but recent developments in image processing and deep learning techniques are opening the door for the automated detection of these diseases. In this paper, we present a comprehensive review including: types of thoracic diseases; examination types of thoracic images; image pre-processing; models of deep learning applied to the detection of thoracic diseases (e.g., pneumonia, COVID-19, edema, fibrosis, tuberculosis, chronic obstructive pulmonary disease (COPD), and lung cancer); transfer learning background knowledge; ensemble learning; and future initiatives for improving the efficacy of deep learning models in applications that detect thoracic diseases. Through this survey paper, researchers may be able to gain an overall and systematic knowledge of deep learning applications in medical thoracic images. The review investigates a performance comparison of various models and a comparison of various datasets.

Development of an Image-Based Methodology for the Evaluation of Histopathological Features in Human Meningioma

Meningioma is the most common intracranial tumor in adulthood. With a clear female predominance and a recurrence rate that reaches 20%, it is, despite being considered a benign tumor, a pathology that greatly compromises post-diagnosis quality of life. Its prone to recur or progress to a higher degree is difficult to predict in the absence of obvious histological criteria. This project aims to develop an automatic methodology to aid in the diagnosis of meningiomas that is objective and easily reproducible. The methodology is based on histopathological image analysis using artificial intelligence and machine learning algorithms. It includes a semi-automatic process of identification and cleaning of the scanned samples, an automatic detection of the nuclei of each image and, finally, the parameterization of the samples. The obtained data together with the clinical information will be analyzed using statistical methods in order to provide a methodology to support clinical diagnosis and decision-making in patient management. The result is the development of an effective methodology that generates a set of data associated with morphological parameters with different trends according to the pathological groups studied. A tool has been developed that allows an effective semiautomatic analysis of the images to evaluate these parameters in an objective and reproducible way, helping in clinical decision-making and facilitating to undertake projects with large sample series. Clinical Relevance- The main contribution of this project is in the field of neuropathology, for the diagnosis of meningiomas, the most common brain tumor. The present project provides an objective and quantifiable prognosis methodology for the meningiomas, offering a more precise monitoring of the treatment applied to the patient, resulting in a better prognosis and better quality of life.

Segmentation of wood cell in cross-section using deep convolutional neural networks

Fiber and vessel structures located in the cross-section are anatomical features that play an important role in identifying tree species. In order to determine the microscopic anatomical structure of these cell types, each cell must be accurately segmented. In this study, a segmentation method is proposed for wood cell images based on deep convolutional neural networks. The network, which was developed by combining two-stage CNN structures, was trained using the Adam optimization algorithm. For evaluation, the method was compared with SegNet and U-Net architectures, trained with the same dataset. The losses in these models trained were compared using IoU (Intersection over Union), accuracy, and BF-score measurements on the test data. The automatic identification of the cells in the wood images obtained using a microscope will provide a fast, inexpensive, and reliable tool for those working in this field.

The Role of Machine Learning in Cardiovascular Pathology

Machine learning has seen slow but steady uptake in diagnostic pathology over the past decade to assess digital whole-slide images. Machine learning tools have incredible potential to standardise, and likely even improve, histopathologic diagnoses, but they are not yet widely used in clinical practice. We describe the principles of these tools and technologies and some successful preclinical and pretranslational efforts in cardiovascular pathology, as well as a roadmap for moving forward. In nonhuman animal models, one proof-of-principle application is in rodent progressive cardiomyopathy, which is of particular significance to drug toxicity studies. Basic science successes include screening the quality of differentiated stem cells and characterising cardiomyocyte developmental stages, with potential applications for research and toxicology/drug safety screening using derived or native human pluripotent stem cells differentiated into cardiomyocytes. Translational studies of particular note include those with success in diagnosing the various forms of heart allograft rejection. For fully realising the value of these tools in clinical cardiovascular pathology, we identify 3 essential challenges. First is image quality standardisation to ensure that algorithms can be developed and implemented on robust, consistent data. The second is consensus diagnosis; experts don't always agree, and thus "truth" may be difficult to establish, but the algorithms themselves may provide a solution. The third is the need for large-enough data sets to facilitate robust algorithm development, necessitating large cross-institutional shared image databases. The power of histopathology-based machine learning technologies is tremendous, and we outline the next steps needed to capitalise on this power.

Cardiac radiotherapy induces electrical conduction reprogramming in the absence of transmural fibrosis

Cardiac radiotherapy (RT) may be effective in treating heart failure (HF) patients with refractory ventricular tachycardia (VT). The previously proposed mechanism of radiation-induced fibrosis does not explain the rapidity and magnitude with which VT reduction occurs clinically. Here, we demonstrate in hearts from RT patients that radiation does not achieve transmural fibrosis within the timeframe of VT reduction. Electrophysiologic assessment of irradiated murine hearts reveals a persistent supraphysiologic electrical phenotype, mediated by increases in NaV1.5 and Cx43. By sequencing and transgenic approaches, we identify Notch signaling as a mechanistic contributor to NaV1.5 upregulation after RT. Clinically, RT was associated with increased NaV1.5 expression in 1 of 1 explanted heart. On electrocardiogram (ECG), post-RT QRS durations were shortened in 13 of 19 patients and lengthened in 5 patients. Collectively, this study provides evidence for radiation-induced reprogramming of cardiac conduction as a potential treatment strategy for arrhythmia management in VT patients.

Understanding PITX2-Dependent Atrial Fibrillation Mechanisms through Computational Models

Atrial fibrillation (AF) is a common arrhythmia. Better prevention and treatment of AF are needed to reduce AF-associated morbidity and mortality. Several major mechanisms cause AF in patients, including genetic predispositions to AF development. Genome-wide association studies have identified a number of genetic variants in association with AF populations, with the strongest hits clustering on chromosome 4q25, close to the gene for the homeobox transcription PITX2. Because of the inherent complexity of the human heart, experimental and basic research is insufficient for understanding the functional impacts of PITX2 variants on AF. Linking PITX2 properties to ion channels, cells, tissues, atriums and the whole heart, computational models provide a supplementary tool for achieving a quantitative understanding of the functional role of PITX2 in remodelling atrial structure and function to predispose to AF. It is hoped that computational approaches incorporating all we know about PITX2-related structural and electrical remodelling would provide better understanding into its proarrhythmic effects leading to development of improved anti-AF therapies. In the present review, we discuss advances in atrial modelling and focus on the mechanistic links between PITX2 and AF. Challenges in applying models for improving patient health are described, as well as a summary of future perspectives.

Segmentation of Microscope Erythrocyte Images by CNN-Enhanced Algorithms

This paper presents an algorithm for segmentation and shape analysis of erythrocyte images collected using an optical microscope. The main objective of the proposed approach is to compute statistical object values such as the number of erythrocytes in the image, their size, and width to height ratio. A median filter, a mean filter and a bilateral filter were used for initial noise reduction. Background subtraction using a rolling ball filter removes background irregularities. Combining the distance transform with the Otsu and watershed segmentation methods allows for initial image segmentation. Further processing steps, including morphological transforms and the previously mentioned segmentation methods, were applied to each segmented cell, resulting in an accurate segmentation. Finally, the noise standard deviation, sensitivity, specificity, precision, negative predictive value, accuracy and the number of detected objects are calculated. The presented approach shows that the second stage of the two-stage segmentation algorithm applied to individual cells segmented in the first stage allows increasing the precision from 0.857 to 0.968 for the artificial image example tested in this paper. The next step of the algorithm is to categorize segmented erythrocytes to identify poorly segmented and abnormal ones, thus automating this process, previously often done manually by specialists. The presented segmentation technique is also applicable as a probability map processor in the deep learning pipeline. The presented two-stage processing introduces a promising fusion model presented by the authors for the first time.

Karpinski Score under Digital Investigation: A Fully Automated Segmentation Algorithm to Identify Vascular and Stromal Injury of Donors’ Kidneys

In kidney transplantations, the evaluation of the vascular structures and stromal areas is crucial for determining kidney acceptance, which is currently based on the pathologist’s visual evaluation. In this context, an accurate assessment of the vascular and stromal injury is fundamental to assessing the nephron status. In the present paper, the authors present a fully automated algorithm, called RENFAST (Rapid EvaluatioN of Fibrosis And vesselS Thickness), for the segmentation of kidney blood vessels and fibrosis in histopathological images. The proposed method employs a novel strategy based on deep learning to accurately segment blood vessels, while interstitial fibrosis is assessed using an adaptive stain separation method. The RENFAST algorithm is developed and tested on 350 periodic acid–Schiff (PAS) images for blood vessel segmentation and on 300 Massone’s trichrome (TRIC) stained images for the detection of renal fibrosis. In the TEST set, the algorithm exhibits excellent segmentation performance in both blood vessels (accuracy: 0.8936) and fibrosis (accuracy: 0.9227) and outperforms all the compared methods. To the best of our knowledge, the RENFAST algorithm is the first fully automated method capable of detecting both blood vessels and fibrosis in digital histological images. Being very fast (average computational time 2.91 s), this algorithm paves the way for automated, quantitative, and real-time kidney graft assessments.

Leukocyte super-resolution via geometry prior and structural consistency

SIGNIFICANCE

Researchers have made great progress in single-image super-resolution (SISR) using deep convolutional neural networks. However, in the field of leukocyte imaging, the performance of existing SISR methods is still limited as it fails to thoroughly explore the geometry and structural consistency of leukocytes. The inaccurate super-resolution (SR) results will hinder the pathological study of leukocytes, since the structure and cell lineage determine the types of leukocyte and will significantly affect the subsequent inspection.

AIM

We propose a deep network that takes full use of the geometry prior and structural consistency of the leukocyte images. We establish and annotate a leukocyte dataset, which contains five main types of leukocytes (basophil, eosinophil, monocyte, lymphocyte, and neutrophil), for learning the structure and geometry information.

APPROACH

Our model is composed of two modules: prior network and SR network. The prior network estimates the parsing map of the low-resolution (LR) image, and then the SR network takes both the estimated parsing map and LR image as input to predict the final high-resolution image.

RESULT

Experiments show that the geometry prior and structural consistency in use obviously improves the SR performance of leukocyte images, enhancing the peak-signal-to-noise ratio (PSNR) by about 0.4 dB in our benchmark.

CONCLUSION

As proved by our leukocyte SR benchmark, the proposed method significantly outperforms state-of-the-art SR methods. Our method not only improves the PSNR and structural similarity indices, but also accurately preserves the structural details of leukocytes. The proposed method is believed to have potential use in the wide-field cell prescreening by simply using a low-power objective.

Application of a fully deep convolutional neural network to the automation of tooth segmentation on panoramic radiographs

OBJECTIVES

To evaluate a fully deep learning mask region-based convolutional neural network (R-CNN) method for automated tooth segmentation using individual annotation of panoramic radiographs.

STUDY DESIGN

In total, 846 images with tooth annotations from 30 panoramic radiographs were used for training, and 20 panoramic images as the validation and test sets. An oral radiologist manually performed individual tooth annotation on the panoramic radiographs to generate the ground truth of each tooth structure. We used the augmentation technique to reduce overfitting and obtained 1024 training samples from 846 original data points. A fully deep learning method using the mask R-CNN model was implemented through a fine-tuning process to detect and localize the tooth structures. For performance evaluation, the F1 score, mean intersection over union (IoU), and visual analysis were utilized.

RESULTS

The proposed method produced an F1 score of 0.875 (precision: 0.858, recall: 0.893) and a mean IoU of 0.877. A visual evaluation of the segmentation method showed a close resemblance to the ground truth.

CONCLUSIONS

The method achieved high performance for automation of tooth segmentation on dental panoramic images. The proposed method might be applied in the first step of diagnosis automation and in forensic identification, which involves similar segmentation tasks.

Dragonfly Algorithm with Opposition-Based Learning for Multilevel Thresholding Color Image Segmentation

Multilevel thresholding is a very active research field in image segmentation, and has been successfully used in various applications. However, the computational time will increase exponentially as the number of thresholds increases, and for color images which contain more information this is even worse. To overcome the drawback while maintaining segmentation accuracy, a modified version of dragonfly algorithm (DA) with opposition-based learning (OBLDA) for color image segmentation is proposed in this paper. The opposition-based learning (OBL) strategy simultaneously considers the current solution and the opposite solution, which are symmetrical in the search space. With the introduction of OBL, the proposed algorithm has a faster convergence speed and more balanced exploration–exploitation compared with the original DA. In order to clearly demonstrate the outstanding performance of the OBLDA, the proposed method is compared with seven state-of-the-art meta-heuristic algorithms, through experiments on 10 test images. The optimal threshold values are calculated by the maximization of between-class variance and Kapur’s entropy. Meanwhile, some indicators, including peak signal to noise ratio (PSNR), feature similarity index (FSIM), structure similarity index (SSIM), the average fitness values, standard deviation (STD), and computation time are used as evaluation criteria in the experiments. The promising results reveal that proposed method has the advantages of high accuracy and remarkable stability. Wilcoxon’s rank sum test and Friedman test are also performed to verify the superiority of OBLDA in a statistical way. Furthermore, various satellite images are also included for robustness testing. In conclusion, the OBLDA algorithm is a feasible and effective method for multilevel thresholding color image segmentation.

Kapur's Entropy for Color Image Segmentation Based on a Hybrid Whale Optimization Algorithm

In this paper, a new hybrid whale optimization algorithm (WOA) called WOA-DE is proposed to better balance the exploitation and exploration phases of optimization. Differential evolution (DE) is adopted as a local search strategy with the purpose of enhancing exploitation capability. The WOA-DE algorithm is then utilized to solve the problem of multilevel color image segmentation that can be considered as a challenging optimization task. Kapur's entropy is used to obtain an efficient image segmentation method. In order to evaluate the performance of proposed algorithm, different images are selected for experiments, including natural images, satellite images and magnetic resonance (MR) images. The experimental results are compared with state-of-the-art meta-heuristic algorithms as well as conventional approaches. Several performance measures have been used such as average fitness values, standard deviation (STD), peak signal to noise ratio (PSNR), structural similarity index (SSIM), feature similarity index (FSIM), Wilcoxon's rank sum test, and Friedman test. The experimental results indicate that the WOA-DE algorithm is superior to the other meta-heuristic algorithms. In addition, to show the effectiveness of the proposed technique, the Otsu method is used for comparison.

Quantification of hepatic steatosis in histologic images by deep learning method

OBJECTIVE

To develop and test a novel method for automatic quantification of hepatic steatosis in histologic images based on the deep learning scheme designed to predict the fat ratio directly, which aims to improve accuracy in diagnosis of non-alcoholic fatty liver disease (NAFLD) with objective assessment of the severity of hepatic steatosis instead of subjective visual estimation.

MATERIALS AND METHODS

Thirty-six 8-week old New Zealand white rabbits of both sexes were fed with high-cholesterol, high-fat diet and sacrificed under deep anesthesia at various time points to obtain the pathological specimen. All rabbits were performed by multislice computed tomography for surveillance to measure density changes of liver parenchyma. A deep learning scheme using a convolutional neural network was developed to directly predict the liver fat ratio based on the pathological images. The average error value, standard deviation, and accuracy (error <5%) were evaluated and compared between the deep learning scheme and manual segmentation results. The Pearson's correlation coefficient was also calculated in this study.

RESULTS

The deep learning scheme performs successfully on rabbit liver histologic data, showing a high degree of accuracy and stability. The average error value, standard deviation, and accuracy (error <5%) were 3.21%, 4.02%, and 79.10% for the cropped images, 2.22%, 1.92%, and 88.34% for the original images, respectively. The strong positive correlation was also observed for cropped images (R = 0.9227) and original images (R = 0.9255) in comparison to labeled fat ratio.

CONCLUSIONS

This new deep learning scheme may aid in the quantification of steatosis in the liver and facilitate its treatment by providing an earlier clinical diagnosis.