State of machine and deep learning in histopathological applications in digestive diseases

The return of natural dyes: the case of logwood tree (Haematoxylum campechianum L.)

In recent years, a worldwide reassessment of natural dyes has occurred, driven by the health and environmental issues associated with synthetic dyes. Haematoxylum campechianum L. is a tropical tree from which wood extracts were widely used in the textile industry during the 16th century. The logwood tree extract serves as a contemporary source of hematoxylin, a key dye in the globally prevalent hematoxylin-eosin staining method, a cornerstone in histopathological procedures. This paper will initially explore the re-emergence of natural dyes. Subsequently, it will focus on the historical, conventional, and innovative applications of logwood in the fields of medicine, histopathology, and nanotechnology, along with the status and alternative uses of the hematoxylin-eosin stain. Lastly, this paper will examine the current state of conservation and utilization of Haematoxylum campechianum in Campeche, Mexico, a leading global producer of hematoxylin.

Computational analysis of peripheral blood smears detects disease-associated cytomorphologies

Many hematological diseases are characterized by altered abundance and morphology of blood cells and their progenitors. Myelodysplastic syndromes (MDS), for example, are a group of blood cancers characterised by cytopenias, dysplasia of hematopoietic cells and blast expansion. Examination of peripheral blood slides (PBS) in MDS often reveals changes such as abnormal granulocyte lobulation or granularity and altered red blood cell (RBC) morphology; however, some of these features are shared with conditions such as haematinic deficiency anemias. Definitive diagnosis of MDS requires expert cytomorphology analysis of bone marrow smears and complementary information such as blood counts, karyotype and molecular genetics testing. Here, we present Haemorasis, a computational method that detects and characterizes white blood cells (WBC) and RBC in PBS. Applied to over 300 individuals with different conditions (SF3B1-mutant and SF3B1-wildtype MDS, megaloblastic anemia, and iron deficiency anemia), Haemorasis detected over half a million WBC and millions of RBC and characterized their morphology. These large sets of cell morphologies can be used in diagnosis and disease subtyping, while identifying novel associations between computational morphotypes and disease. We find that hypolobulated neutrophils and large RBC are characteristic of SF3B1-mutant MDS. Additionally, while prevalent in both iron deficiency and megaloblastic anemia, hyperlobulated neutrophils are larger in the latter. By integrating cytomorphological features using machine learning, Haemorasis was able to distinguish SF3B1-mutant MDS from other MDS using cytomorphology and blood counts alone, with high predictive performance. We validate our findings externally, showing that they generalize to other centers and scanners. Collectively, our work reveals the potential for the large-scale incorporation of automated cytomorphology into routine diagnostic workflows.

MSIr: Automatic Registration Service for Mass Spectrometry Imaging and Histology

Mass spectrometry imaging (MSI) is a powerful tool that can be used to simultaneously investigate the spatial distribution of different molecules in samples. However, it is difficult to comprehensively analyze complex biological systems with only a single analytical technique due to different analytical properties and application limitations. Therefore, many analytical methods have been combined to extend data interpretation, evaluate data credibility, and facilitate data mining to explore important temporal and spatial relationships in biological systems. Image registration is an initial and critical step for multimodal imaging data fusion. However, the image registration of multimodal images is not a simple task. The property difference between each data modality may include spatial resolution, image characteristics, or both. The image registrations between MSI and different imaging techniques are often achieved indirectly through histology. Many methods exist for image registration between MSI data and histological images. However, most of them are manual or semiautomatic and have their prerequisites. Here, we built MSI Registrar (MSIr), a web service for automatic registration between MSI and histology. It can help to reduce subjectivity and processing time efficiently. MSIr provides an interface for manually selecting region of interests from histological images; the user selects regions of interest to extract the corresponding spectrum indices in MSI data. In the performance evaluation, MSIr can quickly map MSI data to histological images and help pinpoint molecular components at specific locations in tissues. Most registrations were adequate and were without excessive shifts. MSIr is freely available at https://msir.cmdm.tw and https://github.com/CMDM-Lab/MSIr.

Deep learning-based approach to the characterization and quantification of histopathology in mouse models of colitis

Inflammatory bowel disease (IBD) is a chronic immune-mediated disease of the gastrointestinal tract. While therapies exist, response can be limited within the patient population. Researchers have thus studied mouse models of colitis to further understand pathogenesis and identify new treatment targets. Flow cytometry and RNA-sequencing can phenotype immune populations with single-cell resolution but provide no spatial context. Spatial context may be particularly important in colitis mouse models, due to the simultaneous presence of colonic regions that are involved or uninvolved with disease. These regions can be identified on hematoxylin and eosin (H&E)-stained colonic tissue slides based on the presence of abnormal or normal histology. However, detection of such regions requires expert interpretation by pathologists. This can be a tedious process that may be difficult to perform consistently across experiments. To this end, we trained a deep learning model to detect ‘Involved’ and ‘Uninvolved’ regions from H&E-stained colonic tissue slides. Our model was trained on specimens from controls and three mouse models of colitis–the dextran sodium sulfate (DSS) chemical induction model, the recently established intestinal epithelium-specific, inducible Klf5^ΔIND (Villin-CreER^T2;Klf5^fl/fl) genetic model, and one that combines both induction methods. Image patches predicted to be ‘Involved’ and ‘Uninvolved’ were extracted across mice to cluster and identify histological classes. We quantified the proportion of ‘Uninvolved’ patches and ‘Involved’ patch classes in murine swiss-rolled colons. Furthermore, we trained linear determinant analysis classifiers on these patch proportions to predict mouse model and clinical score bins in a prospectively treated cohort of mice. Such a pipeline has the potential to reveal histological links and improve synergy between various colitis mouse model studies to identify new therapeutic targets and pathophysiological mechanisms.

A review: The detection of cancer cells in histopathology based on machine vision

Machine vision is being employed in defect detection, size measurement, pattern recognition, image fusion, target tracking and 3D reconstruction. Traditional cancer detection methods are dominated by manual detection, which wastes time and manpower, and heavily relies on the pathologists' skill and work experience. Therefore, these manual detection approaches are not convenient for the inheritance of domain knowledge, and are not suitable for the rapid development of medical care in the future. The emergence of machine vision can iteratively update and learn the domain knowledge of cancer cell pathology detection to achieve automated, high-precision, and consistent detection. Consequently, this paper reviews the use of machine vision to detect cancer cells in histopathology images, as well as the benefits and drawbacks of various detection approaches. First, we review the application of image preprocessing and image segmentation in histopathology for the detection of cancer cells, and compare the benefits and drawbacks of different algorithms. Secondly, for the characteristics of histopathological cancer cell images, the research progress of shape, color and texture features and other methods is mainly reviewed. Furthermore, for the classification methods of histopathological cancer cell images, the benefits and drawbacks of traditional machine vision approaches and deep learning methods are compared and analyzed. Finally, the above research is discussed and forecasted, with the expected future development tendency serving as a guide for future research.

Prediction for Mitosis-Karyorrhexis Index Status of Pediatric Neuroblastoma via Machine Learning Based 18F-FDG PET/CT Radiomics

Accurate differentiation of intermediate/high mitosis-karyorrhexis index (MKI) from low MKI is vital for the further management of neuroblastoma. The purpose of this research was to investigate the efficacy of ¹⁸F-FDG PET/CT–based radiomics features for the prediction of MKI status of pediatric neuroblastoma via machine learning. A total of 102 pediatric neuroblastoma patients were retrospectively enrolled and divided into training (68 patients) and validation sets (34 patients) in a 2:1 ratio. Clinical characteristics and radiomics features were extracted by XGBoost algorithm and were used to establish radiomics and clinical models for MKI status prediction. A combined model was developed, encompassing clinical characteristics and radiomics features and presented as a radiomics nomogram. The predictive performance of the models was evaluated by AUC and decision curve analysis. The radiomics model yielded AUC of 0.982 (95% CI: 0.916, 0.999) and 0.955 (95% CI: 0.823, 0.997) in the training and validation sets, respectively. The clinical model yielded AUC of 0.746 and 0.670 in the training and validation sets, respectively. The combined model demonstrated AUC of 0.988 (95% CI: 0.924, 1.000) and 0.951 (95% CI: 0.818, 0.996) in the training and validation sets, respectively. The radiomics features could non-invasively predict MKI status of pediatric neuroblastoma with high accuracy.

Barrett's esophagus: The pathomorphological and molecular genetic keystones of neoplastic progression

Barrett's esophagus is a widespread chronically progressing disease of heterogeneous nature. A life threatening complication of this condition is neoplastic transformation, which is often overlooked due to lack of standardized approaches in diagnosis, preventative measures and treatment. In this essay, we aim to stratify existing data to show specific associations between neoplastic transformation and the underlying processes which predate cancerous transition. We discuss pathomorphological, genetic, epigenetic, molecular and immunohistochemical methods related to neoplasia detection on the basis of Barrett's esophagus. Our review sheds light on pathways of such neoplastic progression in the distal esophagus, providing valuable insight into progression assessment, preventative targets and treatment modalities. Our results suggest that molecular, genetic and epigenetic alterations in the esophagus arise earlier than cancerous transformation, meaning the discussed targets can help form preventative strategies in at-risk patient groups.

Machine Learning Modeling from Omics Data as Prospective Tool for Improvement of Inflammatory Bowel Disease Diagnosis and Clinical Classifications

Research of inflammatory bowel disease (IBD) has identified numerous molecular players involved in the disease development. Even so, the understanding of IBD is incomplete, while disease treatment is still far from the precision medicine. Reliable diagnostic and prognostic biomarkers in IBD are limited which may reduce efficient therapeutic outcomes. High-throughput technologies and artificial intelligence emerged as powerful tools in search of unrevealed molecular patterns that could give important insights into IBD pathogenesis and help to address unmet clinical needs. Machine learning, a subtype of artificial intelligence, uses complex mathematical algorithms to learn from existing data in order to predict future outcomes. The scientific community has been increasingly employing machine learning for the prediction of IBD outcomes from comprehensive patient data-clinical records, genomic, transcriptomic, proteomic, metagenomic, and other IBD relevant omics data. This review aims to present fundamental principles behind machine learning modeling and its current application in IBD research with the focus on studies that explored genomic and transcriptomic data. We described different strategies used for dealing with omics data and outlined the best-performing methods. Before being translated into clinical settings, the developed machine learning models should be tested in independent prospective studies as well as randomized controlled trials.