A Semi-Supervised Learning Framework for Classifying Colorectal Neoplasia Based on the NICE Classification

Labelling medical images is an arduous and costly task that necessitates clinical expertise and large numbers of qualified images. Insufficient samples can lead to underfitting during training and poor performance of supervised learning models. In this study, we aim to develop a SimCLR-based semi-supervised learning framework to classify colorectal neoplasia based on the NICE classification. First, the proposed framework was trained under self-supervised learning using a large unlabelled dataset; subsequently, it was fine-tuned on a limited labelled dataset based on the NICE classification. The model was evaluated on an independent dataset and compared with models based on supervised transfer learning and endoscopists using accuracy, Matthew's correlation coefficient (MCC), and Cohen's kappa. Finally, Grad-CAM and t-SNE were applied to visualize the models' interpretations. A ResNet-backboned SimCLR model (accuracy of 0.908, MCC of 0.862, and Cohen's kappa of 0.896) outperformed supervised transfer learning-based models (means: 0.803, 0.698, and 0.742) and junior endoscopists (0.816, 0.724, and 0.863), while performing only slightly worse than senior endoscopists (0.916, 0.875, and 0.944). Moreover, t-SNE showed a better clustering of ternary samples through self-supervised learning in SimCLR than through supervised transfer learning. Compared with traditional supervised learning, semi-supervised learning enables deep learning models to achieve improved performance with limited labelled endoscopic images.

Association of the fat mass index with hepatic steatosis and fibrosis: evidence from NHANES 2017-2018

Limited population-based studies discuss the association between fat mass index (FMI) and the risk of liver diseases. This investigation utilized data from the National Health and Nutrition Examination Survey (NHANES) to examine the linkage between the FMI and liver conditions, specifically steatosis and fibrosis. The study leveraged data from NHANES's 2017-2018 cross-sectional study, employing an oversampling technique to deal with sample imbalance. Hepatic steatosis and fibrosis were identified by vibration-controlled transient elastography. Receiver operating curve was used to assess the relationship of anthropometric indicators, e.g., the FMI, body mass index (BMI), weight-adjusted-waist index (WWI), percentage of body fat (BF%), waist-to-hip ratio (WHR), and appendicular skeletal muscle index (ASMI), with hepatic steatosis and fibrosis. In this study, which included 2260 participants, multivariate logistic regression models, stratified analyses, restricted cubic spline (RCS), and sharp regression discontinuity analyses were utilized. The results indicated that the WHR and the FMI achieved the highest area under the curve for identifying hepatic steatosis and fibrosis, respectively (0.720 and 0.726). Notably, the FMI presented the highest adjusted odds ratio for both hepatic steatosis (6.40 [4.91-8.38], p = 2.34e-42) and fibrosis (6.06 [5.00, 7.37], p = 5.88e-74). Additionally, potential interaction effects were observed between the FMI and variables such as the family income-to-poverty ratio, smoking status, and hypertension, all of which correlated with the presence of liver fibrosis (p for interaction < 0.05). The RCS models further confirmed a significant positive correlation of the FMI with the controlled attenuation parameter and liver stiffness measurements. Overall, the findings underscore the strong link between the FMI and liver conditions, proposing the FMI as a potential straightforward marker for identifying liver diseases.

Development and Validation of Multimodal Models to Predict the 30-Day Mortality of ICU Patients Based on Clinical Parameters and Chest X-Rays

We aimed to develop and validate multimodal ICU patient prognosis models that combine clinical parameters data and chest X-ray (CXR) images. A total of 3798 subjects with clinical parameters and CXR images were extracted from the Medical Information Mart for Intensive Care IV (MIMIC-IV) database and an external hospital (the test set). The primary outcome was 30-day mortality after ICU admission. Automated machine learning (AutoML) and convolutional neural networks (CNNs) were used to construct single-modal models based on clinical parameters and CXR separately. An early fusion approach was used to integrate both modalities (clinical parameters and CXR) into a multimodal model named PrismICU. Compared to the single-modal models, i.e., the clinical parameter model (AUC = 0.80, F1-score = 0.43) and the CXR model (AUC = 0.76, F1-score = 0.45) and the scoring system APACHE II (AUC = 0.83, F1-score = 0.77), PrismICU (AUC = 0.95, F1 score = 0.95) showed improved performance in predicting the 30-day mortality in the validation set. In the test set, PrismICU (AUC = 0.82, F1-score = 0.61) was also better than the clinical parameters model (AUC = 0.72, F1-score = 0.50), CXR model (AUC = 0.71, F1-score = 0.36), and APACHE II (AUC = 0.62, F1-score = 0.50). PrismICU, which integrated clinical parameters data and CXR images, performed better than single-modal models and the existing scoring system. It supports the potential of multimodal models based on structured data and imaging in clinical management.

Public Imaging Datasets of Gastrointestinal Endoscopy for Artificial Intelligence: a Review

With the advances in endoscopic technologies and artificial intelligence, a large number of endoscopic imaging datasets have been made public to researchers around the world. This study aims to review and introduce these datasets. An extensive literature search was conducted to identify appropriate datasets in PubMed, and other targeted searches were conducted in GitHub, Kaggle, and Simula to identify datasets directly. We provided a brief introduction to each dataset and evaluated the characteristics of the datasets included. Moreover, two national datasets in progress were discussed. A total of 40 datasets of endoscopic images were included, of which 34 were accessible for use. Basic and detailed information on each dataset was reported. Of all the datasets, 16 focus on polyps, and 6 focus on small bowel lesions. Most datasets (n = 16) were constructed by colonoscopy only, followed by normal gastrointestinal endoscopy and capsule endoscopy (n = 9). This review may facilitate the usage of public dataset resources in endoscopic research.

Towards Personalized Medicine for Chronic Liver Disease

Chronic liver disease is a progressive deterioration of hepatic functions and a continuous process of inflammation, destruction, and regeneration of liver parenchyma, resulting in fibrosis and cirrhosis [...].