Unraveling the interplay of image formation, data representation and learning in CT-based COPD phenotyping automation: The need for a meta-strategy

SEMPAI: a Self-Enhancing Multi-Photon Artificial Intelligence for Prior-Informed Assessment of Muscle Function and Pathology

Deep learning (DL) shows notable success in biomedical studies. However, most DL algorithms work as black boxes, exclude biomedical experts, and need extensive data. This is especially problematic for fundamental research in the laboratory, where often only small and sparse data are available and the objective is knowledge discovery rather than automation. Furthermore, basic research is usually hypothesis-driven and extensive prior knowledge (priors) exists. To address this, the Self-Enhancing Multi-Photon Artificial Intelligence (SEMPAI) that is designed for multiphoton microscopy (MPM)-based laboratory research is presented. It utilizes meta-learning to optimize prior (and hypothesis) integration, data representation, and neural network architecture simultaneously. By this, the method allows hypothesis testing with DL and provides interpretable feedback about the origin of biological information in 3D images. SEMPAI performs multi-task learning of several related tasks to enable prediction for small datasets. SEMPAI is applied on an extensive MPM database of single muscle fibers from a decade of experiments, resulting in the largest joint analysis of pathologies and function for single muscle fibers to date. It outperforms state-of-the-art biomarkers in six of seven prediction tasks, including those with scarce data. SEMPAI's DL models with integrated priors are superior to those without priors and to prior-only approaches.

Artificial Intelligence has Similar Performance to Subjective Assessment of Emphysema Severity on Chest CT

RATIONALE AND OBJECTIVES

To compare an artificial intelligence (AI)-based prototype and subjective grading for predicting disease severity in patients with emphysema.

METHODS

Our IRB approved HIPAA-compliant study included 113 adults (71±8 years; 47 females, 66 males) who had both non-contrast chest CT and pulmonary function tests performed within a span of 2 months. The disease severity was classified based on the forced expiratory volume in 1 second (FEV1 as % of predicted) into mild, moderate, and severe. 2 thoracic radiologists (RA), blinded to the clinical and AI results, graded severity of emphysema on a 5-point scale suggested by the Fleischner Society for each lobe. The whole lung scores were derived from the summation of lobar scores. Thin-section CT images were processed with the AI-Rad Companion Chest prototype (Siemens Healthineers) to quantify low attenuation areas (LAA < - 950 HU) in whole lung and each lobe separately. Bronchial abnormality was assessed by both radiologists and a fully automated software (Philips Healthcare).

RESULTS

Both AI (AUC of 0.77; 95% CI: 0.68 - 0.85) and RA (AUC: 0.76, 95% CI: 0.65 - 0.84) emphysema quantification could differentiate mild, moderate, and severe disease based on FEV1. There was a strong positive correlation between AI and RA (r = 0.72 - 0.80; p <0.001). The combination of emphysema and bronchial abnormality quantification from radiologists' and AI assessment could differentiate between different severities with AUC of 0.80 - 0.82 and 0.87, respectively.

CONCLUSION

The assessed AI-prototypes can predict the disease severity in patients with emphysema with the same predictive value as the radiologists.