Three-dimensional label-free morphology of CD8 + T cells as a sepsis biomarker

Sepsis is a dysregulated immune response to infection that leads to organ dysfunction and is associated with a high incidence and mortality rate. The lack of reliable biomarkers for diagnosing and prognosis of sepsis is a major challenge in its management. We aimed to investigate the potential of three-dimensional label-free CD8 + T cell morphology as a biomarker for sepsis. This study included three-time points in the sepsis recovery cohort (N = 8) and healthy controls (N = 20). Morphological features and spatial distribution within cells were compared among the patients' statuses. We developed a deep learning model to predict the diagnosis and prognosis of sepsis using the internal cell morphology. Correlation between the morphological features and clinical indices were analysed. Cell morphological features and spatial distribution differed significantly between patients with sepsis and healthy controls and between the survival and non-survival groups. The model for predicting the diagnosis and prognosis of sepsis showed an area under the receiver operating characteristic curve of nearly 100% with only a few cells, and a strong correlation between the morphological features and clinical indices was observed. Our study highlights the potential of three-dimensional label-free CD8 + T cell morphology as a promising biomarker for sepsis. This approach is rapid, requires a minimum amount of blood samples, and has the potential to provide valuable information for the early diagnosis and prognosis of sepsis.

Artificial intelligence-enabled quantitative phase imaging methods for life sciences

Quantitative phase imaging, integrated with artificial intelligence, allows for the rapid and label-free investigation of the physiology and pathology of biological systems. This review presents the principles of various two-dimensional and three-dimensional label-free phase imaging techniques that exploit refractive index as an intrinsic optical imaging contrast. In particular, we discuss artificial intelligence-based analysis methodologies for biomedical studies including image enhancement, segmentation of cellular or subcellular structures, classification of types of biological samples and image translation to furnish subcellular and histochemical information from label-free phase images. We also discuss the advantages and challenges of artificial intelligence-enabled quantitative phase imaging analyses, summarize recent notable applications in the life sciences, and cover the potential of this field for basic and industrial research in the life sciences.

Prediction of Postoperative Creatinine Levels by Artificial Intelligence after Partial Nephrectomy

Background and Objectives: Multiple factors are associated with postoperative functional outcomes, such as acute kidney injury (AKI), following partial nephrectomy (PN). The pre-, peri-, and postoperative factors are heavily intertwined and change dynamically, making it difficult to predict postoperative renal function. Therefore, we aimed to build an artificial intelligence (AI) model that utilizes perioperative factors to predict residual renal function and incidence of AKI following PN. Methods and Materials: This retrospective study included 785 patients (training set 706, test set 79) from six tertiary referral centers who underwent open or robotic PN. Forty-four perioperative features were used as inputs to train the AI prediction model. XG-Boost and genetic algorithms were used for the final model selection and to determine feature importance. The primary outcome measure was immediate postoperative serum creatinine (Cr) level. The secondary outcome was the incidence of AKI (estimated glomerular filtration rate (eGFR) < 60 mL/h). The average difference between the true and predicted serum Cr levels was considered the mean absolute error (MAE) and was used as a model evaluation parameter. Results: An AI model for predicting immediate postoperative serum Cr levels was selected from 2000 candidates by providing the lowest MAE (0.03 mg/dL). The model-predicted immediate postoperative serum Cr levels correlated closely with the measured values (R2 = 0.9669). The sensitivity and specificity of the model for predicting AKI were 85.5% and 99.7% in the training set, and 100.0% and 100.0% in the test set, respectively. The limitations of this study included its retrospective design. Conclusions: Our AI model successfully predicted accurate serum Cr levels and the likelihood of AKI. The accuracy of our model suggests that personalized guidelines to optimize multidisciplinary plans involving pre- and postoperative care need to be developed.

Machine-learning-based diagnosis of thyroid fine-needle aspiration biopsy synergistically by Papanicolaou staining and refractive index distribution

We developed a machine learning algorithm (MLA) that can classify human thyroid cell clusters by exploiting both Papanicolaou staining and intrinsic refractive index (RI) as correlative imaging contrasts and evaluated the effects of this combination on diagnostic performance. Thyroid fine-needle aspiration biopsy (FNAB) specimens were analyzed using correlative optical diffraction tomography, which can simultaneously measure both, the color brightfield of Papanicolaou staining and three-dimensional RI distribution. The MLA was designed to classify benign and malignant cell clusters using color images, RI images, or both. We included 1535 thyroid cell clusters (benign: malignancy = 1128:407) from 124 patients. Accuracies of MLA classifiers using color images, RI images, and both were 98.0%, 98.0%, and 100%, respectively. As information for classification, the nucleus size was mainly used in the color image; however, detailed morphological information of the nucleus was also used in the RI image. We demonstrate that the present MLA and correlative FNAB imaging approach has the potential for diagnosing thyroid cancer, and complementary information from color and RI images can improve the performance of the MLA.

Feasibility of artificial intelligence-based decision supporting system in tolvaptan prescription for autosomal dominant polycystic kidney disease

PURPOSE

Total kidney volume (TKV) measurement is crucial for selecting treatment candidates in autosomal dominant polycystic kidney disease (ADPKD). We developed and investigated the performance of fully-automated 3D-volumetry model and applied it to software as a service (SaaS) for clinical support on tolvaptan prescription in ADPKD patients.

MATERIALS AND METHODS

Computed tomography scans of ADPKD patients taken between January 2000 and June 2022 were acquired from seven institutions. The quality of the images was manually reviewed in advance. The acquired dataset was split into training, validation, and test datasets at a ratio of 8.5:1:0.5. Convolutional, neural network-based automatic segmentation model was trained to obtain 3D segment mask for TKV measurement. The algorithm consisted of three steps: data preprocessing, ADPKD area extraction, and post-processing. After performance validation with the Dice score, 3D-volumetry model was applied to SaaS which is based on Mayo imaging classification for ADPKD.

RESULTS

A total of 753 cases with 95,117 slices were included. The differences between the ground-truth ADPKD kidney mask and the predicted ADPKD kidney mask were negligible, with intersection over union >0.95. The post-process filter successfully removed false alarms. The test-set performance was homogeneously equal and the Dice score of the model was 0.971; after post-processing, it improved to 0.979. The SaaS calculated TKV from uploaded Digital Imaging and Communications in Medicine images and classified patients according to height-adjusted TKV for age.

CONCLUSIONS

Our artificial intelligence-3D volumetry model exhibited effective, feasible, and non-inferior performance compared with that of human experts and successfully predicted the rapid ADPKD progressor.

Rapid species identification of pathogenic bacteria from a minute quantity exploiting three-dimensional quantitative phase imaging and artificial neural network

The healthcare industry is in dire need of rapid microbial identification techniques for treating microbial infections. Microbial infections are a major healthcare issue worldwide, as these widespread diseases often develop into deadly symptoms. While studies have shown that an early appropriate antibiotic treatment significantly reduces the mortality of an infection, this effective treatment is difficult to practice. The main obstacle to early appropriate antibiotic treatments is the long turnaround time of the routine microbial identification, which includes time-consuming sample growth. Here, we propose a microscopy-based framework that identifies the pathogen from single to few cells. Our framework obtains and exploits the morphology of the limited sample by incorporating three-dimensional quantitative phase imaging and an artificial neural network. We demonstrate the identification of 19 bacterial species that cause bloodstream infections, achieving an accuracy of 82.5% from an individual bacterial cell or cluster. This performance, comparable to that of the gold standard mass spectroscopy under a sufficient amount of sample, underpins the effectiveness of our framework in clinical applications. Furthermore, our accuracy increases with multiple measurements, reaching 99.9% with seven different measurements of cells or clusters. We believe that our framework can serve as a beneficial advisory tool for clinicians during the initial treatment of infections.

Label-free multiplexed microtomography of endogenous subcellular dynamics using generalizable deep learning

Simultaneous imaging of various facets of intact biological systems across multiple spatiotemporal scales is a long-standing goal in biology and medicine, for which progress is hindered by limits of conventional imaging modalities. Here we propose using the refractive index (RI), an intrinsic quantity governing light-matter interaction, as a means for such measurement. We show that major endogenous subcellular structures, which are conventionally accessed via exogenous fluorescence labelling, are encoded in three-dimensional (3D) RI tomograms. We decode this information in a data-driven manner, with a deep learning-based model that infers multiple 3D fluorescence tomograms from RI measurements of the corresponding subcellular targets, thereby achieving multiplexed microtomography. This approach, called RI2FL for refractive index to fluorescence, inherits the advantages of both high-specificity fluorescence imaging and label-free RI imaging. Importantly, full 3D modelling of absolute and unbiased RI improves generalization, such that the approach is applicable to a broad range of new samples without retraining to facilitate immediate applicability. The performance, reliability and scalability of this technology are extensively characterized, and its various applications within single-cell profiling at unprecedented scales (which can generate new experimentally testable hypotheses) are demonstrated.

Label-Free White Blood Cell Classification Using Refractive Index Tomography and Deep Learning

Objective and Impact Statement. We propose a rapid and accurate blood cell identification method exploiting deep learning and label-free refractive index (RI) tomography. Our computational approach that fully utilizes tomographic information of bone marrow (BM) white blood cell (WBC) enables us to not only classify the blood cells with deep learning but also quantitatively study their morphological and biochemical properties for hematology research. Introduction. Conventional methods for examining blood cells, such as blood smear analysis by medical professionals and fluorescence-activated cell sorting, require significant time, costs, and domain knowledge that could affect test results. While label-free imaging techniques that use a specimen's intrinsic contrast (e.g., multiphoton and Raman microscopy) have been used to characterize blood cells, their imaging procedures and instrumentations are relatively time-consuming and complex. Methods. The RI tomograms of the BM WBCs are acquired via Mach-Zehnder interferometer-based tomographic microscope and classified by a 3D convolutional neural network. We test our deep learning classifier for the four types of bone marrow WBC collected from healthy donors (n = 10 ): monocyte, myelocyte, B lymphocyte, and T lymphocyte. The quantitative parameters of WBC are directly obtained from the tomograms. Results. Our results show >99% accuracy for the binary classification of myeloids and lymphoids and >96% accuracy for the four-type classification of B and T lymphocytes, monocyte, and myelocytes. The feature learning capability of our approach is visualized via an unsupervised dimension reduction technique. Conclusion. We envision that the proposed cell classification framework can be easily integrated into existing blood cell investigation workflows, providing cost-effective and rapid diagnosis for hematologic malignancy.

DeepRegularizer: Rapid Resolution Enhancement of Tomographic Imaging Using Deep Learning

Optical diffraction tomography measures the three-dimensional refractive index map of a specimen and visualizes biochemical phenomena at the nanoscale in a non-destructive manner. One major drawback of optical diffraction tomography is poor axial resolution due to limited access to the three-dimensional optical transfer function. This missing cone problem has been addressed through regularization algorithms that use a priori information, such as non-negativity and sample smoothness. However, the iterative nature of these algorithms and their parameter dependency make real-time visualization impossible. In this article, we propose and experimentally demonstrate a deep neural network, which we term DeepRegularizer, that rapidly improves the resolution of a three-dimensional refractive index map. Trained with pairs of datasets (a raw refractive index tomogram and a resolution-enhanced refractive index tomogram via the iterative total variation algorithm), the three-dimensional U-net-based convolutional neural network learns a transformation between the two tomogram domains. The feasibility and generalizability of our network are demonstrated using bacterial cells and a human leukaemic cell line, and by validating the model across different samples. DeepRegularizer offers more than an order of magnitude faster regularization performance compared to the conventional iterative method. We envision that the proposed data-driven approach can bypass the high time complexity of various image reconstructions in other imaging modalities.

Deep-learning-based three-dimensional label-free tracking and analysis of immunological synapses of CAR-T cells

The immunological synapse (IS) is a cell-cell junction between a T cell and a professional antigen-presenting cell. Since the IS formation is a critical step for the initiation of an antigen-specific immune response, various live-cell imaging techniques, most of which rely on fluorescence microscopy, have been used to study the dynamics of IS. However, the inherent limitations associated with the fluorescence-based imaging, such as photo-bleaching and photo-toxicity, prevent the long-term assessment of dynamic changes of IS with high frequency. Here, we propose and experimentally validate a label-free, volumetric, and automated assessment method for IS dynamics using a combinational approach of optical diffraction tomography and deep learning-based segmentation. The proposed method enables an automatic and quantitative spatiotemporal analysis of IS kinetics of morphological and biochemical parameters associated with IS dynamics, providing a new option for immunological research.

Calibration-free quantitative phase imaging using data-driven aberration modeling

We present a data-driven approach to compensate for optical aberrations in calibration-free quantitative phase imaging (QPI). Unlike existing methods that require additional measurements or a background region to correct aberrations, we exploit deep learning techniques to model the physics of aberration in an imaging system. We demonstrate the generation of a single-shot aberration-corrected field image by using a U-net-based deep neural network that learns a translation between an optical field with aberrations and an aberration-corrected field. The high fidelity and stability of our method is demonstrated on 2D and 3D QPI measurements of various confluent eukaryotic cells and microbeads, benchmarking against the conventional method using background subtractions.

Label-free 3-D quantitative phase imaging cytometry with deep learning: identifying naive, memory, and senescent T cells

The current prevailing methods for identifying immune cell subsets exploit a group of differentiation markers (CDs) targeted by fluorochrome or metal conjugated antibodies. However, such labeling methods, requiring a staining process and specific reagents, prevent rapid and cost-effective identification of immune cell subsets. Therefore we developed a label-free imaging cytometry platform that synergistically used refractive index (RI) tomography and three-dimensional (3-D) deep learning. We constructed and trained a deep learning classifier that learns unique representations from the 3-D RI map of each cell obtained using RI tomography without labeling. In this study, we were able to classify human naïve, memory, and senescent T cells according to the expression of CD4, CD8, CD45RA, CCR7 and CD57 using the label-free classifier within milliseconds, with high precision (&gt;95%) even though the morphological and biochemical characteristics extracted from the RI tomograms of the T cells are almost homogeneous. This cannot be achieved by conventional machine learning approaches that only exploit the set of manually extracted features. Our label-free cell sorting platform will facilitate rapid and cost-effective immunological and biomedical studies by eliminating the laborious labeling process.

Angiography-Based Machine Learning for Predicting Fractional Flow Reserve in Intermediate Coronary Artery Lesions

Background An angiography-based supervised machine learning ( ML ) algorithm was developed to classify lesions as having fractional flow reserve ≤0.80 versus >0.80. Methods and Results With a 4:1 ratio, 1501 patients with 1501 intermediate lesions were randomized into training versus test sets. Between the ostium and 10 mm distal to the target lesion, a series of angiographic lumen diameter measurements along the centerline was plotted. The 24 computed angiographic features based on the diameter plot and 4 clinical features (age, sex, body surface area, and involve segment) were used for ML by XGBoost. The model was independently trained and tested by 2000 bootstrap iterations. External validation with 79 patients was conducted. Including all 28 features, the ML model with 5-fold cross-validation in the 1204 training samples predicted fractional flow reserve ≤0.80 with overall diagnostic accuracy of 78±4% (averaged area under the curve: 0.84±0.03). The 12 high-ranking features selected by scatter search were involved segment; body surface area; distal lumen diameter; minimal lumen diameter; length of a lumen diameter <2.0 mm, <1.5 mm, and <1.25 mm; mean lumen diameter within the worst segment; sex; diameter stenosis; distal 5-mm reference lumen diameter; and length of diameter stenosis >70%. Using those 12 features, the ML predicted fractional flow reserve ≤0.80 in the test set with sensitivity of 84%, specificity of 80%, and overall accuracy of 82% (area under the curve: 0.87). The averaged diagnostic accuracy in bootstrap replicates was 81±1% (averaged area under the curve: 0.87±0.01). External validation showed accuracy of 85% (area under the curve: 0.87). Conclusions Angiography-based ML showed good diagnostic performance in identifying ischemia-producing lesions and reduced the need for pressure wires.

Prediction of coronary thin-cap fibroatheroma by intravascular ultrasound-based machine learning

BACKGROUND AND AIMS

Although grayscale intravascular ultrasound (IVUS) is commonly used for assessing coronary lesion morphology and optimizing stent implantation, detection of vulnerable plaques by IVUS remains challenging. We aimed to develop machine learning (ML) models for predicting optical coherence tomography-derived thin-cap fibroatheromas (OCT-TCFAs).

METHODS

In 517 patients with angina, 414 and 103 coronary lesions were randomized into training vs. test sets. Each of the IVUS-OCT co-registered frames (including 32,807 for training and 8101 for test) was labeled according to the presence vs. absence of OCT-TCFA. Among 1449 computed IVUS features based on two-dimensional geometry and texture, 17 features were finally selected and used in supervised ML with artificial neural network (ANN), support vector machine (SVM), and naïve Bayes.

RESULTS

IVUS sections with (vs. without) OCT-TCFA showed a larger plaque burden, and a smaller and eccentric lumen. TCFA-containing sections were characterized by increased ratios of variance, entropy, and kurtosis; reduced ratio of homogeneity within the superficial to the deeper plaque; and decreased smoothness within the fibrous cap. In addition, OCT-TCFA was associated with low ratios of gamma-beta, Nakagami-μ and Nakagami-ω, and a high ratio of Rayleigh-b within the superficial to the deeper region. With a 5-fold cross-validation, the averaged accuracies were 81 ± 5% for ANN (area under the curve [AUC] = 0.80 ± 0.08), 77 ± 4% for SVM (AUC = 0.74 ± 0.05), and 78 ± 2% for naïve Bayes (AUC = 0.77 ± 0.04) for predicting OCT-TCFA. In the test set, ANN and naïve Bayes showed the overall accuracies of >80%.

CONCLUSIONS

Supervised ML algorithms with computed IVUS features predicted the presence of OCT-TCFA. This data-driven approach may help clinicians in recognizing high-risk coronary lesions.

Cycle-consistent deep learning approach to coherent noise reduction in optical diffraction tomography

We present a deep neural network to reduce coherent noise in three-dimensional quantitative phase imaging. Inspired by the cycle generative adversarial network, the denoising network was trained to learn a transform between two image domains: clean and noisy refractive index tomograms. The unique feature of this network, distinct from previous machine learning approaches employed in the optical imaging problem, is that it uses unpaired images. The learned network quantitatively demonstrated its performance and generalization capability through denoising experiments of various samples. We concluded by applying our technique to reduce the temporally changing noise emerging from focal drift in time-lapse imaging of biological cells. This reduction cannot be performed using other optical methods for denoising.

The Role of Core Needle Biopsy and Its Impact on Surgical Management in Patients with Medullary Thyroid Cancer: Clinical Experience at 3 Medical Institutions

BACKGROUND AND PURPOSE

Medullary thyroid carcinoma is an uncommon malignancy that is challenging to diagnose. Our aim was to present our experience using core needle biopsy for the diagnosis of medullary thyroid carcinoma compared with fine-needle aspiration.

MATERIALS AND METHODS

Between January 2000 and March 2012, 202 thyroid nodules in 191 patients were diagnosed as medullary thyroid cancer by using sonography-guided fine-needle aspiration, core needle biopsy, or surgery. One hundred eighty-three thyroid nodules in 172 patients were included on the basis of the final diagnosis. We evaluated the sensitivity and positive predictive value of fine-needle aspiration and core needle biopsy for the diagnosis of medullary thyroid cancer. We compared the rate of a delayed diagnosis, a diagnostic surgery, and surgery with an incorrect diagnosis for fine-needle aspiration and core needle biopsy and investigated the factors related to the fine-needle aspiration misdiagnosis of medullary thyroid cancer.

RESULTS

Fine-needle aspiration showed 43.8% sensitivity and 85.1% positive predictive value for the diagnosis of medullary thyroid cancer; 25.7% (44/171) of patients had a delayed diagnosis, while 18.7% (32/171) underwent an operation for accurate diagnosis, and 20.5% (35/171) underwent an operation with an incorrect diagnosis. Core needle biopsy achieved 100% sensitivity and positive predictive value without a delay in diagnosis (0/22), the need for a diagnostic operation (0/22), or an operation for an incorrect diagnosis (0/22). A calcitonin level of <100 pg/mL was the only significant factor for predicting the fine-needle aspiration misdiagnosis of medullary thyroid cancer (P = .034).

CONCLUSIONS

Core needle biopsy showed a superior sensitivity and positive predictive value to fine-needle aspiration and could optimize the surgical management in patients with medullary thyroid cancer. Because the ability of fine-needle aspiration to diagnose medullary thyroid cancer significantly decreases in patients with serum calcitonin levels of <100 pg/mL, core needle biopsy could be indicated for these patients to optimize their surgical management.

High tumour islet macrophage infiltration correlates with improved patient survival but not with EGFR mutations, gene copy number or protein expression in resected non-small cell lung cancer

The purpose of this study was to investigate the prognostic value of tumour-associated macrophages with a focus on micro-anatomical localisation and determine whether molecular changes of the epidermal growth factor receptor (EGFR) are related to macrophage infiltration in resected non-small cell lung cancer (NSCLC). One hundred and forty-four patients were included in this study. Immunohistochemistry was used to identify CD68+ macrophages in the tumour islet and surrounding stroma. Epidermal growth factor receptor mutations were studied by direct sequencing. The EGFR gene copy number and protein expression were analysed by fluorescence in situ hybridisation and immunohistochemistry. Patients with a high tumour islet macrophage density survived longer than did the patient with a low tumour islet macrophage density (5-year overall survival rate was 63.9 vs 38.9%, P=0.0002). A multivariate Cox proportional hazard analysis revealed that the tumour islet macrophage count was an independent prognostic factor for survival (hazard ratio 0.471, 95% confidence interval 0.300-0.740). However, EGFR mutations, gene copy number, and protein expression were not related to the macrophage infiltration. In conclusion, tumour islet macrophage infiltration was identified as a strong favourable independent prognostic marker for survival but not correlated with the molecular changes of the EGFR in patients with resected NSCLC.