Decoding biological age from face photographs using deep learning

Because humans age at different rates, a person's physical appearance may yield insights into their biological age and physiological health more reliably than their chronological age. In medicine, however, appearance is incorporated into medical judgments in a subjective and non-standardized fashion. In this study, we developed and validated FaceAge, a deep learning system to estimate biological age from easily obtainable and low-cost face photographs. FaceAge was trained on data from 58,851 healthy individuals, and clinical utility was evaluated on data from 6,196 patients with cancer diagnoses from two institutions in the United States and The Netherlands. To assess the prognostic relevance of FaceAge estimation, we performed Kaplan Meier survival analysis. To test a relevant clinical application of FaceAge, we assessed the performance of FaceAge in end-of-life patients with metastatic cancer who received palliative treatment by incorporating FaceAge into clinical prediction models. We found that, on average, cancer patients look older than their chronological age, and looking older is correlated with worse overall survival. FaceAge demonstrated significant independent prognostic performance in a range of cancer types and stages. We found that FaceAge can improve physicians' survival predictions in incurable patients receiving palliative treatments, highlighting the clinical utility of the algorithm to support end-of-life decision-making. FaceAge was also significantly associated with molecular mechanisms of senescence through gene analysis, while age was not. These findings may extend to diseases beyond cancer, motivating using deep learning algorithms to translate a patient's visual appearance into objective, quantitative, and clinically useful measures.

Development and Validation of an Automated Image-Based Deep Learning Platform for Sarcopenia Assessment in Head and Neck Cancer

Importance

Sarcopenia is an established prognostic factor in patients with head and neck squamous cell carcinoma (HNSCC); the quantification of sarcopenia assessed by imaging is typically achieved through the skeletal muscle index (SMI), which can be derived from cervical skeletal muscle segmentation and cross-sectional area. However, manual muscle segmentation is labor intensive, prone to interobserver variability, and impractical for large-scale clinical use.

Objective

To develop and externally validate a fully automated image-based deep learning platform for cervical vertebral muscle segmentation and SMI calculation and evaluate associations with survival and treatment toxicity outcomes.

Design, Setting, and Participants

For this prognostic study, a model development data set was curated from publicly available and deidentified data from patients with HNSCC treated at MD Anderson Cancer Center between January 1, 2003, and December 31, 2013. A total of 899 patients undergoing primary radiation for HNSCC with abdominal computed tomography scans and complete clinical information were selected. An external validation data set was retrospectively collected from patients undergoing primary radiation therapy between January 1, 1996, and December 31, 2013, at Brigham and Women's Hospital. The data analysis was performed between May 1, 2022, and March 31, 2023.

Exposure

C3 vertebral skeletal muscle segmentation during radiation therapy for HNSCC.

Main Outcomes and Measures

Overall survival and treatment toxicity outcomes of HNSCC.

Results

The total patient cohort comprised 899 patients with HNSCC (median [range] age, 58 [24-90] years; 140 female [15.6%] and 755 male [84.0%]). Dice similarity coefficients for the validation set (n = 96) and internal test set (n = 48) were 0.90 (95% CI, 0.90-0.91) and 0.90 (95% CI, 0.89-0.91), respectively, with a mean 96.2% acceptable rate between 2 reviewers on external clinical testing (n = 377). Estimated cross-sectional area and SMI values were associated with manually annotated values (Pearson r = 0.99; P < .001) across data sets. On multivariable Cox proportional hazards regression, SMI-derived sarcopenia was associated with worse overall survival (hazard ratio, 2.05; 95% CI, 1.04-4.04; P = .04) and longer feeding tube duration (median [range], 162 [6-1477] vs 134 [15-1255] days; hazard ratio, 0.66; 95% CI, 0.48-0.89; P = .006) than no sarcopenia.

Conclusions and Relevance

This prognostic study's findings show external validation of a fully automated deep learning pipeline to accurately measure sarcopenia in HNSCC and an association with important disease outcomes. The pipeline could enable the integration of sarcopenia assessment into clinical decision making for individuals with HNSCC.

Elevated Coronary Artery Calcium Quantified by a Validated Deep Learning Model From Lung Cancer Radiotherapy Planning Scans Predicts Mortality

PURPOSE

Coronary artery calcium (CAC) quantified on computed tomography (CT) scans is a robust predictor of atherosclerotic coronary disease; however, the feasibility and relevance of quantitating CAC from lung cancer radiotherapy planning CT scans is unknown. We used a previously validated deep learning (DL) model to assess whether CAC is a predictor of all-cause mortality and major adverse cardiac events (MACEs).

METHODS

Retrospective analysis of non-contrast-enhanced radiotherapy planning CT scans from 428 patients with locally advanced lung cancer is performed. The DL-CAC algorithm was previously trained on 1,636 cardiac-gated CT scans and tested on four clinical trial cohorts. Plaques ≥ 1 cubic millimeter were measured to generate an Agatston-like DL-CAC score and grouped as DL-CAC = 0 (very low risk) and DL-CAC ≥ 1 (elevated risk). Cox and Fine and Gray regressions were adjusted for lung cancer and cardiovascular factors.

RESULTS

The median follow-up was 18.1 months. The majority (61.4%) had a DL-CAC ≥ 1. There was an increased risk of all-cause mortality with DL-CAC ≥ 1 versus DL-CAC = 0 (adjusted hazard ratio, 1.51; 95% CI, 1.01 to 2.26; P = .04), with 2-year estimates of 56.2% versus 45.4%, respectively. There was a trend toward increased risk of major adverse cardiac events with DL-CAC ≥ 1 versus DL-CAC = 0 (hazard ratio, 1.80; 95% CI, 0.87 to 3.74; P = .11), with 2-year estimates of 7.3% versus 1.2%, respectively.

CONCLUSION

In this proof-of-concept study, CAC was effectively measured from routinely acquired radiotherapy planning CT scans using an automated model. Elevated CAC, as predicted by the DL model, was associated with an increased risk of mortality, suggesting a potential benefit for automated cardiac risk screening before cancer therapy begins.

Dosimetric Planning Tradeoffs to Reduce Heart Dose Using Machine Learning-Guided Decision Support Software in Patients with Lung Cancer

BACKGROUND AND PURPOSE

Cardiac toxicity is a well-recognized risk following radiotherapy (RT) in patients with non-small cell lung cancer (NSCLC). However, the extent to which treatment planning optimization can reduce mean heart dose (MHD) without untoward increases in lung dose is unknown.

MATERIALS AND METHODS

Retrospective analysis of RT plans from 353 consecutive patients with locally advanced NSCLC treated with intensity-modulated RT (IMRT) or 3-dimensional conformal RT (3D-CRT). Commercially available machine learning-guided clinical decision support software was utilized to match RT plans. A leave-one-out predictive model was used to examine lung dosimetric tradeoffs necessary to achieve a MHD reduction.

RESULTS

Thirty-nine percent (91/232) of patients had RT plan matches showing potential MHD reductions of >4 to 8 Gy, without violating the upper limit of lung dose constraints (lung volume [V] receiving 20 Gy (V20Gy)<37%, V5Gy<70%, and mean lung dose [MLD]<20Gy). When switching to IMRT, 72.8% (75/103) had plan matches demonstrating improved MHD (average 2.0 Gy reduction, P<.0001) without violation of lung constraints. Examining specific lung dose tradeoffs, a mean ≥3.7 Gy MHD reduction was achieved with corresponding absolute increases in lung V20Gy, V5Gy, and MLD of 3.3%, 5.0%, and 1.0 Gy, respectively.

CONCLUSION

Nearly 40% of RT plans overall, and 73% when switched to IMRT, were predicted to have reductions in MHD >4 Gy with potentially clinically acceptable tradeoffs in lung dose. These observations demonstrate that decision support software for optimizing heart-lung dosimetric tradeoffs is feasible and may identify patients who might benefit most from more advanced RT technologies.

Deep-learning system to improve the quality and efficiency of volumetric heart segmentation for breast cancer

Although artificial intelligence algorithms are often developed and applied for narrow tasks, their implementation in other medical settings could help to improve patient care. Here we assess whether a deep-learning system for volumetric heart segmentation on computed tomography (CT) scans developed in cardiovascular radiology can optimize treatment planning in radiation oncology. The system was trained using multi-center data (n = 858) with manual heart segmentations provided by cardiovascular radiologists. Validation of the system was performed in an independent real-world dataset of 5677 breast cancer patients treated with radiation therapy at the Dana-Farber/Brigham and Women’s Cancer Center between 2008–2018. In a subset of 20 patients, the performance of the system was compared to eight radiation oncology experts by assessing segmentation time, agreement between experts, and accuracy with and without deep-learning assistance. To compare the performance to segmentations used in the clinic, concordance and failures (defined as Dice < 0.85) of the system were evaluated in the entire dataset. The system was successfully applied without retraining. With deep-learning assistance, segmentation time significantly decreased (4.0 min [IQR 3.1–5.0] vs. 2.0 min [IQR 1.3–3.5]; p < 0.001), and agreement increased (Dice 0.95 [IQR = 0.02]; vs. 0.97 [IQR = 0.02], p < 0.001). Expert accuracy was similar with and without deep-learning assistance (Dice 0.92 [IQR = 0.02] vs. 0.92 [IQR = 0.02]; p = 0.48), and not significantly different from deep-learning-only segmentations (Dice 0.92 [IQR = 0.02]; p ≥ 0.1). In comparison to real-world data, the system showed high concordance (Dice 0.89 [IQR = 0.06]) across 5677 patients and a significantly lower failure rate (p < 0.001). These results suggest that deep-learning algorithms can successfully be applied across medical specialties and improve clinical care beyond the original field of interest.