Image-based deep learning model for predicting pathological response in rectal cancer using post-chemoradiotherapy magnetic resonance imaging

MRI radiomics combined with delta-radiomics model for predicting pathological complete response in locally advanced rectal cancer patients after neoadjuvant chemoradiotherapy: A multi-institutional study

PURPOSE

To construct and validate a magnetic resonance imaging (MRI) radiomics combined with delta-radiomics and clinical information (C) model for predicting pathological complete response (pCR) in patients with locally advanced rectal cancer (LARC) after neoadjuvant chemoradiotherapy (nCRT).

METHODS

A total of 198 patients with LARC who underwent MRI before and after nCRT were retrospectively enrolled in this multi-institutional retrospective study. MRI radiomics features were extracted from pre- and post-nCRT diffusion weighted imaging (DWI) and T2-weighted imaging (T2WI) images. The least absolute shrinkage and selection operator (LASSO) and principal component analysis (PCA) algorithm were used to select the optimal predictive features. We constructed the following models, four single-modal radiomics models: DWI-post, DWI-pre, T2-post, T2-pre, two delta-radiomics models: DWI-delta, T2-delta and four multi-modal fusion models: DWI-post + DWI-pre, DWI-post + DWI-delta, DWI-post + DWI-delta + T2-delta, DWI-post + DWI-delta + T2-delta + C. The models were developed using four machine learning classifiers, including Decision Tree (DT), random forest (RF), support vector machine (SVM), and extreme gradient boosting (XGBoost).

RESULTS

The multi-modal fusion model DWI-post + DWI-delta + T2-delta achieved the best performance with an area under the curve (AUC) of 0.879 for predicting pCR, which was significantly higher than that of the single-modal model DWI-post (optimal AUC = 0.824), DWI-pre (optimal AUC = 0.836) and the delta-radiomics model DWI-delta (optimal AUC = 0.841), T2-delta (optimal AUC = 0.837) in the internal validation sets. XGBoost classifier showed better prediction performance than the other classifiers in the most models. The DWI-post + DWI-pre model with DT classifier and PCA feature selection achieved the highest AUC of 0.754 and the DWI-post + DWI-delta + T2-delta + C model with SVM classifier and LASSO feature selection achieved the suboptimal AUC of 0.734 in the external validation sets.

CONCLUSION

The multi-modal fusion model significantly outperforms conventional single-modal prediction models. The model could be used as a reliable and noninvasive tool for the personalized therapy in LARC patients.

Volumetric histogram analysis of amide proton transfer-weighted imaging for predicting complete tumor response to neoadjuvant chemoradiotherapy in locally advanced rectal adenocarcinoma

OBJECTIVES

To investigate the potential of histogram analysis applied to pre-treatment amide proton transfer-weighted (APTw) imaging in predicting complete pathological regression (pCR) in patients with locally advanced rectal cancer (LARC) undergoing neoadjuvant chemoradiotherapy (nCRT).

MATERIALS AND METHODS

This retrospective study enrolled LARC patients who underwent preoperative rectal magnetic resonance imaging (MRI). Based on histologic assessment, the patients were divided into a pathological complete response (pCR) group or a non-pCR group. APTw histogram features, apparent diffusion coefficient (ADC), and clinical parameters were analyzed. Mann-Whitney U-test, Spearman rank correlation, and univariate and multivariate logistic regression were used for statistical analysis. The predictive performances of different models were evaluated by the receiver operating characteristic curve (ROC).

RESULTS

One-hundred forty-five patients were included (mean age, 61.6 years ± 11.8 [SD]; 87 men). pCR patients exhibited lower pre-treatment ADC value, higher pre-treatment APTw-10%, APTw-90%, minimum, maximum, median, mean, range, and root mean square (RMS) of the primary tumor compared to non-pCR patients (all p < 0.05). APTw-10%, APTw-90%, maximum, mean, median, minimum, range, and RMS showed negative correlations with the tumor regression grade (TRG) category (r ranged between -0.457 and -0.173; all p < 0.005). Skewness, kurtosis, and entropy exhibited positive correlations with the TRG category (r = 0.278, 0.319, and 0.324, respectively; all p < 0.05). The combined model had a higher AUC of 0.930, with 93.9% sensitivity and 83.9% specificity.

CONCLUSION

Histogram analysis of pre-treatment APTw may hold promise as a novel approach for predicting the response of LARC patients to nCRT.

KEY POINTS

Question Predicting response to nCRT is crucial for early stratified management of LARC patients; however, current radiological studies remain inconclusive. Finding LARC patients with pCR is correlated with higher pre-treatment APTw intensity-related and lower shape-related histogram features. Clinical relevance The APTw-histogram model and the APTw-clinical combined model demonstrated strong diagnostic efficacy and clinical practicality in predicting LARC patients' responsiveness to nCRT, offering new insights for early clinical decision-making.

MRI radiomics prediction modelling for pathological complete response to neoadjuvant chemoradiotherapy in locally advanced rectal cancer: a systematic review and meta-analysis

PURPOSE

Predicting response to neoadjuvant therapy in locally advanced rectal cancer (LARC) is challenging. Organ preservation strategies can be offered to patients with complete clinical response. We aim to evaluate MRI-derived radiomics models in predicting complete pathological response (pCR).

METHODS

Search included MEDLINE, Embase and Cochrane Central Register of Controlled Trials (CENTRAL) and Cochrane Database of Systematic Reviews (CDSR) for studies published before 1st February 2024. The Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) and Radiomics Quality Score (RQS) tools were used to assess quality of included study. The research protocol was registered in PROSPERO (CRD42024512865). We calculated pooled area under the receiver operating characteristic curve (AUC) using a random-effects model. To compare AUC between subgroups the Hanley & McNeil test was performed.

RESULTS

Forty-four eligible studies (12,714 patients) were identified for inclusion in the systematic review. We selected thirty-five studies including 10,543 patients for meta-analysis. The pooled AUC for MRI radiomics predicted pCR in LARC was 0.87 (95% CI 0.84-0.89). In the subgroup analysis 3 T MRI field intensity had higher pooled AUC 0.9 (95% CI 0.87-0.94) than 1.5 T pooled AUC 0.82 (95% CI 0.80-0.83) p < 0.001. Asian ethnicity had higher pooled AUC 0.9 (95% CI 0.87-0.93) than non-Asian pooled AUC 0.8 (95% CI 0.75-0.84) p < 0.001.

CONCLUSION

We have demonstrated that 3 T MRI field intensity provides a superior predictive performance. The role of ethnicity on radiomics features needs to be explored in future studies. Further research in the field of MRI radiomics is important as accurate prediction for pCR can lead to organ preservation strategy in LARC.

Predictors of para-aortic lymph node metastasis based on pathological diagnosis via surgical staging in patients with locally advanced cervical cancer: A multicenter study

Para-aortic lymph node (PALN) metastasis of patients with locally advanced cervical cancer (LACC) is associated with multiple risk factors. This study aimed to identify risk factors and develop a predictive model for PALN metastasis based on the pathological diagnosis via surgical staging to determine the patient-population suitable for extended-field irradiation (EFRT) and clarify the prognosis of patients with LACC. Five parameters were identified as predictors by logistic regression analysis. The predictive model was displayed as a nomogram and then modified into a simple scoring system. The concordance indices for the prediction nomogram were 0.939 in the training cohort, and 0.954 in the validation cohort, respectively. The scoring system consisted of tumor size, histological type, number of pelvic lymph nodes (PLNs), common iliac lymph node, and shorter diameter of the largest PLN. With a cutoff value of 8 points, the sensitivity and specificity of the predictive model were 91.04 % and 85.37 %, respectively, in the training cohort, and 89.47 % and 84.68 %, respectively, in the validation cohort. Using this system, patients were divided into high- and low-risk groups. Patients in the high-risk group showed a greater likelihood of PALN metastasis and worse PFS and OS than those in the low-risk group. The predictive model displays promise for the pathological diagnosis of PALN via surgical staging, offering good accuracy. It provides a non-invasive, practical tool to guide precise radiation strategy and stratify prognosis of patients with LACC.

MRI-based radiomics for predicting pathological complete response after neoadjuvant chemoradiotherapy in locally advanced rectal cancer: a systematic review and meta-analysis

Purpose

To evaluate the value of MRI-based radiomics for predicting pathological complete response (pCR) after neoadjuvant chemoradiotherapy (NCRT) in patients with locally advanced rectal cancer (LARC) through a systematic review and meta-analysis.

Methods

A systematic literature search was conducted in PubMed, Embase, Proquest, Cochrane Library, and Web of Science databases, covering studies up to July 1st, 2024, on the diagnostic accuracy of MRI radiomics for predicting pCR in LARC patients following NCRT. Two researchers independently evaluated and selected studies using the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) tool and the Radiomics Quality Score (RQS) tool. A random-effects model was employed to calculate the pooled sensitivity, specificity, and diagnostic odds ratio (DOR) for MRI radiomics in predicting pCR. Meta-regression and subgroup analyses were performed to explore potential sources of heterogeneity. Statistical analyses were performed using RevMan 5.4, Stata 17.0, and Meta-Disc 1.4.

Results

A total of 35 studies involving 9,696 LARC patients were included in this meta-analysis. The average RQS score of the included studies was 13.91 (range 9.00-24.00), accounting for 38.64% of the total score. According to QUADAS-2, there were risks of bias in patient selection and flow and timing domain, though the overall quality of the studies was acceptable. MRI-based radiomics showed no significant threshold effect in predicting pCR (Spearman correlation coefficient=0.119, P=0.498) but exhibited high heterogeneity (I2≥50%). The pooled sensitivity, specificity, positive likelihood ratio, negative likelihood ratio and DOR were 0.83, 0.82, 5.1, 0.23 and 27.22 respectively, with an area under the summary receiver operating characteristic (sROC) curve of 0.91. According to joint model analysis, publication year, country, multi-magnetic field strength, multi-MRI sequence, ROI structure, contour consistency, feature extraction software, and feature quantity after feature dimensionality reduction were potential sources of heterogeneity. Deeks' funnel plot suggested no significant publication bias (P=0.69).

Conclusions

MRI-based radiomics demonstrates high efficacy for predicting pCR in LARC patients following NCRT, holding significant promise for informing clinical decision-making processes and advancing individualized treatment in rectal cancer patients.

Systematic review registration

https://www.crd.york.ac.uk/prospero/, identifier CRD42024611733.

Deep learning algorithms for predicting pathological complete response in MRI of rectal cancer patients undergoing neoadjuvant chemoradiotherapy: a systematic review

PURPOSE

This systematic review examines the utility of deep learning algorithms in predicting pathological complete response (pCR) in rectal cancer patients undergoing neoadjuvant chemoradiotherapy (nCRT). The primary goal is to evaluate the performance of MRI-based artificial intelligence (AI) models and explore factors affecting their diagnostic accuracy.

METHODS

The review followed PRISMA guidelines and is registered with PROSPERO (CRD42024628017). Literature searches were conducted in PubMed, Embase, and Cochrane Library using keywords such as "artificial intelligence," "rectal cancer," "MRI," and "pathological complete response." Articles involving deep learning models applied to MRI for predicting pCR were included, excluding non-MRI data and studies without AI applications. Data on study characteristics, MRI sequences, AI model details, and performance metrics were extracted. Quality assessment was performed using the PROBAST tool.

RESULTS

Out of 512 initial records, 26 studies met the inclusion criteria. Most studies demonstrated promising diagnostic performance, with AUC values for external validation typically exceeding 0.8. The use of T2W and diffusion-weighted imaging (DWI) MRI phases enhanced model accuracy compared to T2W alone. Larger datasets generally correlated with improved model performance. However, heterogeneity in model designs, MRI protocols, and the limited integration of clinical data were noted as challenges.

CONCLUSION

AI-enhanced MRI demonstrates significant potential in predicting pCR in rectal cancer, particularly with T2W + DWI sequences and larger datasets. While integrating clinical data remains controversial, standardizing methodologies and expanding datasets will further enhance model robustness and clinical utility.

Machine learning in predicting pathological complete response to neoadjuvant chemoradiotherapy in rectal cancer using MRI: a systematic review and meta-analysis

OBJECTIVES

To evaluate the performance of machine learning models in predicting pathological complete response (pCR) to neoadjuvant chemoradiotherapy (nCRT) in patients with rectal cancer using magnetic resonance imaging.

METHODS

We searched PubMed, Embase, Cochrane Library, and Web of Science for studies published before March 2024. The Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) was used to assess the methodological quality of the included studies, random-effects models were used to calculate sensitivity and specificity, I2 values were used for heterogeneity measurements, and subgroup analyses were carried out to detect potential sources of heterogeneity.

RESULTS

A total of 1699 patients from 24 studies were included. For machine learning models in predicting pCR to nCRT, the meta-analysis calculated a pooled area under the curve (AUC) of 0.91 (95% CI, 0.88-0.93), pooled sensitivity of 0.83 (95% CI, 0.74-0.89), and pooled specificity of 0.86 (95% CI, 0.80-0.91). We investigated 6 studies that mainly contributed to heterogeneity. After performing meta-analysis again excluding these 6 studies, the heterogeneity was significantly reduced. In subgroup analysis, the pooled AUC of the deep-learning model was 0.93 and 0.89 for the traditional statistical model; the pooled AUC of studies that used diffusion-weighted imaging (DWI) was 0.90 and 0.92 in studies that did not use DWI; the pooled AUC of studies conducted in China was 0.93, and was 0.83 in studies conducted in other countries.

CONCLUSIONS

This systematic study showed that machine learning has promising potential in predicting pCR to nCRT in patients with locally advanced rectal cancer. Compared to traditional machine learning models, although deep-learning-based studies are less predominant and more heterogeneous, they are able to obtain higher AUC.

ADVANCES IN KNOWLEDGE

Compared to traditional machine learning models, deep-learning-based studies are able to obtain higher AUC, although they are less predominant and more heterogeneous. Together with clinical information, machine learning-based models may bring us closer towards precision medicine.

Image-based artificial intelligence for the prediction of pathological complete response to neoadjuvant chemoradiotherapy in patients with rectal cancer: a systematic review and meta-analysis

OBJECTIVE

Artificial intelligence (AI) holds enormous potential for noninvasively identifying patients with rectal cancer who could achieve pathological complete response (pCR) following neoadjuvant chemoradiotherapy (nCRT). We aimed to conduct a meta-analysis to summarize the diagnostic performance of image-based AI models for predicting pCR to nCRT in patients with rectal cancer.

METHODS

This study followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. A literature search of PubMed, Embase, Cochrane Library, and Web of Science was performed from inception to July 29, 2023. Studies that developed or utilized AI models for predicting pCR to nCRT in rectal cancer from medical images were included. The Quality Assessment of Diagnostic Accuracy Studies-AI was used to appraise the methodological quality of the studies. The bivariate random-effects model was used to summarize the individual sensitivities, specificities, and areas-under-the-curve (AUCs). Subgroup and meta-regression analyses were conducted to identify potential sources of heterogeneity. Protocol for this study was registered with PROSPERO (CRD42022382374).

RESULTS

Thirty-four studies (9933 patients) were identified. Pooled estimates of sensitivity, specificity, and AUC of AI models for pCR prediction were 82% (95% CI: 76-87%), 84% (95% CI: 79-88%), and 90% (95% CI: 87-92%), respectively. Higher specificity was seen for the Asian population, low risk of bias, and deep-learning, compared with the non-Asian population, high risk of bias, and radiomics (all P < 0.05). Single-center had a higher sensitivity than multi-center (P = 0.001). The retrospective design had lower sensitivity (P = 0.012) but higher specificity (P < 0.001) than the prospective design. MRI showed higher sensitivity (P = 0.001) but lower specificity (P = 0.044) than non-MRI. The sensitivity and specificity of internal validation were higher than those of external validation (both P = 0.005).

CONCLUSIONS

Image-based AI models exhibited favorable performance for predicting pCR to nCRT in rectal cancer. However, further clinical trials are warranted to verify the findings.

Prediction of Pathologic Complete Response for Rectal Cancer Based on Pretreatment Factors Using Machine Learning

BACKGROUND

Pathologic complete response after neoadjuvant therapy is an important prognostic indicator for locally advanced rectal cancer and may give insights into which patients might be treated nonoperatively in the future. Existing models for predicting pathologic complete response in the pretreatment setting are limited by small data sets and low accuracy.

OBJECTIVE

We sought to use machine learning to develop a more generalizable predictive model for pathologic complete response for locally advanced rectal cancer.

DESIGN

Patients with locally advanced rectal cancer who underwent neoadjuvant therapy followed by surgical resection were identified in the National Cancer Database from years 2010 to 2019 and were split into training, validation, and test sets. Machine learning techniques included random forest, gradient boosting, and artificial neural network. A logistic regression model was also created. Model performance was assessed using an area under the receiver operating characteristic curve.

SETTINGS

This study used a national, multicenter data set.

PATIENTS

Patients with locally advanced rectal cancer who underwent neoadjuvant therapy and proctectomy.

MAIN OUTCOME MEASURES

Pathologic complete response defined as T0/xN0/x.

RESULTS

The data set included 53,684 patients. Pathologic complete response was experienced by 22.9% of patients. Gradient boosting showed the best performance with an area under the receiver operating characteristic curve of 0.777 (95% CI, 0.773-0.781), compared with 0.684 (95% CI, 0.68-0.688) for logistic regression. The strongest predictors of pathologic complete response were no lymphovascular invasion, no perineural invasion, lower CEA, smaller size of tumor, and microsatellite stability. A concise model including the top 5 variables showed preserved performance.

LIMITATIONS

The models were not externally validated.

CONCLUSIONS

Machine learning techniques can be used to accurately predict pathologic complete response for locally advanced rectal cancer in the pretreatment setting. After fine-tuning a data set including patients treated nonoperatively, these models could help clinicians identify the appropriate candidates for a watch-and-wait strategy. See Video Abstract .

EL CNCER DE RECTO BASADA EN FACTORES PREVIOS AL TRATAMIENTO MEDIANTE EL APRENDIZAJE AUTOMTICO

ANTECEDENTES:La respuesta patológica completa después de la terapia neoadyuvante es un indicador pronóstico importante para el cáncer de recto localmente avanzado y puede dar información sobre qué pacientes podrían ser tratados de forma no quirúrgica en el futuro. Los modelos existentes para predecir la respuesta patológica completa en el entorno previo al tratamiento están limitados por conjuntos de datos pequeños y baja precisión.OBJETIVO:Intentamos utilizar el aprendizaje automático para desarrollar un modelo predictivo más generalizable para la respuesta patológica completa para el cáncer de recto localmente avanzado.DISEÑO:Los pacientes con cáncer de recto localmente avanzado que se sometieron a terapia neoadyuvante seguida de resección quirúrgica se identificaron en la Base de Datos Nacional del Cáncer de los años 2010 a 2019 y se dividieron en conjuntos de capacitación, validación y prueba. Las técnicas de aprendizaje automático incluyeron bosque aleatorio, aumento de gradiente y red neuronal artificial. También se creó un modelo de regresión logística. El rendimiento del modelo se evaluó utilizando el área bajo la curva característica operativa del receptor.ÁMBITO:Este estudio utilizó un conjunto de datos nacional multicéntrico.PACIENTES:Pacientes con cáncer de recto localmente avanzado sometidos a terapia neoadyuvante y proctectomía.PRINCIPALES MEDIDAS DE VALORACIÓN:Respuesta patológica completa definida como T0/xN0/x.RESULTADOS:El conjunto de datos incluyó 53.684 pacientes. El 22,9% de los pacientes experimentaron una respuesta patológica completa. El refuerzo de gradiente mostró el mejor rendimiento con un área bajo la curva característica operativa del receptor de 0,777 (IC del 95%: 0,773 - 0,781), en comparación con 0,684 (IC del 95%: 0,68 - 0,688) para la regresión logística. Los predictores más fuertes de respuesta patológica completa fueron la ausencia de invasión linfovascular, la ausencia de invasión perineural, un CEA más bajo, un tamaño más pequeño del tumor y la estabilidad de los microsatélites. Un modelo conciso que incluye las cinco variables principales mostró un rendimiento preservado.LIMITACIONES:Los modelos no fueron validados externamente.CONCLUSIONES:Las técnicas de aprendizaje automático se pueden utilizar para predecir con precisión la respuesta patológica completa para el cáncer de recto localmente avanzado en el entorno previo al tratamiento. Después de realizar ajustes en un conjunto de datos que incluye pacientes tratados de forma no quirúrgica, estos modelos podrían ayudar a los médicos a identificar a los candidatos adecuados para una estrategia de observar y esperar. (Traducción-Dr. Ingrid Melo ).

Performance reporting design in artificial intelligence studies using image-based TNM staging and prognostic parameters in rectal cancer: a systematic review

PURPOSE

The integration of artificial intelligence (AI) and magnetic resonance imaging in rectal cancer has the potential to enhance diagnostic accuracy by identifying subtle patterns and aiding tumor delineation and lymph node assessment. According to our systematic review focusing on convolutional neural networks, AI-driven tumor staging and the prediction of treatment response facilitate tailored treat-ment strategies for patients with rectal cancer.

METHODS

This paper summarizes the current landscape of AI in the imaging field of rectal cancer, emphasizing the performance reporting design based on the quality of the dataset, model performance, and external validation.

RESULTS

AI-driven tumor segmentation has demonstrated promising results using various convolutional neural network models. AI-based predictions of staging and treatment response have exhibited potential as auxiliary tools for personalized treatment strategies. Some studies have indicated superior performance than conventional models in predicting microsatellite instability and KRAS status, offer-ing noninvasive and cost-effective alternatives for identifying genetic mutations.

CONCLUSION

Image-based AI studies for rectal can-cer have shown acceptable diagnostic performance but face several challenges, including limited dataset sizes with standardized data, the need for multicenter studies, and the absence of oncologic relevance and external validation for clinical implantation. Overcoming these pitfalls and hurdles is essential for the feasible integration of AI models in clinical settings for rectal cancer, warranting further research.

Predicting tumor deposits in rectal cancer: a combined deep learning model using T2-MR imaging and clinical features

BACKGROUND

Tumor deposits (TDs) are associated with poor prognosis in rectal cancer (RC). This study aims to develop and validate a deep learning (DL) model incorporating T2-MR image and clinical factors for the preoperative prediction of TDs in RC patients.

METHODS AND METHODS

A total of 327 RC patients with pathologically confirmed TDs status from January 2016 to December 2019 were retrospectively recruited, and the T2-MR images and clinical variables were collected. Patients were randomly split into a development dataset (n = 246) and an independent testing dataset (n = 81). A single-channel DL model, a multi-channel DL model, a hybrid DL model, and a clinical model were constructed. The performance of these predictive models was assessed by using receiver operating characteristics (ROC) analysis and decision curve analysis (DCA).

RESULTS

The areas under the curves (AUCs) of the clinical, single-DL, multi-DL, and hybrid-DL models were 0.734 (95% CI, 0.674-0.788), 0.710 (95% CI, 0.649-0.766), 0.767 (95% CI, 0.710-0.819), and 0.857 (95% CI, 0.807-0.898) in the development dataset. The AUC of the hybrid-DL model was significantly higher than the single-DL and multi-DL models (both p < 0.001) in the development dataset, and the single-DL model (p = 0.028) in the testing dataset. Decision curve analysis demonstrated the hybrid-DL model had higher net benefit than other models across the majority range of threshold probabilities.

CONCLUSIONS

The proposed hybrid-DL model achieved good predictive efficacy and could be used to predict tumor deposits in rectal cancer.

CRITICAL RELEVANCE STATEMENT

The proposed hybrid-DL model achieved good predictive efficacy and could be used to predict tumor deposits in rectal cancer.

KEY POINTS

• Preoperative non-invasive identification of TDs is of great clinical significance. • The combined hybrid-DL model achieved good predictive efficacy and could be used to predict tumor deposits in rectal cancer. • A preoperative nomogram provides gastroenterologist with an accurate and effective tool.

A Longitudinal MRI-Based Artificial Intelligence System to Predict Pathological Complete Response After Neoadjuvant Therapy in Rectal Cancer: A Multicenter Validation Study

BACKGROUND

Accurate prediction of response to neoadjuvant chemoradiotherapy is critical for subsequent treatment decisions for patients with locally advanced rectal cancer.

OBJECTIVE

To develop and validate a deep learning model based on the comparison of paired MRI before and after neoadjuvant chemoradiotherapy to predict pathological complete response.

DESIGN

By capturing the changes from MRI before and after neoadjuvant chemoradiotherapy in 638 patients, we trained a multitask deep learning model for response prediction (DeepRP-RC) that also allowed simultaneous segmentation. Its performance was independently tested in an internal and 3 external validation sets, and its prognostic value was also evaluated.

SETTINGS

Multicenter study.

PATIENTS

We retrospectively enrolled 1201 patients diagnosed with locally advanced rectal cancer who underwent neoadjuvant chemoradiotherapy before total mesorectal excision. Patients had been treated at 1 of 4 hospitals in China between January 2013 and December 2020.

MAIN OUTCOME MEASURES

The main outcome was the accuracy of predicting pathological complete response, measured as the area under receiver operating curve for the training and validation data sets.

RESULTS

DeepRP-RC achieved high performance in predicting pathological complete response after neoadjuvant chemoradiotherapy, with area under the curve values of 0.969 (0.942-0.996), 0.946 (0.915-0.977), 0.943 (0.888-0.998), and 0.919 (0.840-0.997) for the internal and 3 external validation sets, respectively. DeepRP-RC performed similarly well in the subgroups defined by receipt of radiotherapy, tumor location, T/N stages before and after neoadjuvant chemoradiotherapy, and age. Compared with experienced radiologists, the model showed substantially higher performance in pathological complete response prediction. The model was also highly accurate in identifying the patients with poor response. Furthermore, the model was significantly associated with disease-free survival independent of clinicopathological variables.

LIMITATIONS

This study was limited by its retrospective design and absence of multiethnic data.

CONCLUSIONS

DeepRP-RC could be an accurate preoperative tool for pathological complete response prediction in rectal cancer after neoadjuvant chemoradiotherapy.

UN SISTEMA DE IA BASADO EN RESONANCIA MAGNTICA LONGITUDINAL PARA PREDECIR LA RESPUESTA PATOLGICA COMPLETA DESPUS DE LA TERAPIA NEOADYUVANTE EN EL CNCER DE RECTO UN ESTUDIO DE VALIDACIN MULTICNTRICO

ANTECEDENTES:La predicción precisa de la respuesta a la quimiorradioterapia neoadyuvante es fundamental para las decisiones de tratamiento posteriores para los pacientes con cáncer de recto localmente avanzado.OBJETIVO:Desarrollar y validar un modelo de aprendizaje profundo basado en la comparación de resonancias magnéticas pareadas antes y después de la quimiorradioterapia neoadyuvante para predecir la respuesta patológica completa.DISEÑO:Al capturar los cambios de las imágenes de resonancia magnética antes y después de la quimiorradioterapia neoadyuvante en 638 pacientes, entrenamos un modelo de aprendizaje profundo multitarea para la predicción de respuesta (DeepRP-RC) que también permitió la segmentación simultánea. Su rendimiento se probó de forma independiente en un conjunto de validación interna y tres externas, y también se evaluó su valor pronóstico.ESCENARIO:Estudio multicéntrico.PACIENTES:Volvimos a incluir retrospectivamente a 1201 pacientes diagnosticados con cáncer de recto localmente avanzado y sometidos a quimiorradioterapia neoadyuvante antes de la escisión total del mesorrecto. Eran de cuatro hospitales en China en el período entre enero de 2013 y diciembre de 2020.PRINCIPALES MEDIDAS DE RESULTADO:Los principales resultados fueron la precisión de la predicción de la respuesta patológica completa, medida como el área bajo la curva operativa del receptor para los conjuntos de datos de entrenamiento y validación.RESULTADOS:DeepRP-RC logró un alto rendimiento en la predicción de la respuesta patológica completa después de la quimiorradioterapia neoadyuvante, con valores de área bajo la curva de 0,969 (0,942-0,996), 0,946 (0,915-0,977), 0,943 (0,888-0,998), y 0,919 (0,840-0,997) para los conjuntos de validación interna y las tres externas, respectivamente. DeepRP-RC se desempeñó de manera similar en los subgrupos definidos por la recepción de radioterapia, la ubicación del tumor, los estadios T/N antes y después de la quimiorradioterapia neoadyuvante y la edad. En comparación con los radiólogos experimentados, el modelo mostró un rendimiento sustancialmente mayor en la predicción de la respuesta patológica completa. El modelo también fue muy preciso en la identificación de los pacientes con mala respuesta. Además, el modelo se asoció significativamente con la supervivencia libre de enfermedad independientemente de las variables clinicopatológicas.LIMITACIONES:Este estudio estuvo limitado por el diseño retrospectivo y la ausencia de datos multiétnicos.CONCLUSIONES:DeepRP-RC podría servir como una herramienta preoperatoria precisa para la predicción de la respuesta patológica completa en el cáncer de recto después de la quimiorradioterapia neoadyuvante. (Traducción-Dr. Felipe Bellolio ).

Multiphase and multiparameter MRI-based radiomics for prediction of tumor response to neoadjuvant therapy in locally advanced rectal cancer

BACKGROUND

To develop and validate radiomics models for prediction of tumor response to neoadjuvant therapy (NAT) in patients with locally advanced rectal cancer (LARC) using both pre-NAT and post-NAT multiparameter magnetic resonance imaging (mpMRI).

METHODS

In this multicenter study, a total of 563 patients were included from two independent centers. 453 patients from center 1 were split into training and testing cohorts, the remaining 110 from center 2 served as an external validation cohort. Pre-NAT and post-NAT mpMRI was collected for feature extraction. The radiomics models were constructed using machine learning from a training cohort. The accuracy of the models was verified in a testing cohort and an independent external validation cohort. Model performance was evaluated using area under the curve (AUC), sensitivity, specificity, positive predictive value, and negative predictive value.

RESULTS

The model constructed with pre-NAT mpMRI had favorable accuracy for prediction of non-response to NAT in the training cohort (AUC = 0.84), testing cohort (AUC = 0.81), and external validation cohort (AUC = 0.79). The model constructed with both pre-NAT and post-NAT mpMRI had powerful diagnostic value for pathologic complete response in the training cohort (AUC = 0.86), testing cohort (AUC = 0.87), and external validation cohort (AUC = 0.87).

CONCLUSIONS

Models constructed with multiphase and multiparameter MRI were able to predict tumor response to NAT with high accuracy and robustness, which may assist in individualized management of LARC.

Radiomics in colorectal cancer

Colorectal cancer (CRC) is a global health challenge with high morbidity and mortality. Radiomics, an emerging field, utilizes quantitative imaging features extracted from medical images for CRC diagnosis, staging, treatment response assessment, and prognostication. This review highlights the potential of radiomics for personalized CRC management. Radiomics enables noninvasive tumor characterization, aiding in early detection and accurate diagnosis, and it can be used to predict tumor stage, lymph node involvement, and prognosis. Furthermore, radiomics guides personalized therapies by assessing the treatment response and identifying patients who could benefit. Challenges include standardizing imaging protocols and analysis techniques. Robust validation frameworks and user‐friendly software are needed for the integration of radiomics into clinical practice. Despite challenges, radiomics offers valuable insights into tumor biology, treatment response, and prognosis in CRC. Overcoming technical and clinical hurdles will unlock its full potential in CRC management.

Imaging of colon and rectal cancer

Colon and rectal cancer imaging has traditionally been performed to assess for distant disease (typically lung and liver metastases) and to assess the resectability of the primary tumor. With technological and scientific advances in imaging and the evolution of treatment options, the role of imaging has expanded. Radiologists are now expected to provide a precise description of primary tumor invasion extent, including adjacent organ invasion, involvement of the surgical resection plane, extramural vascular invasion, lymphadenopathy, and response to neoadjuvant treatment, and to monitor for recurrence after clinical complete response.

Prediction of lymph node metastasis in stage T1-2 rectal cancers with MRI-based deep learning

OBJECTIVES

This study aimed to investigate whether a deep learning (DL) model based on preoperative MR images of primary tumors can predict lymph node metastasis (LNM) in patients with stage T1-2 rectal cancer.

METHODS

In this retrospective study, patients with stage T1-2 rectal cancer who underwent preoperative MRI between October 2013 and March 2021 were included and assigned to the training, validation, and test sets. Four two-dimensional and three-dimensional (3D) residual networks (ResNet18, ResNet50, ResNet101, and ResNet152) were trained and tested on T2-weighted images to identify patients with LNM. Three radiologists independently assessed LN status on MRI, and diagnostic outcomes were compared with the DL model. Predictive performance was assessed with AUC and compared using the Delong method.

RESULTS

In total, 611 patients were evaluated (444 training, 81 validation, and 86 test). The AUCs of the eight DL models ranged from 0.80 (95% confidence interval [CI]: 0.75, 0.85) to 0.89 (95% CI: 0.85, 0.92) in the training set and from 0.77 (95% CI: 0.62, 0.92) to 0.89 (95% CI: 0.76, 1.00) in the validation set. The ResNet101 model based on 3D network architecture achieved the best performance in predicting LNM in the test set, with an AUC of 0.79 (95% CI: 0.70, 0.89) that was significantly greater than that of the pooled readers (AUC, 0.54 [95% CI: 0.48, 0.60]; p < 0.001).

CONCLUSION

The DL model based on preoperative MR images of primary tumors outperformed radiologists in predicting LNM in patients with stage T1-2 rectal cancer.

KEY POINTS

• Deep learning (DL) models with different network frameworks showed different diagnostic performance for predicting lymph node metastasis (LNM) in patients with stage T1-2 rectal cancer. • The ResNet101 model based on 3D network architecture achieved the best performance in predicting LNM in the test set. • The DL model based on preoperative MR images outperformed radiologists in predicting LNM in patients with stage T1-2 rectal cancer.

Utility of Circulating Free DNA Fragmentomics in the Prediction of Pathological Response after Neoadjuvant Chemoradiotherapy in Locally Advanced Rectal Cancer

BACKGROUND

A "Watch and Wait" (W&W) approach has become an alternative to surgery for locally advanced rectal cancer (LARC) after neoadjuvant chemoradiotherapy (nCRT). Precise prediction of pathological complete response (pCR) will improve patient selection for W&W. We investigated the utility of cell-free DNA (cfDNA) fragmentomics in predicting pCR.

METHODS

We recruited 119 LARC patients and evaluated nCRT response by pCR status and pathological or MRI tumor regression grade (mrTRG). Plasma samples before, during, and after nCRT were applied to deep targeted-panel sequencing, with 103 patients having complete samples. cfDNA fragment and 5'-end motif profiles were used to construct elastic-net logistic regression models to predict non-pCR. Predictive performance was measured by area under the receiver operator characteristic curve (AUC), sensitivity, and specificity.

RESULTS

In the training cohort, the model based on 5'-end motif profile plus mrTRG achieved the highest cross-validation AUC (0.92, 95% CI, 0.91-0.93). The AUC in a testing cohort was 0.96 (95% CI, 0.90-1.00). The models based on 5'-end motif profile alone or in combination with mrTRG both maintained good predictive ability for patients without detectable circulating tumor DNA (AUC 0.94, 95% CI, 0.93-0.95; AUC 0.95, 95% CI, 0.94-0.96). In an external validation cohort, the model trained with a local 5'-end motif profile obtained an AUC of 0.878 (95% CI, 0.801-0.956) in discriminating colorectal cancer from healthy subjects.

CONCLUSIONS

The combination of a 5'-end motif profile with mrTRG has the potential to predict the response to nCRT, and therefore may improve the patient selection for a W&W approach.

Application of Radiomics in Predicting Treatment Response to Neoadjuvant Chemoradiotherapy in Locally Advanced Rectal Cancer: Strategies and Challenges

Neoadjuvant chemoradiotherapy (nCRT) followed by total mesorectal excision is the standard treatment for locally advanced rectal cancer (LARC). A noninvasive preoperative prediction method should greatly assist in the evaluation of response to nCRT and for the development of a personalized strategy for patients with LARC. Assessment of nCRT relies on imaging and radiomics can extract valuable quantitative data from medical images. In this review, we examined the status of radiomic application for assessing response to nCRT in patients with LARC and indicated a potential direction for future research.

Artificial intelligence with magnetic resonance imaging for prediction of pathological complete response to neoadjuvant chemoradiotherapy in rectal cancer: A systematic review and meta-analysis

Purpose

The purpose of this study was to evaluate the diagnostic accuracy of artificial intelligence (AI) models with magnetic resonance imaging(MRI) in predicting pathological complete response(pCR) to neoadjuvant chemoradiotherapy (nCRT) in patients with rectal cancer. Furthermore, assessed the methodological quality of the models.

Methods

We searched PubMed, Embase, Cochrane Library, and Web of science for studies published before 21 June 2022, without any language restrictions. The Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) and Radiomics Quality Score (RQS) tools were used to assess the methodological quality of the included studies. We calculated pooled sensitivity and specificity using random-effects models, I² values were used to measure heterogeneity, and subgroup analyses to explore potential sources of heterogeneity.

Results

We selected 21 papers for inclusion in the meta-analysis from 1562 retrieved publications, with a total of 1873 people in the validation groups. The meta-analysis showed that AI models based on MRI predicted pCR to nCRT in patients with rectal cancer: a pooled area under the curve (AUC) 0.91 (95% CI, 0.88-0.93), sensitivity of 0.82(95% CI,0.71-0.90), pooled specificity 0.86(95% CI,0.80-0.91). In the subgroup analysis, the pooled AUC of the deep learning(DL) model was 0.97, the pooled AUC of the radiomics model was 0.85; the pooled AUC of the combined model with clinical factors was 0.92, and the pooled AUC of the radiomics model alone was 0.87. The mean RQS score of the included studies was 10.95, accounting for 30.4% of the total score.

Conclusions

Radiomics is a promising noninvasive method with high value in predicting pathological response to nCRT in patients with rectal cancer. DL models have higher predictive accuracy than radiomics models, and combined models incorporating clinical factors have higher diagnostic accuracy than radiomics models alone. In the future, prospective, large-scale, multicenter investigations using radiomics approaches will strengthen the diagnostic power of pCR.

Systematic Review Registration

https://www.crd.york.ac.uk/prospero/, identifier CRD42021285630.

Deep learning model for tongue cancer diagnosis using endoscopic images

In this study, we developed a deep learning model to identify patients with tongue cancer based on a validated dataset comprising oral endoscopic images. We retrospectively constructed a dataset of 12,400 verified endoscopic images from five university hospitals in South Korea, collected between 2010 and 2020 with the participation of otolaryngologists. To calculate the probability of malignancy using various convolutional neural network (CNN) architectures, several deep learning models were developed. Of the 12,400 total images, 5576 images related to the tongue were extracted. The CNN models showed a mean area under the receiver operating characteristic curve (AUROC) of 0.845 and a mean area under the precision-recall curve (AUPRC) of 0.892. The results indicate that the best model was DenseNet169 (AUROC 0.895 and AUPRC 0.918). The deep learning model, general physicians, and oncology specialists had sensitivities of 81.1%, 77.3%, and 91.7%; specificities of 86.8%, 75.0%, and 90.9%; and accuracies of 84.7%, 75.9%, and 91.2%, respectively. Meanwhile, fair agreement between the oncologist and the developed model was shown for cancer diagnosis (kappa value = 0.685). The deep learning model developed based on the verified endoscopic image dataset showed acceptable performance in tongue cancer diagnosis.