1
|
Yang Y, Gao H, Berry C, Carrick D, Radjenovic A, Husmeier D. Classification of myocardial blood flow based on dynamic contrast‐enhanced magnetic resonance imaging using hierarchical Bayesian models. J R Stat Soc Ser C Appl Stat 2022. [DOI: 10.1111/rssc.12568] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Affiliation(s)
| | - Hao Gao
- The University of Glasgow GlasgowUK
| | | | | | | | | |
Collapse
|
2
|
Chen J, Zhang P, Liu H, Xu L, Zhang H. Spatio-temporal multi-task network cascade for accurate assessment of cardiac CT perfusion. Med Image Anal 2021; 74:102207. [PMID: 34487982 DOI: 10.1016/j.media.2021.102207] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2020] [Revised: 07/20/2021] [Accepted: 08/04/2021] [Indexed: 10/20/2022]
Abstract
The assessment of myocardial perfusion has become increasingly important in the early diagnosis of coronary artery disease. Currently, the process of perfusion assessment is time-consuming and subjective. Although automated methods by threshold processing have been proposed, they cannot obtain an accurate perfusion assessment. Thus, there is a great clinical demand to obtain a rapid and accurate assessment of myocardial perfusion through a standard procedure using an automated algorithm. In this work, we present a spatio-temporal multi-task network cascade (ST-MNC) to provide an accurate and robust assessment of myocardial perfusion. The proposed network captures patch-based spatio-temporal representations for each pixel through a spatio-temporal encoder-decoder network. Then the multi-task network cascade uses spatio-temporal representations as shared features to predict various perfusion parameters and myocardial ischemic regions. Extensive experiments on CT images of 232 subjects demonstrate ST-MNC could produce a good approximation for perfusion parameters and an accurate classification for ischemic regions. These results show that our proposed method can provide a fast and accurate assessment of myocardial perfusion.
Collapse
Affiliation(s)
- Jiaqi Chen
- School of Biomedical Engineering, Sun Yat-sen University, Guangzhou, China
| | - Pengfei Zhang
- The Key Laboratory of Cardiovascular Remodeling and Function Research, Chinese Ministry of Education, Chinese National Health Commission and Chinese Academy of Medical Sciences, The State and Shandong Province Joint Key Laboratory of Translational Cardiovascular Medicine, Department of Cardiology, Qilu Hospital of Shandong University, Shanodng, China.
| | - Huafeng Liu
- State Key Laboratory of Modern Optical Instrumentation, College of Optical Science and Engineering, Zhejiang University, Hangzhou 310027, China
| | - Lei Xu
- Department of Radiology, Beijing Anzhen Hospital, Capital Medical University, Beijing, China
| | - Heye Zhang
- School of Biomedical Engineering, Sun Yat-sen University, Guangzhou, China.
| |
Collapse
|
3
|
Meyer‐Base A, Morra L, Tahmassebi A, Lobbes M, Meyer‐Base U, Pinker K. AI-Enhanced Diagnosis of Challenging Lesions in Breast MRI: A Methodology and Application Primer. J Magn Reson Imaging 2021; 54:686-702. [PMID: 32864782 PMCID: PMC8451829 DOI: 10.1002/jmri.27332] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2020] [Revised: 07/30/2020] [Accepted: 07/31/2020] [Indexed: 12/11/2022] Open
Abstract
Computer-aided diagnosis (CAD) systems have become an important tool in the assessment of breast tumors with magnetic resonance imaging (MRI). CAD systems can be used for the detection and diagnosis of breast tumors as a "second opinion" review complementing the radiologist's review. CAD systems have many common parts, such as image preprocessing, tumor feature extraction, and data classification that are mostly based on machine-learning (ML) techniques. In this review article, we describe applications of ML-based CAD systems in MRI covering the detection of diagnostically challenging lesions of the breast such as nonmass enhancing (NME) lesions, and furthermore discuss how multiparametric MRI and radiomics can be applied to the study of NME, including prediction of response to neoadjuvant chemotherapy (NAC). Since ML has been widely used in the medical imaging community, we provide an overview about the state-of-the-art and novel techniques applied as classifiers to CAD systems. The differences in the CAD systems in MRI of the breast for several standard and novel applications for NME are explained in detail to provide important examples, illustrating: 1) CAD for detection and diagnosis, 2) CAD in multiparametric imaging, 3) CAD in NAC, and 4) breast cancer radiomics. We aim to provide a comparison between these CAD applications and to illustrate a global view on intelligent CAD systems based on machine and deep learning in MRI of the breast. LEVEL OF EVIDENCE: 2 TECHNICAL EFFICACY STAGE: 2.
Collapse
Affiliation(s)
- Anke Meyer‐Base
- Department of Scientific ComputingFlorida State UniversityTallahasseeFloridaUSA
- Department of Radiology, Maastricht Medical CenterUniversity of MaastrichtMaastrichtNetherlands
| | - Lia Morra
- Department of Control and Computer EngineeringPolitecnico di TorinoTorinoItaly
| | | | - Marc Lobbes
- Department of Radiology, Maastricht Medical CenterUniversity of MaastrichtMaastrichtNetherlands
- GROW School for Oncology and Developmental BiologyMaastrichtNetherlands
- Zuyderland Medical Center, dep of Medical ImagingSittard‐GeleenNetherlands
| | - Uwe Meyer‐Base
- Department of Electrical and Computer EngineeringFlorida A&M University and Florida State UniversityTallahasseeFloridaUSA
| | - Katja Pinker
- Department of Radiology, Breast Imaging ServiceMemorial Sloan‐Kettering Cancer CenterNew YorkNew YorkUSA
- Department of Biomedical Imaging and Image‐Guided Therapy, Division of Molecular and Gender ImagingMedical University of ViennaViennaAustria
| |
Collapse
|
4
|
Zhu W, Kolamunnage-Dona R, Zheng Y, Harding S, Czanner G. Spatial and spatio-temporal statistical analyses of retinal images: a review of methods and applications. BMJ Open Ophthalmol 2020; 5:e000479. [PMID: 32537517 PMCID: PMC7264837 DOI: 10.1136/bmjophth-2020-000479] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2020] [Revised: 04/26/2020] [Accepted: 04/28/2020] [Indexed: 11/12/2022] Open
Abstract
Background Clinical research and management of retinal diseases greatly depend on the interpretation of retinal images and often longitudinally collected images. Retinal images provide context for spatial data, namely the location of specific pathologies within the retina. Longitudinally collected images can show how clinical events at one point can affect the retina over time. In this review, we aimed to assess statistical approaches to spatial and spatio-temporal data in retinal images. We also review the spatio-temporal modelling approaches used in other medical image types. Methods We conducted a comprehensive literature review of both spatial or spatio-temporal approaches and non-spatial approaches to the statistical analysis of retinal images. The key methodological and clinical characteristics of published papers were extracted. We also investigated whether clinical variables and spatial correlation were accounted for in the analysis. Results Thirty-four papers that included retinal imaging data were identified for full-text information extraction. Only 11 (32.4%) papers used spatial or spatio-temporal statistical methods to analyse images, others (23 papers, 67.6%) used non-spatial methods. Twenty-eight (82.4%) papers reported images collected cross-sectionally, while 6 (17.6%) papers reported analyses on images collected longitudinally. In imaging areas outside of ophthalmology, 19 papers were identified with spatio-temporal analysis, and multiple statistical methods were recorded. Conclusions In future statistical analyses of retinal images, it will be beneficial to clearly define and report the spatial distributions studied, report the spatial correlations, combine imaging data with clinical variables into analysis if available, and clearly state the software or packages used.
Collapse
Affiliation(s)
- Wenyue Zhu
- Department of Eye and Vision Science, Institute of Life Course and Medical Sciences, University of Liverpool, a member of Liverpool Health Partners, Liverpool, UK
| | - Ruwanthi Kolamunnage-Dona
- Department of Health Data Science, Institute of Population Health Sciences, University of Liverpool, a member of Liverpool Health Partners, Liverpool, UK
| | - Yalin Zheng
- Department of Eye and Vision Science, Institute of Life Course and Medical Sciences, University of Liverpool, a member of Liverpool Health Partners, Liverpool, UK.,St Paul's Eye Unit, Liverpool University Hospitals Foundation Trust, a member of Liverpool Health Partners, Liverpool, UK
| | - Simon Harding
- Department of Eye and Vision Science, Institute of Life Course and Medical Sciences, University of Liverpool, a member of Liverpool Health Partners, Liverpool, UK.,St Paul's Eye Unit, Liverpool University Hospitals Foundation Trust, a member of Liverpool Health Partners, Liverpool, UK
| | - Gabriela Czanner
- Department of Eye and Vision Science, Institute of Life Course and Medical Sciences, University of Liverpool, a member of Liverpool Health Partners, Liverpool, UK.,St Paul's Eye Unit, Liverpool University Hospitals Foundation Trust, a member of Liverpool Health Partners, Liverpool, UK.,Department of Applied Mathematics, Liverpool John Moores University, Liverpool, UK
| |
Collapse
|
5
|
Giacalone M, Rasti P, Debs N, Frindel C, Cho TH, Grenier E, Rousseau D. Local spatio-temporal encoding of raw perfusion MRI for the prediction of final lesion in stroke. Med Image Anal 2018; 50:117-126. [PMID: 30268970 DOI: 10.1016/j.media.2018.08.008] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2017] [Revised: 07/28/2018] [Accepted: 08/31/2018] [Indexed: 10/28/2022]
Abstract
We address the medical image analysis issue of predicting the final lesion in stroke from early perfusion magnetic resonance imaging. The classical processing approach for the dynamical perfusion images consists in a temporal deconvolution to improve the temporal signals associated with each voxel before performing prediction. We demonstrate here the value of exploiting directly the raw perfusion data by encoding the local environment of each voxel as a spatio-temporal texture, with an observation scale larger than the voxel. As a first illustration for this approach, the textures are characterized with local binary patterns and the classification is performed using a standard support vector machine (SVM). This simple machine learning classification scheme demonstrates results with 95% accuracy on average while working only raw perfusion data. We discuss the influence of the observation scale and evaluate the interest of using post-processed perfusion data with this approach.
Collapse
Affiliation(s)
- Mathilde Giacalone
- CREATIS, CNRS UMR-5220, INSERM U1206, Université Lyon 1, INSA Lyon Bât. Blaise Pascal, 7 avenue Jean Capelle, Villeurbanne 69621, France
| | - Pejman Rasti
- LARIS, UMR IRHS INRA, Université d'Angers 62 avenue Notre Dame du Lac, Angers 49000, France
| | - Noelie Debs
- CREATIS, CNRS UMR-5220, INSERM U1206, Université Lyon 1, INSA Lyon Bât. Blaise Pascal, 7 avenue Jean Capelle, Villeurbanne 69621, France
| | - Carole Frindel
- CREATIS, CNRS UMR-5220, INSERM U1206, Université Lyon 1, INSA Lyon Bât. Blaise Pascal, 7 avenue Jean Capelle, Villeurbanne 69621, France
| | - Tae-Hee Cho
- CREATIS, CNRS UMR-5220, INSERM U1206, Université Lyon 1, INSA Lyon Bât. Blaise Pascal, 7 avenue Jean Capelle, Villeurbanne 69621, France
| | - Emmanuel Grenier
- ENS-Lyon, UMR CNRS 5669 'UMPA', and INRIA Alpes, project NUMED, Lyon F-69364, France
| | - David Rousseau
- LARIS, UMR IRHS INRA, Université d'Angers 62 avenue Notre Dame du Lac, Angers 49000, France.
| |
Collapse
|
6
|
Giacalone M, Frindel C, Robini M, Cervenansky F, Grenier E, Rousseau D. Robustness of spatio-temporal regularization in perfusion MRI deconvolution: An application to acute ischemic stroke. Magn Reson Med 2016; 78:1981-1990. [PMID: 28019027 DOI: 10.1002/mrm.26573] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2016] [Revised: 11/16/2016] [Accepted: 11/16/2016] [Indexed: 12/23/2022]
Abstract
PURPOSE The robustness of a recently introduced globally convergent deconvolution algorithm with temporal and edge-preserving spatial regularization for the deconvolution of dynamic susceptibility contrast perfusion magnetic resonance imaging is assessed in the context of ischemic stroke. THEORY AND METHODS Ischemic tissues are not randomly distributed in the brain but form a spatially organized entity. The addition of a spatial regularization term allows to take into account this spatial organization contrarily to the sole temporal regularization approach which processes each voxel independently. The robustness of the spatial regularization in relation to shape variability, hemodynamic variability in tissues, noise in the magnetic resonance imaging apparatus, and uncertainty on the arterial input function selected for the deconvolution is addressed via an original in silico validation approach. RESULTS The deconvolution algorithm proved robust to the different sources of variability, outperforming temporal Tikhonov regularization in most realistic conditions considered. The limiting factor is the proper estimation of the arterial input function. CONCLUSION This study quantified the robustness of a spatio-temporal approach for dynamic susceptibility contrast-magnetic resonance imaging deconvolution via a new simulator. This simulator, now accessible online, is of wide applicability for the validation of any deconvolution algorithm. Magn Reson Med 78:1981-1990, 2017. © 2016 International Society for Magnetic Resonance in Medicine.
Collapse
Affiliation(s)
- Mathilde Giacalone
- University of Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, CNRS, Inserm, CREATIS UMR 5220, U1206, LYON, F69006, France
| | - Carole Frindel
- University of Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, CNRS, Inserm, CREATIS UMR 5220, U1206, LYON, F69006, France
| | - Marc Robini
- University of Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, CNRS, Inserm, CREATIS UMR 5220, U1206, LYON, F69006, France
| | - Frédéric Cervenansky
- University of Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, CNRS, Inserm, CREATIS UMR 5220, U1206, LYON, F69006, France
| | - Emmanuel Grenier
- ENS-Lyon, UCB Lyon, Inria, NUMED, CNRS, UMPA UMR 5669, LYON, F69007, France
| | - David Rousseau
- University of Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, CNRS, Inserm, CREATIS UMR 5220, U1206, LYON, F69006, France
| |
Collapse
|
7
|
A Semi-Automatic Coronary Artery Segmentation Framework Using Mechanical Simulation. J Med Syst 2015; 39:129. [DOI: 10.1007/s10916-015-0329-9] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2015] [Accepted: 08/18/2015] [Indexed: 11/26/2022]
|
8
|
Ferl GZ, O'Connor JPB, Parker GJM, Carano RAD, Acharya SJ, Jayson GC, Port RE. Mixed-effects modeling of clinical DCE-MRI data: application to colorectal liver metastases treated with bevacizumab. J Magn Reson Imaging 2015; 41:132-41. [PMID: 24753433 DOI: 10.1002/jmri.24514] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2013] [Accepted: 10/18/2013] [Indexed: 12/21/2022] Open
Abstract
PURPOSE Most dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) data are evaluated for individual patients with cohorts analyzed to detect significant changes from baseline values, repeating the process at each posttreatment timepoint. Our study aimed to develop a statistically valid model for the complete time course of DCE-MRI data in a patient cohort. MATERIALS AND METHODS Data from 10 patients with colorectal cancer liver metastases were analyzed, including two baseline scans and four post-bevacizumab scans. Apparent changes in tumor median K(trans) were adjusted for changes in observed enhancing tumor fraction (EnF) by multiplying K(trans) by EnF (KEnF). A mixed-effects model (MEM) was defined to describe the KEnF time course for all patients simultaneously by assuming a three-parameter indirect response model with model parameters lognormally distributed across patients. RESULTS The typical cohort time course showed a KEnF reduction to 59% of baseline at 24 hours, returning to 65% of baseline values by day 12. Interpatient variability of model parameters ranged from 11% to 307%. CONCLUSION The MEM approach has potential for comparing responses at a group level in clinical trials with different doses, schedules, or combination regimens. Furthermore, the KEnF biomarker successfully resolved confounds in interpreting K(trans) arising from therapy induced changes in the volume of enhancing tumor.
Collapse
Affiliation(s)
- Gregory Z Ferl
- Department of Pharmacokinetics & Pharmacodynamics, Genentech, Inc., South San Francisco, California, USA
| | | | | | | | | | | | | |
Collapse
|
9
|
Khalifa F, Soliman A, El-Baz A, Abou El-Ghar M, El-Diasty T, Gimel'farb G, Ouseph R, Dwyer AC. Models and methods for analyzing DCE-MRI: a review. Med Phys 2014; 41:124301. [PMID: 25471985 DOI: 10.1118/1.4898202] [Citation(s) in RCA: 211] [Impact Index Per Article: 19.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2014] [Revised: 09/11/2014] [Accepted: 10/01/2014] [Indexed: 12/14/2022] Open
Abstract
PURPOSE To present a review of most commonly used techniques to analyze dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI), discusses their strengths and weaknesses, and outlines recent clinical applications of findings from these approaches. METHODS DCE-MRI allows for noninvasive quantitative analysis of contrast agent (CA) transient in soft tissues. Thus, it is an important and well-established tool to reveal microvasculature and perfusion in various clinical applications. In the last three decades, a host of nonparametric and parametric models and methods have been developed in order to quantify the CA's perfusion into tissue and estimate perfusion-related parameters (indexes) from signal- or concentration-time curves. These indexes are widely used in various clinical applications for the detection, characterization, and therapy monitoring of different diseases. RESULTS Promising theoretical findings and experimental results for the reviewed models and techniques in a variety of clinical applications suggest that DCE-MRI is a clinically relevant imaging modality, which can be used for early diagnosis of different diseases, such as breast and prostate cancer, renal rejection, and liver tumors. CONCLUSIONS Both nonparametric and parametric approaches for DCE-MRI analysis possess the ability to quantify tissue perfusion.
Collapse
Affiliation(s)
- Fahmi Khalifa
- BioImaging Laboratory, Department of Bioengineering, University of Louisville, Louisville, Kentucky 40292 and Electronics and Communication Engineering Department, Mansoura University, Mansoura 35516, Egypt
| | - Ahmed Soliman
- BioImaging Laboratory, Department of Bioengineering, University of Louisville, Louisville, Kentucky 40292
| | - Ayman El-Baz
- BioImaging Laboratory, Department of Bioengineering, University of Louisville, Louisville, Kentucky 40292
| | - Mohamed Abou El-Ghar
- Radiology Department, Urology and Nephrology Center, Mansoura University, Mansoura 35516, Egypt
| | - Tarek El-Diasty
- Radiology Department, Urology and Nephrology Center, Mansoura University, Mansoura 35516, Egypt
| | - Georgy Gimel'farb
- Department of Computer Science, University of Auckland, Auckland 1142, New Zealand
| | - Rosemary Ouseph
- Kidney Transplantation-Kidney Disease Center, University of Louisville, Louisville, Kentucky 40202
| | - Amy C Dwyer
- Kidney Transplantation-Kidney Disease Center, University of Louisville, Louisville, Kentucky 40202
| |
Collapse
|
10
|
Frindel C, Robini MC, Rousseau D. A 3-D spatio-temporal deconvolution approach for MR perfusion in the brain. Med Image Anal 2014; 18:144-60. [DOI: 10.1016/j.media.2013.10.004] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2013] [Revised: 09/12/2013] [Accepted: 10/07/2013] [Indexed: 11/26/2022]
|
11
|
Boutelier T, Kudo K, Pautot F, Sasaki M. Bayesian hemodynamic parameter estimation by bolus tracking perfusion weighted imaging. IEEE TRANSACTIONS ON MEDICAL IMAGING 2012; 31:1381-1395. [PMID: 22410325 DOI: 10.1109/tmi.2012.2189890] [Citation(s) in RCA: 59] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/31/2023]
Abstract
A delay-insensitive probabilistic method for estimating hemodynamic parameters, delays, theoretical residue functions, and concentration time curves by computed tomography (CT) and magnetic resonance (MR) perfusion weighted imaging is presented. Only a mild stationarity hypothesis is made beyond the standard perfusion model. New microvascular parameters with simple hemodynamic interpretation are naturally introduced. Simulations on standard digital phantoms show that the method outperforms the oscillating singular value decomposition (oSVD) method in terms of goodness-of-fit, linearity, statistical and systematic errors on all parameters, especially at low signal-to-noise ratios (SNRs). Delay is always estimated sharply with user-supplied resolution and is purely arterial, by contrast to oSVD time-to-maximum TMAX that is very noisy and biased by mean transit time (MTT), blood volume, and SNR. Residue functions and signals estimates do not suffer overfitting anymore. One CT acute stroke case confirms simulation results and highlights the ability of the method to reliably estimate MTT when SNR is low. Delays look promising for delineating the arterial occlusion territory and collateral circulation.
Collapse
Affiliation(s)
- Timothé Boutelier
- Department of Research and Innovation, Olea Medical, 13600 La Ciotat, France. timothe.
| | | | | | | |
Collapse
|