1
|
Wang C, Yang G, Papanastasiou G. Unsupervised Image Registration towards Enhancing Performance and Explainability in Cardiac and Brain Image Analysis. SENSORS (BASEL, SWITZERLAND) 2022; 22:2125. [PMID: 35336295 PMCID: PMC8951078 DOI: 10.3390/s22062125] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/04/2022] [Revised: 03/01/2022] [Accepted: 03/07/2022] [Indexed: 02/04/2023]
Abstract
Magnetic Resonance Imaging (MRI) typically recruits multiple sequences (defined here as "modalities"). As each modality is designed to offer different anatomical and functional clinical information, there are evident disparities in the imaging content across modalities. Inter- and intra-modality affine and non-rigid image registration is an essential medical image analysis process in clinical imaging, as for example before imaging biomarkers need to be derived and clinically evaluated across different MRI modalities, time phases and slices. Although commonly needed in real clinical scenarios, affine and non-rigid image registration is not extensively investigated using a single unsupervised model architecture. In our work, we present an unsupervised deep learning registration methodology that can accurately model affine and non-rigid transformations, simultaneously. Moreover, inverse-consistency is a fundamental inter-modality registration property that is not considered in deep learning registration algorithms. To address inverse consistency, our methodology performs bi-directional cross-modality image synthesis to learn modality-invariant latent representations, and involves two factorised transformation networks (one per each encoder-decoder channel) and an inverse-consistency loss to learn topology-preserving anatomical transformations. Overall, our model (named "FIRE") shows improved performances against the reference standard baseline method (i.e., Symmetric Normalization implemented using the ANTs toolbox) on multi-modality brain 2D and 3D MRI and intra-modality cardiac 4D MRI data experiments. We focus on explaining model-data components to enhance model explainability in medical image registration. On computational time experiments, we show that the FIRE model performs on a memory-saving mode, as it can inherently learn topology-preserving image registration directly in the training phase. We therefore demonstrate an efficient and versatile registration technique that can have merit in multi-modal image registrations in the clinical setting.
Collapse
Affiliation(s)
- Chengjia Wang
- Edinburgh Imaging Facility QMRI, Centre for Cardiovascular Science, University of Edinburgh, Edinburgh EH16 4TJ, UK;
| | - Guang Yang
- Faculty of Medicine, National Heart & Lung Institute, Imperial College London, London SW7 2BX, UK
| | - Giorgos Papanastasiou
- Edinburgh Imaging Facility QMRI, Centre for Cardiovascular Science, University of Edinburgh, Edinburgh EH16 4TJ, UK;
- School of Computer Science and Electronic Engineering, University of Essex, Colchester CO4 3SQ, UK
| |
Collapse
|
2
|
Papanastasiou G, Rodrigues MA, Wang C, Heurling K, Lucatelli C, Salman RAS, Wardlaw JM, van Beek EJR, Thompson G. Pharmacokinetic modelling for the simultaneous assessment of perfusion and 18F-flutemetamol uptake in cerebral amyloid angiopathy using a reduced PET-MR acquisition time: Proof of concept. Neuroimage 2020; 225:117482. [PMID: 33157265 DOI: 10.1016/j.neuroimage.2020.117482] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2020] [Revised: 09/24/2020] [Accepted: 10/19/2020] [Indexed: 01/05/2023] Open
Abstract
PURPOSE Cerebral amyloid angiopathy (CAA) is a cerebral small vessel disease associated with perivascular β-amyloid deposition. CAA is also associated with strokes due to lobar intracerebral haemorrhage (ICH). 18F-flutemetamol amyloid ligand PET may improve the early detection of CAA. We performed pharmacokinetic modelling using both full (0-30, 90-120 min) and reduced (30 min) 18F-flutemetamol PET-MR acquisitions, to investigate regional cerebral perfusion and amyloid deposition in ICH patients. METHODS Dynamic18F-flutemetamol PET-MR was performed in a pilot cohort of sixteen ICH participants; eight lobar ICH cases with probable CAA and eight deep ICH patients. A model-based input function (mIF) method was developed for compartmental modelling. mIF 1-tissue (1-TC) and 2-tissue (2-TC) compartmental modelling, reference tissue models and standardized uptake value ratios were assessed in the setting of probable CAA detection. RESULTS The mIF 1-TC model detected perfusion deficits and 18F-flutemetamol uptake in cases with probable CAA versus deep ICH patients, in both full and reduced PET acquisition time (all P < 0.05). In the reduced PET acquisition, mIF 1-TC modelling reached the highest sensitivity and specificity in detecting perfusion deficits (0.87, 0.77) and 18F-flutemetamol uptake (0.83, 0.71) in cases with probable CAA. Overall, 52 and 48 out of the 64 brain areas with 18F-flutemetamol-determined amyloid deposition showed reduced perfusion for 1-TC and 2-TC models, respectively. CONCLUSION Pharmacokinetic (1-TC) modelling using a 30 min PET-MR time frame detected impaired haemodynamics and increased amyloid load in probable CAA. Perfusion deficits and amyloid burden co-existed within cases with CAA, demonstrating a distinct imaging pattern which may have merit in elucidating the pathophysiological process of CAA.
Collapse
Affiliation(s)
- Giorgos Papanastasiou
- Edinburgh Imaging Facility, Queen's Medical Research Institute, The University of Edinburgh, 47 Little France Crescent, Edinburgh EH16 4TJ, UK.
| | - Mark A Rodrigues
- Centre for Clinical Brain Sciences, The University of Edinburgh, Edinburgh, UK
| | - Chengjia Wang
- Edinburgh Imaging Facility, Queen's Medical Research Institute, The University of Edinburgh, 47 Little France Crescent, Edinburgh EH16 4TJ, UK
| | | | - Christophe Lucatelli
- Edinburgh Imaging Facility, Queen's Medical Research Institute, The University of Edinburgh, 47 Little France Crescent, Edinburgh EH16 4TJ, UK
| | | | - Joanna M Wardlaw
- Edinburgh Imaging Facility, Queen's Medical Research Institute, The University of Edinburgh, 47 Little France Crescent, Edinburgh EH16 4TJ, UK; Centre for Clinical Brain Sciences, The University of Edinburgh, Edinburgh, UK
| | - Edwin J R van Beek
- Edinburgh Imaging Facility, Queen's Medical Research Institute, The University of Edinburgh, 47 Little France Crescent, Edinburgh EH16 4TJ, UK
| | - Gerard Thompson
- Edinburgh Imaging Facility, Queen's Medical Research Institute, The University of Edinburgh, 47 Little France Crescent, Edinburgh EH16 4TJ, UK; Centre for Clinical Brain Sciences, The University of Edinburgh, Edinburgh, UK
| |
Collapse
|
3
|
Kuhn J, Papanastasiou G, Tai CW, Moran CM, Jansen MA, Tavares AA, Lennen RJ, Corral CA, Wang C, Thomson AJ, Berry CC, Yiu HH. Tri-modal imaging of gold-dotted magnetic nanoparticles for magnetic resonance imaging, computed tomography and intravascular ultrasound: an in vitro study. Nanomedicine (Lond) 2020; 15:2433-2445. [PMID: 32914695 DOI: 10.2217/nnm-2020-0236] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/28/2023] Open
Abstract
Aim: To examine the multimodal contrasting ability of gold-dotted magnetic nanoparticles (Au*MNPs) for magnetic resonance (MR), computed tomography (CT) and intravascular ultrasound (IVUS) imaging. Materials & methods: Au*MNPs were prepared by adapting an impregnation method, without using surface capping reagents and characterized (transmission electron microscopy, x-ray diffraction and Fourier-transform infrared spectroscopy) with their in vitro cytotoxicity assessed, followed by imaging assessments. Results: The contrast-enhancing ability of Au*MNPs was shown to be concentration-dependent across MR, CT and IVUS imaging. The Au content of the Au*MNP led to evident increases of the IVUS signal. Conclusion: We demonstrated that Au*MNPs showed concentration-dependent contrast-enhancing ability in MRI and CT imaging, and for the first-time in IVUS imaging due to the Au content. These Au*MNPs are promising toward solidifying tri-modal imaging-based theragnostics.
Collapse
Affiliation(s)
- Joel Kuhn
- Chemical Engineering, School of Engineering & Physical Sciences, Heriot-Watt University, Edinburgh, EH14 4AS, UK
| | - Giorgos Papanastasiou
- School of Computer Science & Electronic Engineering, University of Essex, Colchester, CO4 3SQ, UK.,Edinburgh Imaging, Queen's Medical Research Institute, University of Edinburgh, Edinburgh, EH16 4TJ, U.K
| | - Cheuk-Wai Tai
- Department of Materials & Environmental Chemistry, Arrhenius Laboratory, Stockholm University, Stockholm, SE-106 91, Sweden
| | - Carmel M Moran
- Edinburgh Imaging, Queen's Medical Research Institute, University of Edinburgh, Edinburgh, EH16 4TJ, U.K.,Centre for Cardiovascular Science, Queen's Medical Research Institute, University of Edinburgh, Edinburgh, EH16 4TJ, UK
| | - Maurits A Jansen
- Edinburgh Imaging, Queen's Medical Research Institute, University of Edinburgh, Edinburgh, EH16 4TJ, U.K.,Centre for Cardiovascular Science, Queen's Medical Research Institute, University of Edinburgh, Edinburgh, EH16 4TJ, UK
| | - Adriana As Tavares
- Edinburgh Imaging, Queen's Medical Research Institute, University of Edinburgh, Edinburgh, EH16 4TJ, U.K.,Centre for Cardiovascular Science, Queen's Medical Research Institute, University of Edinburgh, Edinburgh, EH16 4TJ, UK
| | - Ross J Lennen
- Edinburgh Imaging, Queen's Medical Research Institute, University of Edinburgh, Edinburgh, EH16 4TJ, U.K.,Centre for Cardiovascular Science, Queen's Medical Research Institute, University of Edinburgh, Edinburgh, EH16 4TJ, UK
| | - Carlos Alcaide Corral
- Edinburgh Imaging, Queen's Medical Research Institute, University of Edinburgh, Edinburgh, EH16 4TJ, U.K.,Centre for Cardiovascular Science, Queen's Medical Research Institute, University of Edinburgh, Edinburgh, EH16 4TJ, UK
| | - Chengjia Wang
- Edinburgh Imaging, Queen's Medical Research Institute, University of Edinburgh, Edinburgh, EH16 4TJ, U.K
| | - Adrian Jw Thomson
- Edinburgh Imaging, Queen's Medical Research Institute, University of Edinburgh, Edinburgh, EH16 4TJ, U.K.,Centre for Cardiovascular Science, Queen's Medical Research Institute, University of Edinburgh, Edinburgh, EH16 4TJ, UK
| | - Catherine C Berry
- Centre for Cell Engineering, IMCSB, Joseph Black Building, University Avenue, University of Glasgow, Glasgow, G12 8QQ, UK
| | - Humphrey Hp Yiu
- Chemical Engineering, School of Engineering & Physical Sciences, Heriot-Watt University, Edinburgh, EH14 4AS, UK
| |
Collapse
|
4
|
Dobbin SJH, Mangion K, Berry C, Roditi G, Basak S, Sourbron S, White J, Venugopal B, Touyz RM, Jones RJ, Petrie MC, Lang NN. Cardiotoxicity and myocardial hypoperfusion associated with anti-vascular endothelial growth factor therapies: prospective cardiac magnetic resonance imaging in patients with cancer. Eur J Heart Fail 2020; 22:1276-1277. [PMID: 32379945 DOI: 10.1002/ejhf.1847] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/20/2020] [Revised: 03/11/2020] [Accepted: 04/06/2020] [Indexed: 11/09/2022] Open
Affiliation(s)
- Stephen J H Dobbin
- BHF Glasgow Cardiovascular Research Centre, Institute of Cardiovascular and Medical Sciences, University of Glasgow, Glasgow, UK
| | - Kenneth Mangion
- BHF Glasgow Cardiovascular Research Centre, Institute of Cardiovascular and Medical Sciences, University of Glasgow, Glasgow, UK
| | - Colin Berry
- BHF Glasgow Cardiovascular Research Centre, Institute of Cardiovascular and Medical Sciences, University of Glasgow, Glasgow, UK
| | - Giles Roditi
- Department of Radiology, Glasgow Royal Infirmary, Glasgow, UK
| | - Susmita Basak
- Division of Medical Physics, University of Leeds, Leeds, UK
| | - Steven Sourbron
- Department of Infection, Immunity, and Cardiovascular Disease, University of Sheffield, Sheffield, UK
| | - Jeff White
- Institute of Cancer Sciences, University of Glasgow, Beatson West of Scotland Cancer Centre, Glasgow, UK
| | - Balaji Venugopal
- Institute of Cancer Sciences, University of Glasgow, Beatson West of Scotland Cancer Centre, Glasgow, UK
| | - Rhian M Touyz
- BHF Glasgow Cardiovascular Research Centre, Institute of Cardiovascular and Medical Sciences, University of Glasgow, Glasgow, UK
| | - Robert J Jones
- Institute of Cancer Sciences, University of Glasgow, Beatson West of Scotland Cancer Centre, Glasgow, UK
| | - Mark C Petrie
- BHF Glasgow Cardiovascular Research Centre, Institute of Cardiovascular and Medical Sciences, University of Glasgow, Glasgow, UK
| | - Ninian N Lang
- BHF Glasgow Cardiovascular Research Centre, Institute of Cardiovascular and Medical Sciences, University of Glasgow, Glasgow, UK
| |
Collapse
|
5
|
Quantificação do fluxo sanguíneo miocárdico por tomografia por emissão de positrões – Atualização. Rev Port Cardiol 2020; 39:37-46. [DOI: 10.1016/j.repc.2019.05.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2018] [Revised: 04/03/2019] [Accepted: 05/05/2019] [Indexed: 10/24/2022] Open
|
6
|
Fernandes J, Ferreira MJ, Leite L. Update on myocardial blood flow quantification by positron emission tomography. REVISTA PORTUGUESA DE CARDIOLOGIA (ENGLISH EDITION) 2020. [DOI: 10.1016/j.repce.2020.03.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|
7
|
Wallingford MC, Tarui T, Jayaraman N, Huggins GS, Dighe MK. Application of Dynamic Contrast Enhanced Magnetic Resonance Imaging to Evaluate Angiogenic Response and Vascular Permeability. Arterioscler Thromb Vasc Biol 2019; 39:1507-1509. [PMID: 31339781 PMCID: PMC8162837 DOI: 10.1161/atvbaha.119.312972] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Affiliation(s)
- Mary C Wallingford
- From the Mother Infant Research Institute (M.C.W., T.T., N.J.), Tufts Medical Center, Boston, MA
- Molecular Cardiology Research Institute (M.C.W., G.S.H.), Tufts Medical Center, Boston, MA
| | - Tomo Tarui
- From the Mother Infant Research Institute (M.C.W., T.T., N.J.), Tufts Medical Center, Boston, MA
| | - Nirmala Jayaraman
- From the Mother Infant Research Institute (M.C.W., T.T., N.J.), Tufts Medical Center, Boston, MA
| | - Gordon S Huggins
- Molecular Cardiology Research Institute (M.C.W., G.S.H.), Tufts Medical Center, Boston, MA
| | - Manjiri K Dighe
- Department of Radiology, University of Washington, Seattle (M.K.D.)
| |
Collapse
|
8
|
Knott KD, Fernandes JL, Moon JC. Automated Quantitative Stress Perfusion in a Clinical Routine. Magn Reson Imaging Clin N Am 2019; 27:507-520. [PMID: 31279453 DOI: 10.1016/j.mric.2019.04.003] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2023]
Abstract
Cardiovascular magnetic resonance (CMR) perfusion imaging is a robust noninvasive technique to evaluate ischemia in patients with coronary artery disease (CAD). Although qualitative and semiquantitative methods have shown that CMR has high accuracy in diagnosing flow-obstructing lesions in CAD, quantitative ischemic burden is an important variable used in clinical practice for treatment decisions. Quantitative CMR perfusion techniques have evolved significantly, with accuracy comparable with both PET and microsphere evaluation. Routine clinical use of these quantitative techniques has been facilitated by the introduction of automated methods that accelerate the work flow and rapidly generate pixel-based myocardial blood flow maps.
Collapse
Affiliation(s)
- Kristopher D Knott
- Barts Heart Centre, The Cardiovascular Magnetic Resonance Imaging Unit and The Inherited Cardiovascular Diseases Unit, St Bartholomew's Hospital, West Smithfield, 2nd Floor, King George V Block, London EC1A 7BE, UK
| | - Juliano Lara Fernandes
- Jose Michel Kalaf Research Insitute, Radiologia Clinica de Campinas, Av Jose de Souza Campos 840, Campinas, São Paulo 13092-100, Brazil
| | - James C Moon
- Barts Heart Centre, The Cardiovascular Magnetic Resonance Imaging Unit and The Inherited Cardiovascular Diseases Unit, St Bartholomew's Hospital, West Smithfield, 2nd Floor, King George V Block, London EC1A 7BE, UK.
| |
Collapse
|
9
|
Contemporary Issues in Quantitative Myocardial Perfusion CMR Imaging. CURRENT CARDIOVASCULAR IMAGING REPORTS 2019. [DOI: 10.1007/s12410-019-9484-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
|