1
|
Dou H, Virtanen S, Ravikumar N, Frangi AF. A Generative Shape Compositional Framework to Synthesize Populations of Virtual Chimeras. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2025; 36:4750-4764. [PMID: 38502618 DOI: 10.1109/tnnls.2024.3374121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/21/2024]
Abstract
Generating virtual organ populations that capture sufficient variability while remaining plausible is essential to conduct in silico trials (ISTs) of medical devices. However, not all anatomical shapes of interest are always available for each individual in a population. The imaging examinations and modalities used can vary between subjects depending on their individualized clinical pathways. Different imaging modalities may have various fields of view and are sensitive to signals from other tissues/organs, or both. Hence, missing/partially overlapping anatomical information is often available across individuals. We introduce a generative shape model for multipart anatomical structures, learnable from sets of unpaired datasets, i.e., where each substructure in the shape assembly comes from datasets with missing or partially overlapping substructures from disjoint subjects of the same population. The proposed generative model can synthesize complete multipart shape assemblies coined virtual chimeras (VCs). We applied this framework to build VCs from databases of whole-heart shape assemblies that each contribute samples for heart substructures. Specifically, we propose a graph neural network-based generative shape compositional framework, which comprises two components, a part-aware generative shape model that captures the variability in shape observed for each structure of interest in the training population and a spatial composition network that assembles/composes the structures synthesized by the former into multipart shape assemblies (i.e., VCs). We also propose a novel self-supervised learning scheme that enables the spatial composition network to be trained with partially overlapping data and weak labels. We trained and validated our approach using shapes of cardiac structures derived from cardiac magnetic resonance (MR) images in the UK Biobank (UKBB). When trained with complete and partially overlapping data, our approach significantly outperforms a principal component analysis (PCA)-based shape model (trained with complete data) in terms of generalizability and specificity. This demonstrates the superiority of the proposed method, as the synthesized cardiac virtual populations are more plausible and capture a greater degree of shape variability than those generated by the PCA-based shape model.
Collapse
|
2
|
Kingsbury SR, Tharmanathan P, Keding A, Watt FE, Scott DL, Roddy E, Birrell F, Arden NK, Bowes M, Arundel C, Watson M, Ronaldson SJ, Hewitt C, Doherty M, Moots RJ, O'Neill TW, Green M, Patel G, Garrood T, Edwards CJ, Walmsley PJ, Sheeran T, Torgerson DJ, Conaghan PG. Pain Reduction With Oral Methotrexate in Knee Osteoarthritis : A Randomized, Placebo-Controlled Clinical Trial. Ann Intern Med 2024; 177:1145-1156. [PMID: 39074374 DOI: 10.7326/m24-0303] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 07/31/2024] Open
Abstract
BACKGROUND Treatments for osteoarthritis (OA) are limited. Previous small studies suggest that the antirheumatic drug methotrexate may be a potential treatment for OA pain. OBJECTIVE To assess symptomatic benefits of methotrexate in knee OA (KOA). DESIGN A multicenter, randomized, double-blind, placebo-controlled trial done between 13 June 2014 and 13 October 2017. (ISRCTN77854383; EudraCT: 2013-001689-41). SETTING 15 secondary care musculoskeletal clinics in the United Kingdom. PARTICIPANTS A total of 207 participants with symptomatic, radiographic KOA and knee pain (severity ≥4 out of 10) on most days in the past 3 months with inadequate response to current medication were approached for inclusion. INTERVENTION Participants were randomly assigned 1:1 to oral methotrexate once weekly (6-week escalation 10 to 25 mg) or matched placebo over 12 months and continued usual analgesia. MEASUREMENTS The primary end point was average knee pain (numerical rating scale [NRS] 0 to 10) at 6 months, with 12-month follow-up to assess longer-term response. Secondary end points included knee stiffness and function outcomes and adverse events (AEs). RESULTS A total of 155 participants (64% women; mean age, 60.9 years; 50% Kellgren-Lawrence grade 3 to 4) were randomly assigned to methotrexate (n = 77) or placebo (n = 78). Follow-up was 86% (n = 134; methotrexate: 66, placebo: 68) at 6 months. Mean knee pain decreased from 6.4 (SD, 1.80) at baseline to 5.1 (SD, 2.32) at 6 months in the methotrexate group and from 6.8 (SD, 1.62) to 6.2 (SD, 2.30) in the placebo group. The primary intention-to-treat analysis showed a statistically significant pain reduction of 0.79 NRS points in favor of methotrexate (95% CI, 0.08 to 1.51; P = 0.030). There were also statistically significant treatment group differences in favor of methotrexate at 6 months for Western Ontario and McMaster Universities Osteoarthritis Index stiffness (0.60 points [CI, 0.01 to 1.18]; P = 0.045) and function (5.01 points [CI, 1.29 to 8.74]; P = 0.008). Treatment adherence analysis supported a dose-response effect. Four unrelated serious AEs were reported (methotrexate: 2, placebo: 2). LIMITATION Not permitting oral methotrexate to be changed to subcutaneous delivery for intolerance. CONCLUSION Oral methotrexate added to usual medications demonstrated statistically significant reduction in KOA pain, stiffness, and function at 6 months. PRIMARY FUNDING SOURCE Versus Arthritis.
Collapse
Affiliation(s)
- Sarah R Kingsbury
- Leeds Institute of Rheumatic and Musculoskeletal Medicine, University of Leeds, and National Institute for Health and Care Research (NIHR) Leeds Biomedical Research Centre, Leeds, United Kingdom (S.R.K., P.G.C.)
| | - Puvan Tharmanathan
- York Trials Unit, Department of Health Sciences, Faculty of Science, University of York, Heslington, York, United Kingdom (P.T., A.K., C.A., M.W., S.J.R., C.H., D.J.T.)
| | - Ada Keding
- York Trials Unit, Department of Health Sciences, Faculty of Science, University of York, Heslington, York, United Kingdom (P.T., A.K., C.A., M.W., S.J.R., C.H., D.J.T.)
| | - Fiona E Watt
- Centre for Inflammatory Disease, Department of Immunology and Inflammation, Hammersmith Campus, Imperial College London, and Centre for Osteoarthritis Pathogenesis Versus Arthritis, Kennedy Institute of Rheumatology, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, and Department of Rheumatology, Oxford University Hospitals NHS Foundation Trust, and Centre for Sport, Exercise and Osteoarthritis Research Versus Arthritis, Oxford, United Kingdom (F.E.W.)
| | - David L Scott
- King's College London, London, United Kingdom (D.L.S.)
| | - Edward Roddy
- Primary Care Centre Versus Arthritis, Keele University, and Haywood Academic Rheumatology Centre, Midlands Partnership University NHS Foundation Trust, Keele, United Kingdom (E.R.)
| | - Fraser Birrell
- Medical Research Council-Versus Arthritis Centre for Integrated Research into Musculoskeletal Ageing, Newcastle University, and Northumbria Healthcare NHS Foundation Trust, Newcastle upon Tyne, United Kingdom (F.B.)
| | - Nigel K Arden
- Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, and Centre for Sport, Exercise and Osteoarthritis Research Versus Arthritis, University of Oxford, Oxford, United Kingdom (N.K.A.)
| | - Mike Bowes
- Imorphics, Manchester, United Kingdom (M.B.)
| | - Catherine Arundel
- York Trials Unit, Department of Health Sciences, Faculty of Science, University of York, Heslington, York, United Kingdom (P.T., A.K., C.A., M.W., S.J.R., C.H., D.J.T.)
| | - Michelle Watson
- York Trials Unit, Department of Health Sciences, Faculty of Science, University of York, Heslington, York, United Kingdom (P.T., A.K., C.A., M.W., S.J.R., C.H., D.J.T.)
| | - Sarah J Ronaldson
- York Trials Unit, Department of Health Sciences, Faculty of Science, University of York, Heslington, York, United Kingdom (P.T., A.K., C.A., M.W., S.J.R., C.H., D.J.T.)
| | - Catherine Hewitt
- York Trials Unit, Department of Health Sciences, Faculty of Science, University of York, Heslington, York, United Kingdom (P.T., A.K., C.A., M.W., S.J.R., C.H., D.J.T.)
| | - Michael Doherty
- Academic Rheumatology and Pain Centre Versus Arthritis, University of Nottingham, Nottingham, United Kingdom (M.D.)
| | - Robert J Moots
- Faculty of Heath Social Care and Medicine, Edge Hill University, Ormskirk, and Department of Rheumatology, Aintree University Hospital, Liverpool, United Kingdom (R.J.M.)
| | - Terence W O'Neill
- Centre for Epidemiology Versus Arthritis, Division of Musculoskeletal and Dermatological Sciences, Manchester Academic Health Science Centre, University of Manchester, and NIHR Manchester Biomedical Research Centre, Manchester University NHS Foundation Trust, Manchester, United Kingdom (T.W.O.)
| | - Michael Green
- Harrogate and District NHS Foundation Trust, Harrogate, and York Teaching Hospital NHS Foundation Trust, York, United Kingdom (M.G.)
| | - Gulam Patel
- Rheumatology Department, Ashford and St. Peter's Hospital NHS Trust, Chertsey, United Kingdom (G.P.)
| | - Toby Garrood
- Department of Rheumatology, Guy's and St. Thomas' NHS Trust, London, United Kingdom (T.G.)
| | - Christopher J Edwards
- NIHR Southampton Clinical Research Facility, University Hospital Southampton NHS Foundation Trust, Southampton, United Kingdom (C.J.E.)
| | - Phil J Walmsley
- Department of Orthopaedics, Victoria Hospital Kirkcaldy and School of Medicine, St. Andrews University, Fife and Fife NHS Trust, Kirkcaldy, United Kingdom (P.J.W.)
| | - Tom Sheeran
- Department of Rheumatology, Royal Wolverhampton Hospitals NHS Trust, Wolverhampton, United Kingdom (T.S.)
| | - David J Torgerson
- York Trials Unit, Department of Health Sciences, Faculty of Science, University of York, Heslington, York, United Kingdom (P.T., A.K., C.A., M.W., S.J.R., C.H., D.J.T.)
| | - Philip G Conaghan
- Leeds Institute of Rheumatic and Musculoskeletal Medicine, University of Leeds, and National Institute for Health and Care Research (NIHR) Leeds Biomedical Research Centre, Leeds, United Kingdom (S.R.K., P.G.C.)
| |
Collapse
|
3
|
Wang G, Zhou M, Ning X, Tiwari P, Zhu H, Yang G, Yap CH. US2Mask: Image-to-mask generation learning via a conditional GAN for cardiac ultrasound image segmentation. Comput Biol Med 2024; 172:108282. [PMID: 38503085 DOI: 10.1016/j.compbiomed.2024.108282] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2024] [Revised: 02/29/2024] [Accepted: 03/12/2024] [Indexed: 03/21/2024]
Abstract
Cardiac ultrasound (US) image segmentation is vital for evaluating clinical indices, but it often demands a large dataset and expert annotations, resulting in high costs for deep learning algorithms. To address this, our study presents a framework utilizing artificial intelligence generation technology to produce multi-class RGB masks for cardiac US image segmentation. The proposed approach directly performs semantic segmentation of the heart's main structures in US images from various scanning modes. Additionally, we introduce a novel learning approach based on conditional generative adversarial networks (CGAN) for cardiac US image segmentation, incorporating a conditional input and paired RGB masks. Experimental results from three cardiac US image datasets with diverse scan modes demonstrate that our approach outperforms several state-of-the-art models, showcasing improvements in five commonly used segmentation metrics, with lower noise sensitivity. Source code is available at https://github.com/energy588/US2mask.
Collapse
Affiliation(s)
- Gang Wang
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, Chongqing; Department of Bioengineering, Imperial College London, London, UK
| | - Mingliang Zhou
- School of Computer Science, Chongqing University, Chongqing, Chongqing.
| | - Xin Ning
- Institute of Semiconductors, Chinese Academy of Sciences, Beijing, China
| | - Prayag Tiwari
- School of Information Technology, Halmstad University, Halmstad, Sweden
| | | | - Guang Yang
- Department of Bioengineering, Imperial College London, London, UK; Cardiovascular Research Centre, Royal Brompton Hospital, London, UK; National Heart and Lung Institute, Imperial College London, London, UK
| | - Choon Hwai Yap
- Department of Bioengineering, Imperial College London, London, UK
| |
Collapse
|
4
|
Marzola A, McGreevy KS, Mussa F, Volpe Y, Governi L. HyM3D: A hybrid method for the automatic 3D reconstruction of a defective cranial vault. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 234:107516. [PMID: 37023601 DOI: 10.1016/j.cmpb.2023.107516] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Revised: 03/08/2023] [Accepted: 03/27/2023] [Indexed: 06/19/2023]
Abstract
BACKGROUND AND OBJECTIVE The ability to accomplish a consistent restoration of a missing or deformed anatomical area is a fundamental step for defining a custom implant, especially in the maxillofacial and cranial reconstruction where the aesthetical aspect is crucial for a successful surgical outcome. At the same time, this task is also the most difficult, time-consuming, and complicated across the whole reconstruction process. This is mostly due to the high geometric complexity of the anatomical structures, insufficient references, and significant interindividual anatomical heterogeneity. Numerous solutions, specifically for the neurocranium, have been put forward in the scientific literature to address the reconstruction issue, but none of them has yet been persuasive enough to guarantee an easily automatable approach with a consistent shape reconstruction. METHODS This work aims to present a novel reconstruction method (named HyM3D) for the automatic restoration of the exocranial surface by ensuring both the symmetry of the resulting skull and the continuity between the reconstructive patch and the surrounding bone. To achieve this goal, the strengths of the Template-based methods are exploited to provide knowledge of the missing or deformed region and to guide a subsequent Surface Interpolation-based algorithm. HyM3D is an improved version of a methodology presented by the authors in a previous publication for the restoration of unilateral defects. Differently from the first version, the novel procedure applies to all kinds of cranial defects, whether they are unilateral or not. RESULTS The presented method has been tested on several test cases, both synthetic and real, and the results show that it is reliable and trustworthy, providing a consistent outcome with no user intervention even when dealing with complex defects. CONCLUSIONS HyM3D method proved to be a valid alternative to the existing approaches for the digital reconstruction of a defective cranial vault; furthermore, with respect to the current alternatives, it demands less user interaction since the method is landmarks-independent and does not require any patch adaptation.
Collapse
Affiliation(s)
- Antonio Marzola
- Department of Industrial Engineering of Florence, University of Florence (Italy), via di Santa Marta 3, Firenze 50139, Italy.
| | | | - Federico Mussa
- Meyer Children's Hospital IRCCS, Viale Pieraccini 24, Florence 50141, Italy
| | - Yary Volpe
- Department of Industrial Engineering of Florence, University of Florence (Italy), via di Santa Marta 3, Firenze 50139, Italy
| | - Lapo Governi
- Department of Industrial Engineering of Florence, University of Florence (Italy), via di Santa Marta 3, Firenze 50139, Italy
| |
Collapse
|
5
|
Owens CA, Rigaud B, Ludmir EB, Gupta AC, Shrestha S, Paulino AC, Smith SA, Peterson CB, Kry SF, Lee C, Henderson TO, Armstrong GT, Brock KK, Howell RM. Development and validation of a population-based anatomical colorectal model for radiation dosimetry in late effects studies of survivors of childhood cancer. Radiother Oncol 2022; 176:118-126. [PMID: 36063983 PMCID: PMC9845018 DOI: 10.1016/j.radonc.2022.08.027] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2022] [Revised: 08/10/2022] [Accepted: 08/24/2022] [Indexed: 01/19/2023]
Abstract
PURPOSE The purposes of this study were to develop and integrate a colorectal model that incorporates anatomical variations of pediatric patients into the age-scalable MD Anderson Late Effects (MDA-LE) computational phantom, and validate the model for pediatric radiation therapy (RT) dose reconstructions. METHODS Colorectal contours were manually derived from whole-body non-contrast computed tomography (CT) scans of 114 pediatric patients (age range: 2.1-21.6 years, 74 males, 40 females). One contour was used for an anatomical template, 103 for training and 10 for testing. Training contours were used to create a colorectal principal component analysis (PCA)-based statistical shape model (SSM) to extract the population's dominant deformations. The SSM was integrated into the MDA-LE phantom. Geometric accuracy was assessed between patient-specific and SSM contours using several overlap metrics. Two alternative colorectal shapes were generated using the first 17 dominant modes of the PCA-based SSM. Dosimetric accuracy was assessed by comparing colorectal doses from test patients' CT-based RT plans (ground truth) with reconstructed doses for the mean and two alternative models in age-matched MDA-LE phantoms. RESULTS When using all 103 PCA modes, the mean (min-max) Dice similarity coefficient, distance-to-agreement and Hausdorff distance between the patient-specific and reconstructed contours for the test patients were 0.89 (0.85-0.91), 2.1 mm (1.7-3.0), and 8.6 mm (5.7-14.3), respectively. The average percent difference between reconstructed and ground truth mean and maximum colorectal doses for the mean (alternative 1, 2) model were 6.3% (8.1%, 6.1%) and 4.4% (4.3%, 4.7%), respectively. CONCLUSIONS We developed, validated and integrated a colorectal PCA-based SSM into the MDA-LE phantom and demonstrated its dosimetric performance for accurate pediatric RT dose reconstruction.
Collapse
Affiliation(s)
- Constance A Owens
- The University of Texas MD Anderson Cancer Center, Department of Radiation Physics, Houston, TX, USA; MD Anderson Cancer Center UTHealth Graduate School of Biomedical Sciences, Graduate Program in Medical Physics, Houston, TX, USA.
| | - Bastien Rigaud
- The University of Texas MD Anderson Cancer Center, Department of Imaging Physics, Houston, TX, USA
| | - Ethan B Ludmir
- The University of Texas MD Anderson Cancer Center, Department of Radiation Oncology, Houston, TX, USA; The University of Texas MD Anderson Cancer Center, Department of Biostatistics, Houston, TX, USA
| | - Aashish C Gupta
- The University of Texas MD Anderson Cancer Center, Department of Radiation Physics, Houston, TX, USA; MD Anderson Cancer Center UTHealth Graduate School of Biomedical Sciences, Graduate Program in Medical Physics, Houston, TX, USA
| | - Suman Shrestha
- The University of Texas MD Anderson Cancer Center, Department of Radiation Physics, Houston, TX, USA; MD Anderson Cancer Center UTHealth Graduate School of Biomedical Sciences, Graduate Program in Medical Physics, Houston, TX, USA
| | - Arnold C Paulino
- The University of Texas MD Anderson Cancer Center, Department of Radiation Oncology, Houston, TX, USA
| | - Susan A Smith
- The University of Texas MD Anderson Cancer Center, Department of Radiation Physics, Houston, TX, USA
| | - Christine B Peterson
- The University of Texas MD Anderson Cancer Center, Department of Biostatistics, Houston, TX, USA
| | - Stephen F Kry
- The University of Texas MD Anderson Cancer Center, Department of Radiation Physics, Houston, TX, USA; MD Anderson Cancer Center UTHealth Graduate School of Biomedical Sciences, Graduate Program in Medical Physics, Houston, TX, USA
| | - Choonsik Lee
- National Cancer Institute, Division of Cancer Epidemiology and Genetics, Bethesda, MD, USA
| | - Tara O Henderson
- The University of Chicago, Department of Pediatrics, Chicago, IL, USA
| | - Gregory T Armstrong
- St. Jude Children's Research Hospital, Department of Epidemiology and Cancer Control, Memphis, TN, USA
| | - Kristy K Brock
- The University of Texas MD Anderson Cancer Center, Department of Radiation Physics, Houston, TX, USA; The University of Texas MD Anderson Cancer Center, Department of Imaging Physics, Houston, TX, USA
| | - Rebecca M Howell
- The University of Texas MD Anderson Cancer Center, Department of Radiation Physics, Houston, TX, USA; MD Anderson Cancer Center UTHealth Graduate School of Biomedical Sciences, Graduate Program in Medical Physics, Houston, TX, USA.
| |
Collapse
|
6
|
Conaghan PG, Bowes MA, Kingsbury SR, Brett A, Guillard G, Rizoska B, Sjögren N, Graham P, Jansson Å, Wadell C, Bethell R, Öhd J. Disease-Modifying Effects of a Novel Cathepsin K Inhibitor in Osteoarthritis: A Randomized Controlled Trial. Ann Intern Med 2020; 172:86-95. [PMID: 31887743 DOI: 10.7326/m19-0675] [Citation(s) in RCA: 90] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
BACKGROUND MIV-711 is a novel selective cathepsin K inhibitor with beneficial effects on bone and cartilage in preclinical osteoarthritis models. OBJECTIVE To evaluate the efficacy, safety, and tolerability of MIV-711 in participants with symptomatic, radiographic knee osteoarthritis. DESIGN 26-week randomized, double-blind, placebo-controlled phase 2a study with a 26-week open-label safety extension substudy. (EudraCT: 2015-003230-26 and 2016-001096-73). SETTING Six European sites. PARTICIPANTS 244 participants with primary knee osteoarthritis, Kellgren-Lawrence grade 2 or 3, and pain score of 4 to 10 on a numerical rating scale (NRS). INTERVENTION MIV-711, 100 (n = 82) or 200 (n = 81) mg daily, or matched placebo (n = 77). Participants (46 who initially received 200 mg/d and 4 who received placebo) received 200 mg of MIV-711 daily during the extension substudy. MEASUREMENTS The primary outcome was change in NRS pain score. The key secondary outcome was change in bone area on magnetic resonance imaging (MRI). Other secondary end points included cartilage thickness on quantitative MRI and type I and II collagen C-telopeptide biomarkers. Outcomes were assessed over 26 weeks. RESULTS Changes in NRS pain scores with MIV-711 were not statistically significant (placebo, -1.4; MIV-711, 100 mg/d, -1.7; MIV-711, 200 mg/d, -1.5). MIV-711 significantly reduced medial femoral bone area progression (P = 0.002 for 100 mg/d and 0.004 for 200 mg/d) and medial femoral cartilage thinning (P = 0.023 for 100 mg/d and 0.125 for 200 mg/d) versus placebo and substantially reduced bone and cartilage biomarker levels. Nine serious adverse events occurred in 6 participants (1 in the placebo group, 3 in the 100 mg group, and 2 in the 200 mg group); none were considered to be treatment-related. LIMITATION The trial was relatively short. CONCLUSION MIV-711 was not more effective than placebo for pain, but it significantly reduced bone and cartilage progression with a reassuring safety profile. This treatment may merit further evaluation as a disease-modifying osteoarthritis drug. PRIMARY FUNDING SOURCE Medivir.
Collapse
Affiliation(s)
- Philip G Conaghan
- Leeds Institute of Rheumatic and Musculoskeletal Medicine, University of Leeds and NIHR Leeds Biomedical Research Centre, Leeds, United Kingdom (P.G.C., S.R.K.)
| | | | - Sarah R Kingsbury
- Leeds Institute of Rheumatic and Musculoskeletal Medicine, University of Leeds and NIHR Leeds Biomedical Research Centre, Leeds, United Kingdom (P.G.C., S.R.K.)
| | - Alan Brett
- Imorphics, Manchester, United Kingdom (M.A.B., A.B., G.G.)
| | | | - Biljana Rizoska
- Medivir, Huddinge, Sweden (B.R., N.S., P.G., Å.J., C.W., R.B., J.Ö.)
| | - Niclas Sjögren
- Medivir, Huddinge, Sweden (B.R., N.S., P.G., Å.J., C.W., R.B., J.Ö.)
| | - Philippa Graham
- Medivir, Huddinge, Sweden (B.R., N.S., P.G., Å.J., C.W., R.B., J.Ö.)
| | - Åsa Jansson
- Medivir, Huddinge, Sweden (B.R., N.S., P.G., Å.J., C.W., R.B., J.Ö.)
| | - Cecilia Wadell
- Medivir, Huddinge, Sweden (B.R., N.S., P.G., Å.J., C.W., R.B., J.Ö.)
| | - Richard Bethell
- Medivir, Huddinge, Sweden (B.R., N.S., P.G., Å.J., C.W., R.B., J.Ö.)
| | - John Öhd
- Medivir, Huddinge, Sweden (B.R., N.S., P.G., Å.J., C.W., R.B., J.Ö.)
| |
Collapse
|
7
|
Das PK, Meher S, Panda R, Abraham A. A Review of Automated Methods for the Detection of Sickle Cell Disease. IEEE Rev Biomed Eng 2019; 13:309-324. [PMID: 31107662 DOI: 10.1109/rbme.2019.2917780] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Detection of sickle cell disease is a crucial job in medical image analysis. It emphasizes elaborate analysis of proper disease diagnosis after accurate detection followed by a classification of irregularities, which plays a vital role in the sickle cell disease diagnosis, treatment planning, and treatment outcome evaluation. Proper segmentation of complex cell clusters makes sickle cell detection more accurate and robust. Cell morphology has a key role in the detection of the sickle cell because the shapes of the normal blood cell and sickle cell differ significantly. This review emphasizes state-of-the-art methods and recent advances in detection, segmentation, and classification of sickle cell disease. We discuss key challenges encountered during the segmentation of overlapping blood cells. Moreover, standard validation measures that have been employed to yield performance analysis of various methods are also discussed. The methodologies and experiments in this review will be useful to further research and work in this area.
Collapse
|
8
|
Cerveri P, Belfatto A, Manzotti A. Pair-wise vs group-wise registration in statistical shape model construction: representation of physiological and pathological variability of bony surface morphology. Comput Methods Biomech Biomed Engin 2019; 22:772-787. [PMID: 30931618 DOI: 10.1080/10255842.2019.1592378] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Abstract
Statistical shape models (SSM) of bony surfaces have been widely proposed in orthopedics, especially for anatomical bone modeling, joint kinematic analysis, staging of morphological abnormality, and pre- and intra-operative shape reconstruction. In the SSM computation, reference shape selection, shape registration and point correspondence computation are fundamental aspects determining the quality (generality, specificity and compactness) of the SSM. Such procedures can be made critical by the presence of large morphological dissimilarities within the surfaces, not only because of anthropometrical variability but also mainly due to pathological abnormalities. In this work, we proposed a SW pipeline for SSM construction based on pair-wise (PW) shape registration, which requires the a-priori selection of the reference shape, and on a custom iterative point correspondence algorithm. We addressed large morphological deformations in five different bony surface sets, namely proximal femur, distal femur, patella, proximal fibula and proximal tibia, extracted from a retrospective patient dataset. The technique was compared to a method from the literature, based on group-wise (GW) shape registration. As a main finding, the proposed technique provided generalization and specificity median errors, for all the five bony regions, lower than 2 mm. The comparative analysis provided basically similar results. Particularly, for the distal femur that was the shape affected by the largest pathological deformations, the differences in generalization, specificity and compactness were lower than 0.5 mm, 0.5 mm, and 1%, respectively. We can argue the proposed pipeline, along with the robust correspondence algorithm, is able to compute high-quality SSM of bony shapes, even affected by large morphological variability.
Collapse
Affiliation(s)
- Pietro Cerveri
- a Department of Electronics, Information and Bioengineering , Politecnico di Milano , Milan , Italy
| | - Antonella Belfatto
- a Department of Electronics, Information and Bioengineering , Politecnico di Milano , Milan , Italy
| | - Alfonso Manzotti
- b Orthopaedic and Trauma Department , Luigi Sacco Hospital, ASST FBF-Sacco , Milan , Italy
| |
Collapse
|
9
|
Gahm JK, Shi Y. Riemannian metric optimization on surfaces (RMOS) for intrinsic brain mapping in the Laplace-Beltrami embedding space. Med Image Anal 2018; 46:189-201. [PMID: 29574399 PMCID: PMC5910235 DOI: 10.1016/j.media.2018.03.004] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2017] [Revised: 01/31/2018] [Accepted: 03/13/2018] [Indexed: 11/18/2022]
Abstract
Surface mapping methods play an important role in various brain imaging studies from tracking the maturation of adolescent brains to mapping gray matter atrophy patterns in Alzheimer's disease. Popular surface mapping approaches based on spherical registration, however, have inherent numerical limitations when severe metric distortions are present during the spherical parameterization step. In this paper, we propose a novel computational framework for intrinsic surface mapping in the Laplace-Beltrami (LB) embedding space based on Riemannian metric optimization on surfaces (RMOS). Given a diffeomorphism between two surfaces, an isometry can be defined using the pullback metric, which in turn results in identical LB embeddings from the two surfaces. The proposed RMOS approach builds upon this mathematical foundation and achieves general feature-driven surface mapping in the LB embedding space by iteratively optimizing the Riemannian metric defined on the edges of triangular meshes. At the core of our framework is an optimization engine that converts an energy function for surface mapping into a distance measure in the LB embedding space, which can be effectively optimized using gradients of the LB eigen-system with respect to the Riemannian metrics. In the experimental results, we compare the RMOS algorithm with spherical registration using large-scale brain imaging data, and show that RMOS achieves superior performance in the prediction of hippocampal subfields and cortical gyral labels, and the holistic mapping of striatal surfaces for the construction of a striatal connectivity atlas from substantia nigra.
Collapse
Affiliation(s)
- Jin Kyu Gahm
- Laboratory of Neuro Imaging, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of University of Southern California, 2025 Zonal Ave.,Los Angeles, CA 90033, USA
| | - Yonggang Shi
- Laboratory of Neuro Imaging, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of University of Southern California, 2025 Zonal Ave.,Los Angeles, CA 90033, USA.
| |
Collapse
|
10
|
Gooya A, Lekadir K, Castro-Mateos I, Pozo JM, Frangi AF. Mixture of Probabilistic Principal Component Analyzers for Shapes from Point Sets. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2018; 40:891-904. [PMID: 28475045 DOI: 10.1109/tpami.2017.2700276] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Inferring a probability density function (pdf) for shape from a population of point sets is a challenging problem. The lack of point-to-point correspondences and the non-linearity of the shape spaces undermine the linear models. Methods based on manifolds model the shape variations naturally, however, statistics are often limited to a single geodesic mean and an arbitrary number of variation modes. We relax the manifold assumption and consider a piece-wise linear form, implementing a mixture of distinctive shape classes. The pdf for point sets is defined hierarchically, modeling a mixture of Probabilistic Principal Component Analyzers (PPCA) in higher dimension. A Variational Bayesian approach is designed for unsupervised learning of the posteriors of point set labels, local variation modes, and point correspondences. By maximizing the model evidence, the numbers of clusters, modes of variations, and points on the mean models are automatically selected. Using the predictive distribution, we project a test shape to the spaces spanned by the local PPCA's. The method is applied to point sets from: i) synthetic data, ii) healthy versus pathological heart morphologies, and iii) lumbar vertebrae. The proposed method selects models with expected numbers of clusters and variation modes, achieving lower generalization-specificity errors compared to state-of-the-art.
Collapse
|
11
|
Gee AH, Treece GM, Poole KES. How does the femoral cortex depend on bone shape? A methodology for the joint analysis of surface texture and shape. Med Image Anal 2018; 45:55-67. [PMID: 29414436 PMCID: PMC5842044 DOI: 10.1016/j.media.2018.01.001] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2017] [Revised: 11/24/2017] [Accepted: 01/12/2018] [Indexed: 11/19/2022]
Abstract
In humans, there is clear evidence of an association between hip fracture risk and femoral neck bone mineral density, and some evidence of an association between fracture risk and the shape of the proximal femur. Here, we investigate whether the femoral cortex plays a role in these associations: do particular morphologies predispose to weaker cortices? To answer this question, we used cortical bone mapping to measure the distribution of cortical mass surface density (CMSD, mg/cm2) in a cohort of 125 females. Principal component analysis of the femoral surfaces identified three modes of shape variation accounting for 65% of the population variance. We then used statistical parametric mapping (SPM) to locate regions of the cortex where CMSD depends on shape, allowing for age. Our principal findings were increased CMSD with increased gracility over much of the proximal femur; and decreased CMSD at the superior femoral neck, coupled with increased CMSD at the calcar femorale, with increasing neck-shaft angle. In obtaining these results, we studied the role of spatial normalization in SPM, identifying systematic misregistration as a major impediment to the joint analysis of CMSD and shape. Through a series of experiments on synthetic data, we evaluated a number of registration methods for spatial normalization, concluding that only those predicated on an explicit set of homologous landmarks are suitable for this kind of analysis. The emergent methodology amounts to an extension of Geometric Morphometric Image Analysis to the domain of textured surfaces, alongside a protocol for labelling homologous landmarks in clinical CT scans of the human proximal femur.
Collapse
Affiliation(s)
- A H Gee
- Department of Engineering, University of Cambridge, Trumpington Street, Cambridge CB2 1PZ, UK.
| | - G M Treece
- Department of Engineering, University of Cambridge, Trumpington Street, Cambridge CB2 1PZ, UK.
| | - K E S Poole
- Department of Medicine, University of Cambridge, Level 5, Addenbrooke's Hospital, Box 157, Hills Road, Cambridge CB2 2QQ, UK.
| |
Collapse
|
12
|
Tu L, Styner M, Vicory J, Elhabian S, Wang R, Hong J, Paniagua B, Prieto JC, Yang D, Whitaker R, Pizer SM. Skeletal Shape Correspondence Through Entropy. IEEE TRANSACTIONS ON MEDICAL IMAGING 2018; 37:1-11. [PMID: 28945591 PMCID: PMC5943061 DOI: 10.1109/tmi.2017.2755550] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
We present a novel approach for improving the shape statistics of medical image objects by generating correspondence of skeletal points. Each object's interior is modeled by an s-rep, i.e., by a sampled, folded, two-sided skeletal sheet with spoke vectors proceeding from the skeletal sheet to the boundary. The skeleton is divided into three parts: the up side, the down side, and the fold curve. The spokes on each part are treated separately and, using spoke interpolation, are shifted along that skeleton in each training sample so as to tighten the probability distribution on those spokes' geometric properties while sampling the object interior regularly. As with the surface/boundary-based correspondence method of Cates et al., entropy is used to measure both the probability distribution tightness and the sampling regularity, here of the spokes' geometric properties. Evaluation on synthetic and real world lateral ventricle and hippocampus data sets demonstrate improvement in the performance of statistics using the resulting probability distributions. This improvement is greater than that achieved by an entropy-based correspondence method on the boundary points.
Collapse
|
13
|
Ravikumar N, Gooya A, Çimen S, Frangi AF, Taylor ZA. Group-wise similarity registration of point sets using Student's t-mixture model for statistical shape models. Med Image Anal 2017; 44:156-176. [PMID: 29248842 DOI: 10.1016/j.media.2017.11.012] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2016] [Revised: 07/11/2017] [Accepted: 11/25/2017] [Indexed: 01/18/2023]
Abstract
A probabilistic group-wise similarity registration technique based on Student's t-mixture model (TMM) and a multi-resolution extension of the same (mr-TMM) are proposed in this study, to robustly align shapes and establish valid correspondences, for the purpose of training statistical shape models (SSMs). Shape analysis across large cohorts requires automatic generation of the requisite training sets. Automated segmentation and landmarking of medical images often result in shapes with varying proportions of outliers and consequently require a robust method of alignment and correspondence estimation. Both TMM and mrTMM are validated by comparison with state-of-the-art registration algorithms based on Gaussian mixture models (GMMs), using both synthetic and clinical data. Four clinical data sets are used for validation: (a) 2D femoral heads (K= 1000 samples generated from DXA images of healthy subjects); (b) control-hippocampi (K= 50 samples generated from T1-weighted magnetic resonance (MR) images of healthy subjects); (c) MCI-hippocampi (K= 28 samples generated from MR images of patients diagnosed with mild cognitive impairment); and (d) heart shapes comprising left and right ventricular endocardium and epicardium (K= 30 samples generated from short-axis MR images of: 10 healthy subjects, 10 patients diagnosed with pulmonary hypertension and 10 diagnosed with hypertrophic cardiomyopathy). The proposed methods significantly outperformed the state-of-the-art in terms of registration accuracy in the experiments involving synthetic data, with mrTMM offering significant improvement over TMM. With the clinical data, both methods performed comparably to the state-of-the-art for the hippocampi and heart data sets, which contained few outliers. They outperformed the state-of-the-art for the femur data set, containing large proportions of outliers, in terms of alignment accuracy, and the quality of SSMs trained, quantified in terms of generalization, compactness and specificity.
Collapse
Affiliation(s)
- Nishant Ravikumar
- CISTIB Centre for Computational Imaging and Simulation Technologies in Biomedicine, INSIGNEO Institute for in silico Medicine, United Kingdom; Department of Mechanical Engineering, The University of Sheffield, United Kingdom.
| | - Ali Gooya
- CISTIB Centre for Computational Imaging and Simulation Technologies in Biomedicine, INSIGNEO Institute for in silico Medicine, United Kingdom; Department of Electronic and Electrical Engineering, The University of Sheffield, United Kingdom.
| | - Serkan Çimen
- CISTIB Centre for Computational Imaging and Simulation Technologies in Biomedicine, INSIGNEO Institute for in silico Medicine, United Kingdom; Department of Electronic and Electrical Engineering, The University of Sheffield, United Kingdom.
| | - Alejandro F Frangi
- CISTIB Centre for Computational Imaging and Simulation Technologies in Biomedicine, INSIGNEO Institute for in silico Medicine, United Kingdom; Department of Electronic and Electrical Engineering, The University of Sheffield, United Kingdom.
| | - Zeike A Taylor
- CISTIB Centre for Computational Imaging and Simulation Technologies in Biomedicine, INSIGNEO Institute for in silico Medicine, United Kingdom; Department of Mechanical Engineering, The University of Sheffield, United Kingdom.
| |
Collapse
|
14
|
Laga H, Xie Q, Jermyn IH, Srivastava A. Numerical Inversion of SRNF Maps for Elastic Shape Analysis of Genus-Zero Surfaces. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2017; 39:2451-2464. [PMID: 28103188 DOI: 10.1109/tpami.2016.2647596] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Recent developments in elastic shape analysis (ESA) are motivated by the fact that it provides a comprehensive framework for simultaneous registration, deformation, and comparison of shapes. These methods achieve computational efficiency using certain square-root representations that transform invariant elastic metrics into euclidean metrics, allowing for the application of standard algorithms and statistical tools. For analyzing shapes of embeddings of in , Jermyn et al. [1] introduced square-root normal fields (SRNFs), which transform an elastic metric, with desirable invariant properties, into the metric. These SRNFs are essentially surface normals scaled by square-roots of infinitesimal area elements. A critical need in shape analysis is a method for inverting solutions (deformations, averages, modes of variations, etc.) computed in SRNF space, back to the original surface space for visualizations and inferences. Due to the lack of theory for understanding SRNF maps and their inverses, we take a numerical approach, and derive an efficient multiresolution algorithm, based on solving an optimization problem in the surface space, that estimates surfaces corresponding to given SRNFs. This solution is found to be effective even for complex shapes that undergo significant deformations including bending and stretching, e.g., human bodies and animals. We use this inversion for computing elastic shape deformations, transferring deformations, summarizing shapes, and for finding modes of variability in a given collection, while simultaneously registering the surfaces. We demonstrate the proposed algorithms using a statistical analysis of human body shapes, classification of generic surfaces, and analysis of brain structures.
Collapse
|
15
|
Dora L, Agrawal S, Panda R, Abraham A. State-of-the-Art Methods for Brain Tissue Segmentation: A Review. IEEE Rev Biomed Eng 2017. [PMID: 28622675 DOI: 10.1109/rbme.2017.2715350] [Citation(s) in RCA: 37] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Brain tissue segmentation is one of the most sought after research areas in medical image processing. It provides detailed quantitative brain analysis for accurate disease diagnosis, detection, and classification of abnormalities. It plays an essential role in discriminating healthy tissues from lesion tissues. Therefore, accurate disease diagnosis and treatment planning depend merely on the performance of the segmentation method used. In this review, we have studied the recent advances in brain tissue segmentation methods and their state-of-the-art in neuroscience research. The review also highlights the major challenges faced during tissue segmentation of the brain. An effective comparison is made among state-of-the-art brain tissue segmentation methods. Moreover, a study of some of the validation measures to evaluate different segmentation methods is also discussed. The brain tissue segmentation, content in terms of methodologies, and experiments presented in this review are encouraging enough to attract researchers working in this field.
Collapse
|
16
|
Ghayoor A, Vaidya JG, Johnson HJ. Robust automated constellation-based landmark detection in human brain imaging. Neuroimage 2017; 170:471-481. [PMID: 28392490 DOI: 10.1016/j.neuroimage.2017.04.012] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2016] [Revised: 02/04/2017] [Accepted: 04/05/2017] [Indexed: 10/19/2022] Open
Abstract
A robust fully automated algorithm for identifying an arbitrary number of landmark points in the human brain is described and validated. The proposed method combines statistical shape models with trained brain morphometric measures to estimate midbrain landmark positions reliably and accurately. Gross morphometric constraints provided by automatically identified eye centers and the center of the head mass are shown to provide robust initialization in the presence of large rotations in the initial head orientation. Detection of primary midbrain landmarks are used as the foundation from which extended detection of an arbitrary set of secondary landmarks in different brain regions by applying a linear model estimation and principle component analysis. This estimation model sequentially uses the knowledge of each additional detected landmark as an improved foundation for improved prediction of the next landmark location. The accuracy and robustness of the presented method was evaluated by comparing the automatically generated results to two manual raters on 30 identified landmark points extracted from each of 30 T1-weighted magnetic resonance images. For the landmarks with unambiguous anatomical definitions, the average discrepancy between the algorithm results and each human observer differed by less than 1 mm from the average inter-observer variability when the algorithm was evaluated on imaging data collected from the same site as the model building data. Similar results were obtained when the same model was applied to a set of heterogeneous image volumes from seven different collection sites representing 3 scanner manufacturers. This method is reliable for general application in large-scale multi-site studies that consist of a variety of imaging data with different orientations, spacings, origins, and field strengths.
Collapse
Affiliation(s)
- Ali Ghayoor
- Department of Electrical and Computer Engineering, 1402 Seamans Center for the Engineering Arts and Science, The University of Iowa, Iowa City, IA 52240, USA; Department of Psychiatry, University of Iowa Hospitals & Clinics, Iowa City, IA 52242, USA
| | - Jatin G Vaidya
- Department of Psychiatry, University of Iowa Hospitals & Clinics, Iowa City, IA 52242, USA
| | - Hans J Johnson
- Department of Electrical and Computer Engineering, 1402 Seamans Center for the Engineering Arts and Science, The University of Iowa, Iowa City, IA 52240, USA; Department of Psychiatry, University of Iowa Hospitals & Clinics, Iowa City, IA 52242, USA.
| |
Collapse
|
17
|
Melinska AU, Romaszkiewicz P, Wagel J, Antosik B, Sasiadek M, Iskander DR. Statistical shape models of cuboid, navicular and talus bones. J Foot Ankle Res 2017; 10:6. [PMID: 28163787 PMCID: PMC5282805 DOI: 10.1186/s13047-016-0178-x] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/11/2016] [Accepted: 11/25/2016] [Indexed: 11/30/2022] Open
Abstract
BACKGROUND The aim was to develop statistical shape models of the main human tarsal bones that would result in novel representations of cuboid, navicular and talus. METHODS Fifteen right and 15 left retrospectively collected computed tomography data sets from male individuals, aged from 17 to 63 years, with no known foot pathology were collected. Data were gathered from 30 different subjects. A process of model building includes image segmentation, unifying feature position, mathematical shape description and obtaining statistical shape geometry. RESULTS Orthogonal decomposition of bone shapes utilising spherical harmonics was employed providing means for unique parametric representation of each bone. Cross-validated classification results based on parametric spherical harmonics representation showed high sensitivity and high specificity greater than 0.98 for all considered bones. CONCLUSIONS The statistical shape models of cuboid, navicular and talus created in this work correspond to anatomically accurate atlases that have not been previously considered. The study indicates high clinical potential of statistical shape modelling in the characterisation of tarsal bones. Those novel models can be applied in medical image analysis, orthopaedics and biomechanics in order to provide support for preoperative planning, better diagnosis or implant design.
Collapse
Affiliation(s)
- Aleksandra U. Melinska
- Department of Biomedical Engineering, Wroclaw University of Science and Technology, 50370, Wybrzeze Wyspianskiego, Wroclaw, Poland
| | - Patryk Romaszkiewicz
- Regional Specialist Hospital, Research and Development Centre, Chair of Orthopaedics, Kamienskiego, Wroclaw, 24105 Poland
| | - Justyna Wagel
- Department of General Radiology, Interventional Radiology and Neuroradiology, Chair of Radiology, Wroclaw Medical University, Borowska, Wroclaw, 24105 Poland
| | - Bartlomiej Antosik
- Department of Biomedical Engineering, Wroclaw University of Science and Technology, 50370, Wybrzeze Wyspianskiego, Wroclaw, Poland
| | - Marek Sasiadek
- Department of General Radiology, Interventional Radiology and Neuroradiology, Chair of Radiology, Wroclaw Medical University, Borowska, Wroclaw, 24105 Poland
| | - D. Robert Iskander
- Department of Biomedical Engineering, Wroclaw University of Science and Technology, 50370, Wybrzeze Wyspianskiego, Wroclaw, Poland
| |
Collapse
|
18
|
Characterization of myocardial motion patterns by unsupervised multiple kernel learning. Med Image Anal 2017; 35:70-82. [DOI: 10.1016/j.media.2016.06.007] [Citation(s) in RCA: 39] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2016] [Revised: 06/03/2016] [Accepted: 06/09/2016] [Indexed: 11/18/2022]
|
19
|
Chandra SS, Dowling JA, Greer PB, Martin J, Wratten C, Pichler P, Fripp J, Crozier S. Fast automated segmentation of multiple objects via spatially weighted shape learning. Phys Med Biol 2016; 61:8070-8084. [PMID: 27779139 DOI: 10.1088/0031-9155/61/22/8070] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
Abstract
Active shape models (ASMs) have proved successful in automatic segmentation by using shape and appearance priors in a number of areas such as prostate segmentation, where accurate contouring is important in treatment planning for prostate cancer. The ASM approach however, is heavily reliant on a good initialisation for achieving high segmentation quality. This initialisation often requires algorithms with high computational complexity, such as three dimensional (3D) image registration. In this work, we present a fast, self-initialised ASM approach that simultaneously fits multiple objects hierarchically controlled by spatially weighted shape learning. Prominent objects are targeted initially and spatial weights are progressively adjusted so that the next (more difficult, less visible) object is simultaneously initialised using a series of weighted shape models. The scheme was validated and compared to a multi-atlas approach on 3D magnetic resonance (MR) images of 38 cancer patients and had the same (mean, median, inter-rater) Dice's similarity coefficients of (0.79, 0.81, 0.85), while having no registration error and a computational time of 12-15 min, nearly an order of magnitude faster than the multi-atlas approach.
Collapse
Affiliation(s)
- Shekhar S Chandra
- School of Information Technology and Electrical Engineering, The University of Queensland, Australia
| | | | | | | | | | | | | | | |
Collapse
|
20
|
Tu L, Vicory J, Elhabian S, Paniagua B, Prieto JC, Damon JN, Whitaker R, Styner M, Pizer SM. Entropy-based Correspondence Improvement of Interpolated Skeletal Models. COMPUTER VISION AND IMAGE UNDERSTANDING : CVIU 2016; 151:72-79. [PMID: 31983868 PMCID: PMC6980525 DOI: 10.1016/j.cviu.2015.11.002] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Statistical analysis of shape representations relies on having good correspondence across a population. Improving correspondence yields improved statistics. Point distribution models (PDMs) are often used to represent object boundaries. Skeletal representations (s-reps) model object widths and boundary directions as well as boundary positions, so they should yield better correspondence. We present two methods: one for continuously interpolating a discretely-sampled skeletal model and one for improving correspondence by using this interpolation to shift skeletal samples to new positions. The interpolation operates by an extension of the mathematics of medial structures. As with Cates' boundary-based method, we evaluate correspondence in terms of regularity and shape-feature population entropies. Evaluation on both synthetic and real data shows that our method both improves correspondence of s-rep models fit to segmented lateral ventricles and that the combined boundary-and-skeletal PDMs implied by these optimized s-reps have better correspondence than optimized boundary PDMs.
Collapse
Affiliation(s)
- Liyun Tu
- Chongqing University, Shapingba, China
- University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Jared Vicory
- University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | | | - Beatriz Paniagua
- University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | | | - James N. Damon
- University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | | | - Martin Styner
- University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Stephen M. Pizer
- University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| |
Collapse
|
21
|
Duchateau N, De Craene M, Allain P, Saloux E, Sermesant M. Infarct Localization From Myocardial Deformation: Prediction and Uncertainty Quantification by Regression From a Low-Dimensional Space. IEEE TRANSACTIONS ON MEDICAL IMAGING 2016; 35:2340-2352. [PMID: 27164583 DOI: 10.1109/tmi.2016.2562181] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Diagnosing and localizing myocardial infarct is crucial for early patient management and therapy planning. We propose a new method for predicting the location of myocardial infarct from local wall deformation, which has value for risk stratification from routine examinations such as (3D) echocardiography. The pipeline combines non-linear dimensionality reduction of deformation patterns and two multi-scale kernel regressions. Confidence in the diagnosis is assessed by a map of local uncertainties, which integrates plausible infarct locations generated from the space of reduced dimensionality. These concepts were tested on 500 synthetic cases generated from a realistic cardiac electromechanical model, and 108 pairs of 3D echocardiographic sequences and delayed-enhancement magnetic resonance images from real cases. Infarct prediction is made at a spatial resolution around 4 mm, more than 10 times smaller than the current diagnosis, made regionally. Our method is accurate, and significantly outperforms the clinically-used thresholding of the deformation patterns (on real data: sensitivity/specificity of 0.828/0.804, area under the curve: 0.909 versus 0.742 for the most predictive strain component). Uncertainty adds value to refine the diagnosis and eventually re-examine suspicious cases.
Collapse
|
22
|
A Bayesian framework for joint morphometry of surface and curve meshes in multi-object complexes. Med Image Anal 2016; 35:458-474. [PMID: 27607468 DOI: 10.1016/j.media.2016.08.011] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2015] [Revised: 08/25/2016] [Accepted: 08/26/2016] [Indexed: 11/22/2022]
Abstract
We present a Bayesian framework for atlas construction of multi-object shape complexes comprised of both surface and curve meshes. It is general and can be applied to any parametric deformation framework and to all shape models with which it is possible to define probability density functions (PDF). Here, both curve and surface meshes are modelled as Gaussian random varifolds, using a finite-dimensional approximation space on which PDFs can be defined. Using this framework, we can automatically estimate the parameters balancing data-terms and deformation regularity, which previously required user tuning. Moreover, it is also possible to estimate a well-conditioned covariance matrix of the deformation parameters. We also extend the proposed framework to data-sets with multiple group labels. Groups share the same template and their deformation parameters are modelled with different distributions. We can statistically compare the groups'distributions since they are defined on the same space. We test our algorithm on 20 Gilles de la Tourette patients and 20 control subjects, using three sub-cortical regions and their incident white matter fiber bundles. We compare their morphological characteristics and variations using a single diffeomorphism in the ambient space. The proposed method will be integrated with the Deformetrica software package, publicly available at www.deformetrica.org.
Collapse
|
23
|
Li A, Li C, Wang X, Eberl S, Feng D, Fulham M. A combinatorial Bayesian and Dirichlet model for prostate MR image segmentation using probabilistic image features. Phys Med Biol 2016; 61:6085-104. [PMID: 27461085 DOI: 10.1088/0031-9155/61/16/6085] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Blurred boundaries and heterogeneous intensities make accurate prostate MR image segmentation problematic. To improve prostate MR image segmentation we suggest an approach that includes: (a) an image patch division method to partition the prostate into homogeneous segments for feature extraction; (b) an image feature formulation and classification method, using the relevance vector machine, to provide probabilistic prior knowledge for graph energy construction; (c) a graph energy formulation scheme with Bayesian priors and Dirichlet graph energy and (d) a non-iterative graph energy minimization scheme, based on matrix differentiation, to perform the probabilistic pixel membership optimization. The segmentation output was obtained by assigning pixels with foreground and background labels based on derived membership probabilities. We evaluated our approach on the PROMISE-12 dataset with 50 prostate MR image volumes. Our approach achieved a mean dice similarity coefficient (DSC) of 0.90 ± 0.02, which surpassed the five best prior-based methods in the PROMISE-12 segmentation challenge.
Collapse
Affiliation(s)
- Ang Li
- Biomedical and Multimedia Information Technology Research Group, School of Information Technologies, The University of Sydney, Sydney, Australia
| | | | | | | | | | | |
Collapse
|
24
|
|
25
|
Analysis of pediatric airway morphology using statistical shape modeling. Med Biol Eng Comput 2015; 54:899-911. [DOI: 10.1007/s11517-015-1445-x] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2014] [Accepted: 12/16/2015] [Indexed: 11/25/2022]
|
26
|
Tu L, Yang D, Vicory J, Zhang X, Pizer SM, Styner M. Fitting Skeletal Object Models Using Spherical Harmonics Based Template Warping. IEEE SIGNAL PROCESSING LETTERS 2015; 22:2269-2273. [PMID: 31402834 PMCID: PMC6688764 DOI: 10.1109/lsp.2015.2476366] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
We present a scheme that propagates a reference skeletal model (s-rep) into a particular case of an object, thereby propagating the initial shape-related layout of the skeleton-to-boundary vectors, called spokes. The scheme represents the surfaces of the template as well as the target objects by spherical harmonics and computes a warp between these via a thin plate spline. To form the propagated s-rep, it applies the warp to the spokes of the template s-rep and then statistically refines. This automatic approach promises to make s-rep fitting robust for complicated objects, which allows s-rep based statistics to be available to all. The improvement in fitting and statistics is significant compared with the previous methods and in statistics compared with a state-of-the-art boundary based method.
Collapse
Affiliation(s)
- Liyun Tu
- College of Computer Science, Chongqing University, Chongqing 400044 China, and also with the Department of Computer Science, University of North Carolina at Chapel Hill, NC 27599 USA
| | - Dan Yang
- College of Computer Science, Chongqing University, Chongqing 400044 China
| | - Jared Vicory
- Department of Computer Science, University of North Carolina, Chapel Hill, NC 27599 USA
| | - Xiaohong Zhang
- School of Software Engineering, Chongqing University, Chongqing 400044 China, and also with the Key Laboratory of Dependable Service Computing in Cyber Physical Society Ministry of Education, Chongqing 400044 China
| | - Stephen M Pizer
- Department of Computer Science, University of North Carolina, Chapel Hill, NC 27599 USA
| | - Martin Styner
- Department of Computer Science and the Department of Psychiatry, University of North Carolina, Chapel Hill, NC 27599 USA
| |
Collapse
|
27
|
Gooya A, Lekadir K, Alba X, Swift AJ, Wild JM, Frangi AF. Joint Clustering and Component Analysis of Correspondenceless Point Sets: Application to Cardiac Statistical Modeling. INFORMATION PROCESSING IN MEDICAL IMAGING : PROCEEDINGS OF THE ... CONFERENCE 2015. [PMID: 26221669 DOI: 10.1007/978-3-319-19992-4_8] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Construction of Statistical Shape Models (SSMs) from arbitrary point sets is a challenging problem due to significant shape variation and lack of explicit point correspondence across the training data set. In medical imaging, point sets can generally represent different shape classes that span healthy and pathological exemplars. In such cases, the constructed SSM may not generalize well, largely because the probability density function (pdf) of the point sets deviates from the underlying assumption of Gaussian statistics. To this end, we propose a generative model for unsupervised learning of the pdf of point sets as a mixture of distinctive classes. A Variational Bayesian (VB) method is proposed for making joint inferences on the labels of point sets, and the principal modes of variations in each cluster. The method provides a flexible framework to handle point sets with no explicit point-to-point correspondences. We also show that by maximizing the marginalized likelihood of the model, the optimal number of clusters of point sets can be determined. We illustrate this work in the context of understanding the anatomical phenotype of the left and right ventricles in heart. To this end, we use a database containing hearts of healthy subjects, patients with Pulmonary Hypertension (PH), and patients with Hypertrophic Cardiomyopathy (HCM). We demonstrate that our method can outperform traditional PCA in both generalization and specificity measures.
Collapse
|
28
|
Lyu I, Kim SH, Seong JK, Yoo SW, Evans A, Shi Y, Sanchez M, Niethammer M, Styner MA. Robust estimation of group-wise cortical correspondence with an application to macaque and human neuroimaging studies. Front Neurosci 2015; 9:210. [PMID: 26113807 PMCID: PMC4462677 DOI: 10.3389/fnins.2015.00210] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2015] [Accepted: 05/26/2015] [Indexed: 11/25/2022] Open
Abstract
We present a novel group-wise registration method for cortical correspondence for local cortical thickness analysis in human and non-human primate neuroimaging studies. The proposed method is based on our earlier template based registration that estimates a continuous, smooth deformation field via sulcal curve-constrained registration employing spherical harmonic decomposition of the deformation field. This pairwise registration though results in a well-known template selection bias, which we aim to overcome here via a group-wise approach. We propose the use of an unbiased ensemble entropy minimization following the use of the pairwise registration as an initialization. An individual deformation field is then iteratively updated onto the unbiased average. For the optimization, we use metrics specific for cortical correspondence though all of these are straightforwardly extendable to the generic setting: The first focused on optimizing the correspondence of automatically extracted sulcal landmarks and the second on that of sulcal depth property maps. We further propose a robust entropy metric and a hierarchical optimization by employing spherical harmonic basis orthogonality. We also provide the detailed methodological description of both our earlier work and the proposed method with a set of experiments on a population of human and non-human primate subjects. In the experiment, we have shown that our method achieves superior results on consistency through quantitative and visual comparisons as compared to the existing methods.
Collapse
Affiliation(s)
- Ilwoo Lyu
- Department of Computer Science, University of North CarolinaChapel Hill, NC, USA
| | - Sun H. Kim
- Department of Psychiatry, University of North CarolinaChapel Hill, NC, USA
| | - Joon-Kyung Seong
- Department of Biomedical Engineering, Korea UniversitySeoul, South Korea
| | - Sang W. Yoo
- R&D Team, Health and Medical Equipment Business, Samsung ElectronicsSuwon, South Korea
| | - Alan Evans
- Montreal Neurological Institute, McGill UniversityMontreal, QC, Canada
| | - Yundi Shi
- Department of Psychiatry, University of North CarolinaChapel Hill, NC, USA
| | - Mar Sanchez
- Department of Psychiatry and Behavioral Sciences, Emory University School of Medicine, Emory universityAtlanta, GA, USA
| | - Marc Niethammer
- Department of Computer Science, University of North CarolinaChapel Hill, NC, USA
- Biomedical Research Imaging Center, University of North CarolinaChapel Hill, NC, USA
| | - Martin A. Styner
- Department of Computer Science, University of North CarolinaChapel Hill, NC, USA
- Department of Psychiatry, University of North CarolinaChapel Hill, NC, USA
| |
Collapse
|
29
|
Mutsvangwa T, Burdin V, Schwartz C, Roux C. An Automated Statistical Shape Model Developmental Pipeline: Application to the Human Scapula and Humerus. IEEE Trans Biomed Eng 2015; 62:1098-107. [DOI: 10.1109/tbme.2014.2368362] [Citation(s) in RCA: 36] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
30
|
Li C, Wang X, Eberl S, Fulham M, Yin Y, Dagan Feng D. Supervised Variational Model With Statistical Inference and Its Application in Medical Image Segmentation. IEEE Trans Biomed Eng 2015; 62:196-207. [DOI: 10.1109/tbme.2014.2344660] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
31
|
Joint Morphometry of Fiber Tracts and Gray Matter Structures Using Double Diffeomorphisms. INFORMATION PROCESSING IN MEDICAL IMAGING : PROCEEDINGS OF THE ... CONFERENCE 2015. [PMID: 26221680 DOI: 10.1007/978-3-319-19992-4_21] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/21/2023]
Abstract
This work proposes an atlas construction method to jointly analyse the relative position and shape of fiber tracts and gray matter structures. It is based on a double diffeomorphism which is a composition of two diffeomorphisms. The first diffeomorphism acts only on the white matter keeping fixed the gray matter of the atlas. The resulting white matter, together with the gray matter, are then deformed by the second diffeomorphism. The two diffeomorphisms are related and jointly optimised. In this way, the, first diffeomorphisms explain the variability in structural connectivity within the population, namely both changes in the connected areas of the gray matter and in the geometry of the pathway of the tracts. The second diffeomorphisms put into correspondence the homologous anatomical structures across subjects. Fiber bundles are approximated with weighted prototypes using the metric of weighted currents. The atlas, the covariance matrix of deformation parameters and the noise variance of each structure are automatically estimated using a Bayesian approach. This method is applied to patients with Tourette syndrome and controls showing a variability in the structural connectivity of the left cortico-putamen circuit.
Collapse
|
32
|
Lu YC, Untaroiu CD. A statistical geometrical description of the human liver for probabilistic occupant models. J Biomech 2014; 47:3681-8. [PMID: 25315219 DOI: 10.1016/j.jbiomech.2014.09.031] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2014] [Revised: 09/20/2014] [Accepted: 09/25/2014] [Indexed: 01/28/2023]
Abstract
Realistic numerical assessments of liver injury risk for the entire occupant population require incorporating inter-subject variations into numerical models. Statistical shape models of the abdominal organs have been shown to be useful tools for the investigation of the organ variations and could be applied to the development of statistical computational models. The main objective of this study was to establish a standard procedure to quantify the shape variations of a human liver in a seated posture, and construct three-dimensional (3D) statistical shape boundary models. Statistical shape analysis was applied to construct shape models of 15 adult human livers. Principal component analysis (PCA) was then utilized to obtain the modes of variation, the mean model, and a set of statistical boundary shape models, which were constructed using the q-hyper-ellipsoid approach. The first five modes of a human liver accounted for the major anatomical variations. The modes were highly correlated to the height, thickness, width, and curvature of the liver, and the concavity of the right lobe. The mean model and the principal components were utilized to construct four boundary models of human liver. The statistical boundary model approach presented in this study could be used to develop probabilistic finite element (FE) models. In the future, the probabilistic liver models could be used in FE simulations to better understand the variability in biomechanical responses and abdominal injuries under impact loading.
Collapse
Affiliation(s)
- Yuan-Chiao Lu
- Department of Biomedical Engineering and Mechanics, Virginia Tech, Blacksburg, VA 24060, USA
| | - Costin D Untaroiu
- Department of Biomedical Engineering and Mechanics, Virginia Tech, Blacksburg, VA 24060, USA.
| |
Collapse
|
33
|
Pereañez M, Lekadir K, Butakoff C, Hoogendoorn C, Frangi AF. A framework for the merging of pre-existing and correspondenceless 3D statistical shape models. Med Image Anal 2014; 18:1044-58. [DOI: 10.1016/j.media.2014.05.009] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2013] [Revised: 05/15/2014] [Accepted: 05/24/2014] [Indexed: 10/25/2022]
|
34
|
Shi Y, Lai R, Wang DJ, Pelletier D, Mohr D, Sicotte N, Toga AW. Metric optimization for surface analysis in the Laplace-Beltrami embedding space. IEEE TRANSACTIONS ON MEDICAL IMAGING 2014; 33:1447-63. [PMID: 24686245 PMCID: PMC4079755 DOI: 10.1109/tmi.2014.2313812] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/05/2023]
Abstract
In this paper, we present a novel approach for the intrinsic mapping of anatomical surfaces and its application in brain mapping research. Using the Laplace-Beltrami eigen-system, we represent each surface with an isometry invariant embedding in a high dimensional space. The key idea in our system is that we realize surface deformation in the embedding space via the iterative optimization of a conformal metric without explicitly perturbing the surface or its embedding. By minimizing a distance measure in the embedding space with metric optimization, our method generates a conformal map directly between surfaces with highly uniform metric distortion and the ability of aligning salient geometric features. Besides pairwise surface maps, we also extend the metric optimization approach for group-wise atlas construction and multi-atlas cortical label fusion. In experimental results, we demonstrate the robustness and generality of our method by applying it to map both cortical and hippocampal surfaces in population studies. For cortical labeling, our method achieves excellent performance in a cross-validation experiment with 40 manually labeled surfaces, and successfully models localized brain development in a pediatric study of 80 subjects. For hippocampal mapping, our method produces much more significant results than two popular tools on a multiple sclerosis study of 109 subjects.
Collapse
Affiliation(s)
- Yonggang Shi
- Laboratory of Neuro Imaging, Institute for Neuroimaging and Informatics, Keck School of Medicine of University of Southern California, Los Angeles, CA 90033, USA ()
| | - Rongjie Lai
- Department of Mathematics, University of California at Irvine, Irvine, CA 92697, USA ()
| | - Danny J.J. Wang
- Ahmanson-Lovelace Brain Mapping Center, Department of Neurology, UCLA School of Medicine, Los Angeles, CA 90095, USA ()
| | - Daniel Pelletier
- Department of Neurology, Yale School of Medicine, New Haven, CT, USA ()
| | - David Mohr
- Department of Preventive Medicine, Northwestern University, Feinberg School of Medicine, Chicago, IL, USA ()
| | | | - Arthur W. Toga
- Laboratory of Neuro Imaging, Institute for Neuroimaging and Informatics, Keck School of Medicine of University of Southern California, Los Angeles, CA 90033, USA ()
| |
Collapse
|
35
|
Ye DH, Desjardins B, Hamm J, Litt H, Pohl KM. Regional manifold learning for disease classification. IEEE TRANSACTIONS ON MEDICAL IMAGING 2014; 33:1236-1247. [PMID: 24893254 PMCID: PMC5450500 DOI: 10.1109/tmi.2014.2305751] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
While manifold learning from images itself has become widely used in medical image analysis, the accuracy of existing implementations suffers from viewing each image as a single data point. To address this issue, we parcellate images into regions and then separately learn the manifold for each region. We use the regional manifolds as low-dimensional descriptors of high-dimensional morphological image features, which are then fed into a classifier to identify regions affected by disease. We produce a single ensemble decision for each scan by the weighted combination of these regional classification results. Each weight is determined by the regional accuracy of detecting the disease. When applied to cardiac magnetic resonance imaging of 50 normal controls and 50 patients with reconstructive surgery of Tetralogy of Fallot, our method achieves significantly better classification accuracy than approaches learning a single manifold across the entire image domain.
Collapse
Affiliation(s)
| | - Benoit Desjardins
- Department of Radiology, University of Pennsylvania, Philadelphia,
PA 19104 USA
| | - Jihun Hamm
- Department of Computer Science and Engineering, Ohio State
University, Columbus, OH 43210 USA
| | - Harold Litt
- Department of Radiology, University of Pennsylvania, Philadelphia,
PA 19104 USA
| | - Kilian M. Pohl
- Center for Health Sciences, SRI International, Menlo Park, CA 94025
USA, and also with the Department of Psychiatry and Behavioral Sciences,
Stanford University, Stanford, CA 94304 USA
| |
Collapse
|
36
|
Group-wise cortical correspondence via sulcal curve-constrained entropy minimization. ACTA ACUST UNITED AC 2014; 23:364-75. [PMID: 24683983 DOI: 10.1007/978-3-642-38868-2_31] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/09/2023]
Abstract
We present a novel cortical correspondence method employing group-wise registration in a spherical parametrization space for the use in local cortical thickness analysis in human and non-human primate neuroimaging studies. The proposed method is unbiased registration that estimates a continuous smooth deformation field into an unbiased average space via sulcal curve-constrained entropy minimization using spherical harmonic decomposition of the spherical deformation field. We initialize a correspondence by our pair-wise method that establishes a surface correspondence with a prior template. Since this pair-wise correspondence is biased to the choice of a template, we further improve the correspondence by employing unbiased ensemble entropy minimization across all surfaces, which yields a deformation field onto the iteratively updated unbiased average. The specific entropy metric incorporates two terms: the first focused on optimizing the correspondence of automatically extracted sulcal landmarks and the second on that of sulcal depth maps. We also propose an encoding scheme for spherical deformation via spherical harmonics as well as a novel method to choose an optimal spherical polar coordinate system for the most efficient deformation field estimation. The experimental results show evidence that the proposed method improves the correspondence quality in non-human primate and human subjects as compared to the pair-wise method.
Collapse
|
37
|
Chandra SS, Xia Y, Engstrom C, Crozier S, Schwarz R, Fripp J. Focused shape models for hip joint segmentation in 3D magnetic resonance images. Med Image Anal 2014; 18:567-78. [DOI: 10.1016/j.media.2014.02.002] [Citation(s) in RCA: 36] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2013] [Revised: 01/29/2014] [Accepted: 02/05/2014] [Indexed: 01/18/2023]
|
38
|
Graham J, Hutchinson C, Muir L. Automatic generation of statistical pose and shape models for articulated joints. IEEE TRANSACTIONS ON MEDICAL IMAGING 2014; 33:372-383. [PMID: 24132008 DOI: 10.1109/tmi.2013.2285503] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
Abstract
Statistical analysis of motion patterns of body joints is potentially useful for detecting and quantifying pathologies. However, building a statistical motion model across different subjects remains a challenging task, especially for a complex joint like the wrist. We present a novel framework for simultaneous registration and segmentation of multiple 3-D (CT or MR) volumes of different subjects at various articulated positions. The framework starts with a pose model generated from 3-D volumes captured at different articulated positions of a single subject (template). This initial pose model is used to register the template volume to image volumes from new subjects. During this process, the Grow-Cut algorithm is used in an iterative refinement of the segmentation of the bone along with the pose parameters. As each new subject is registered and segmented, the pose model is updated, improving the accuracy of successive registrations. We applied the algorithm to CT images of the wrist from 25 subjects, each at five different wrist positions and demonstrated that it performed robustly and accurately. More importantly, the resulting segmentations allowed a statistical pose model of the carpal bones to be generated automatically without interaction. The evaluation results show that our proposed framework achieved accurate registration with an average mean target registration error of 0.34 ±0.27 mm. The automatic segmentation results also show high consistency with the ground truth obtained semi-automatically. Furthermore, we demonstrated the capability of the resulting statistical pose and shape models by using them to generate a measurement tool for scaphoid-lunate dissociation diagnosis, which achieved 90% sensitivity and specificity.
Collapse
|
39
|
Lu YC, Kemper AR, Gayzik S, Untaroiu CD, Beillas P. Statistical modeling of human liver incorporating the variations in shape, size, and material properties. STAPP CAR CRASH JOURNAL 2013; 57:285-311. [PMID: 24435736 DOI: 10.4271/2013-22-0012] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
The liver is one of the most frequently injured abdominal organs during motor vehicle crashes. Realistic numerical assessments of liver injury risk for the entire occupant population require incorporating inter-subject variations into numerical models. The main objective of this study was to quantify the shape variations of human liver in a seated posture and the statistical distributions of its material properties. Statistical shape analysis was applied to construct shape models of the livers of 15 adult human subjects, recorded in a typical seated (occupant) posture. The principal component analysis was then utilized to obtain the modes of variation, the mean model, and 95% statistical boundary shape models. In addition, a total of 52 tensile tests were performed on the parenchyma of three fresh human livers at four loading rates (0.01, 0.1, 1, and 10 s^-1) to characterize the rate-dependent and failure properties of the human liver. A FE-based optimization approach was employed to identify the material parameters of an Ogden material model for each specimen. The mean material parameters were then determined for each loading rate from the characteristic averages of the stress-strain curves, and a stochastic optimization approach was utilized to determine the standard deviations of the material parameters. Results showed that the first five modes of the human liver shape models account for more than 60% of the overall anatomical variations. The distributions of the material parameters combined with the mean and statistical boundary shape models could be used to develop probabilistic finite element (FE) models, which may help to better understand the variability in biomechanical responses and injuries to the abdominal organs under impact loading.
Collapse
Affiliation(s)
- Yuan-Chiao Lu
- Virginia Tech-Wake Forest University, Center for Injury Biomechanics
| | - Andrew R Kemper
- Virginia Tech-Wake Forest University, Center for Injury Biomechanics
| | - Scott Gayzik
- Virginia Tech-Wake Forest University, Center for Injury Biomechanics
| | - Costin D Untaroiu
- Virginia Tech-Wake Forest University, Center for Injury Biomechanics
| | | |
Collapse
|
40
|
Particle system based adaptive sampling on spherical parameter space to improve the MDL method for construction of statistical shape models. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2013; 2013:196259. [PMID: 23861721 PMCID: PMC3687723 DOI: 10.1155/2013/196259] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/16/2013] [Revised: 05/01/2013] [Accepted: 05/20/2013] [Indexed: 11/18/2022]
Abstract
Minimum description length (MDL) based group-wise registration was a state-of-the-art method to determine the corresponding points of 3D shapes for the construction of statistical shape models (SSMs). However, it suffered from the problem that determined corresponding points did not uniformly spread on original shapes, since corresponding points were obtained by uniformly sampling the aligned shape on the parameterized space of unit sphere. We proposed a particle-system based method to obtain adaptive sampling positions on the unit sphere to resolve this problem. Here, a set of particles was placed on the unit sphere to construct a particle system whose energy was related to the distortions of parameterized meshes. By minimizing this energy, each particle was moved on the unit sphere. When the system became steady, particles were treated as vertices to build a spherical mesh, which was then relaxed to slightly adjust vertices to obtain optimal sampling-positions. We used 47 cases of (left and right) lungs and 50 cases of livers, (left and right) kidneys, and spleens for evaluations. Experiments showed that the proposed method was able to resolve the problem of the original MDL method, and the proposed method performed better in the generalization and specificity tests.
Collapse
|
41
|
Wu J, Wang Y, Simon MA, Sacks MS, Brigham JC. A new computational framework for anatomically consistent 3D statistical shape analysis with clinical imaging applications. COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING: IMAGING & VISUALIZATION 2013. [DOI: 10.1080/21681163.2013.764610] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
|
42
|
Li G, Kim H, Tan JK, Ishikawa S. A Parameterization Based Correspondence Method for PDM Building. JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS 2013. [DOI: 10.20965/jaciii.2013.p0018] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Place-march of corresponding landmarks is one of the major factors influencing 3D Points Distribution Model (PDM) quality. In this study, we propose a semi-automatic correspondence method based on surface parameterization theory. All the training sets are mapped into a spherical domain previously. The rotation transformation of training samples is regarded as spherical rotation of their maps. We solve it by comparing the density distribution of surface map of training sample with respect to the reference model. Simultaneously, the corresponding landmarks across the whole training set are marketed depending on the spherical coordinates on parameter domain. In this paper, we also compared the corresponding results with two constraint conditions of spherical conformal mapping: 3 datum points constrain and zero-mass constrain. Experimental results are given for left lung training sets of 3D shapes. The mean result with the 3 datum points constraint and the zero mass-center constraint was 21.65 mm and 20.19 mm respectively.
Collapse
|
43
|
Gori P, Colliot O, Worbe Y, Marrakchi-Kacem L, Lecomte S, Poupon C, Hartmann A, Ayache N, Durrleman S. Bayesian atlas estimation for the variability analysis of shape complexes. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2013; 16:267-74. [PMID: 24505675 DOI: 10.1007/978-3-642-40811-3_34] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/21/2023]
Abstract
In this paper we propose a Bayesian framework for multiobject atlas estimation based on the metric of currents which permits to deal with both curves and surfaces without relying on point correspondence. This approach aims to study brain morphometry as a whole and not as a set of different components, focusing mainly on the shape and relative position of different anatomical structures which is fundamental in neuro-anatomical studies. We propose a generic algorithm to estimate templates of sets of curves (fiber bundles) and closed surfaces (sub-cortical structures) which have the same "form" (topology) of the shapes present in the population. This atlas construction method is based on a Bayesian framework which brings to two main improvements with respect to previous shape based methods. First, it allows to estimate from the data set a parameter specific to each object which was previously fixed by the user: the trade-off between data-term and regularity of deformations. In a multi-object analysis these parameters balance the contributions of the different objects and the need for an automatic estimation is even more crucial. Second, the covariance matrix of the deformation parameters is estimated during the atlas construction in a way which is less sensitive to the outliers of the population.
Collapse
Affiliation(s)
- Pietro Gori
- CNRS UMR 7225, Inserm UMR-S975, UPMC, CRICM, Paris, France
| | - Olivier Colliot
- Aramis Project-Team, Inria Paris-Rocquencourt, Paris, France
| | - Yulia Worbe
- CNRS UMR 7225, Inserm UMR-S975, UPMC, CRICM, Paris, France
| | | | - Sophie Lecomte
- Aramis Project-Team, Inria Paris-Rocquencourt, Paris, France
| | | | | | - Nicholas Ayache
- Asclepios Project-Team, Inria Sophia Antipolis, Sophia Antipolis, France
| | | |
Collapse
|
44
|
Li C, Wang X, Li J, Eberl S, Fulham M, Yin Y, Feng DD. Joint probabilistic model of shape and intensity for multiple abdominal organ segmentation from volumetric CT images. IEEE J Biomed Health Inform 2012. [PMID: 23193317 DOI: 10.1109/titb.2012.2227273] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
We propose a novel joint probabilistic model that correlates a new probabilistic shape model with the corresponding global intensity distribution to segment multiple abdominal organs simultaneously. Our probabilistic shape model estimates the probability of an individual voxel belonging to the estimated shape of the object. The probability density of the estimated shape is derived from a combination of the shape variations of target class and the observed shape information. To better capture the shape variations, we used probabilistic principle component analysis optimized by expectation maximization to capture the shape variations and reduce computational complexity. The maximum a posteriori estimation was optimized by the iterated conditional mode-expectation maximization. We used 72 training datasets including low- and high-contrast CT images to construct the shape models for the liver, spleen and both kidneys. We evaluated our algorithm on 40 test datasets that were grouped into normal (34 normal cases) and pathologic (6 datasets) classes. The testing datasets were from different databases and manual segmentation was performed by different clinicians. We measured the volumetric overlap percentage error, relative volume difference, average square symmetric surface distance, false positive rate and false negative rate and our method achieved accurate and robust segmentation for multiple abdominal organs simultaneously.
Collapse
|
45
|
Kurtek S, Klassen E, Gore JC, Ding Z, Srivastava A. Elastic geodesic paths in shape space of parameterized surfaces. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2012; 34:1717-1730. [PMID: 22144521 DOI: 10.1109/tpami.2011.233] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/31/2023]
Abstract
This paper presents a novel Riemannian framework for shape analysis of parameterized surfaces. In particular, it provides efficient algorithms for computing geodesic paths which, in turn, are important for comparing, matching, and deforming surfaces. The novelty of this framework is that geodesics are invariant to the parameterizations of surfaces and other shape-preserving transformations of surfaces. The basic idea is to formulate a space of embedded surfaces (surfaces seen as embeddings of a unit sphere in IR3) and impose a Riemannian metric on it in such a way that the reparameterization group acts on this space by isometries. Under this framework, we solve two optimization problems. One, given any two surfaces at arbitrary rotations and parameterizations, we use a path-straightening approach to find a geodesic path between them under the chosen metric. Second, by modifying a technique presented in [25], we solve for the optimal rotation and parameterization (registration) between surfaces. Their combined solution provides an efficient mechanism for computing geodesic paths in shape spaces of parameterized surfaces. We illustrate these ideas using examples from shape analysis of anatomical structures and other general surfaces.
Collapse
Affiliation(s)
- Sebastian Kurtek
- Department of Statistics, Florida State University, 117 N. Woodward Ave., PO Box 3064330, Tallahassee, FL 32306, USA.
| | | | | | | | | |
Collapse
|
46
|
Constrained manifold learning for the characterization of pathological deviations from normality. Med Image Anal 2012; 16:1532-49. [PMID: 22906821 DOI: 10.1016/j.media.2012.07.003] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2011] [Revised: 05/30/2012] [Accepted: 07/19/2012] [Indexed: 10/28/2022]
Abstract
This paper describes a technique to (1) learn the representation of a pathological motion pattern from a given population, and (2) compare individuals to this population. Our hypothesis is that this pattern can be modeled as a deviation from normal motion by means of non-linear embedding techniques. Each subject is represented by a 2D map of local motion abnormalities, obtained from a statistical atlas of myocardial motion built from a healthy population. The algorithm estimates a manifold from a set of patients with varying degrees of the same disease, and compares individuals to the training population using a mapping to the manifold and a distance to normality along the manifold. The approach extends recent manifold learning techniques by constraining the manifold to pass by a physiologically meaningful origin representing a normal motion pattern. Interpolation techniques using locally adjustable kernel improve the accuracy of the method. The technique is applied in the context of cardiac resynchronization therapy (CRT), focusing on a specific motion pattern of intra-ventricular dyssynchrony called septal flash (SF). We estimate the manifold from 50 CRT candidates with SF and test it on 37 CRT candidates and 21 healthy volunteers. Experiments highlight the relevance of non-linear techniques to model a pathological pattern from the training set and compare new individuals to this pattern.
Collapse
|
47
|
Gollmer ST, Simon M, Bischof A, Barkhausen J, Buzug TM. Multi-object active shape model construction for abdomen segmentation: preliminary results. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2012; 2012:3990-3993. [PMID: 23366802 DOI: 10.1109/embc.2012.6346841] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
The automatic segmentation of abdominal organs is a pre-requisite for many medical applications. Successful methods typically rely on prior knowledge about the to be segmented anatomy as it is for instance provided by means of active shape models (ASMs). Contrary to most previous ASM based methods, this work does not focus on individual organs. Instead, a more holistic approach that aims at exploiting inter-organ relationships to eventually segment a complex of organs is proposed. Accordingly, a flexible framework for automatic construction of multi-object ASMs is introduced, employed for coupled shape modeling, and used for co-segmentation of liver and spleen based on a new coupled shape/separate pose approach. Our first results indicate feasible segmentation accuracies, whereas pose decoupling leads to substantially better segmentation results and performs in average also slightly better than the standard single-object ASM approach.
Collapse
Affiliation(s)
- Sebastian T Gollmer
- Institute of Medical Engineering, University of Lübeck, 23562 Lübeck, Germany.
| | | | | | | | | |
Collapse
|
48
|
Abstract
Statistical atlases of bone anatomy are traditionally constructed with point-based models. These methods establish initial point correspondences across the population of shapes and model variations in the shapes using a variety of statistical tools. A drawbacks of such methods is that initial point correspondences are not updated after their first establishment. This paper proposes an iterative method for refining point correspondences for statistical atlases. The statistical model is used to estimate the direction of "pull" along the surface and consistency checks are used to ensure that illegal shapes are not generated. Our method is much faster that previous methods since it does not rely on computationally expensive deformable registration. It is also generalizable and can be used with any statististical model. We perform experiments on a human pelvis atlas consisting of 110 healthy patients and demonstrate that the method can be used to re-estimate point correspondences which reduce the hausdorff distance from 3.2mm to 2.7mm and the surface error from 1.6mm to 1.4mm for PCA modelling with 20 modes.
Collapse
|
49
|
Abstract
We present a novel framework for inferring 3D carpal bone kinematics and bone shapes from a single view fluoroscopic sequence. A hybrid statistical model representing both the kinematics and shape variation of the carpal bones is built, based on a number of 3D CT data sets obtained from different subjects at different poses. Given a fluoroscopic sequence, the wrist pose, carpal bone kinematics and bone shapes are estimated iteratively by matching the statistical model with the 2D images. A specially designed cost function enables smoothed parameter estimation across frames. We have evaluated the proposed method on both simulated data and real fluoroscopic sequences. It was found that the relative positions between carpal bones can be accurately estimated, which is potentially useful for detection of conditions such as scapholunate dissociation.
Collapse
|
50
|
Iglesias JE, Liu CY, Thompson PM, Tu Z. Robust brain extraction across datasets and comparison with publicly available methods. IEEE TRANSACTIONS ON MEDICAL IMAGING 2011; 30:1617-1634. [PMID: 21880566 DOI: 10.1109/tmi.2011.2138152] [Citation(s) in RCA: 322] [Impact Index Per Article: 23.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/31/2023]
Abstract
Automatic whole-brain extraction from magnetic resonance images (MRI), also known as skull stripping, is a key component in most neuroimage pipelines. As the first element in the chain, its robustness is critical for the overall performance of the system. Many skull stripping methods have been proposed, but the problem is not considered to be completely solved yet. Many systems in the literature have good performance on certain datasets (mostly the datasets they were trained/tuned on), but fail to produce satisfactory results when the acquisition conditions or study populations are different. In this paper we introduce a robust, learning-based brain extraction system (ROBEX). The method combines a discriminative and a generative model to achieve the final result. The discriminative model is a Random Forest classifier trained to detect the brain boundary; the generative model is a point distribution model that ensures that the result is plausible. When a new image is presented to the system, the generative model is explored to find the contour with highest likelihood according to the discriminative model. Because the target shape is in general not perfectly represented by the generative model, the contour is refined using graph cuts to obtain the final segmentation. Both models were trained using 92 scans from a proprietary dataset but they achieve a high degree of robustness on a variety of other datasets. ROBEX was compared with six other popular, publicly available methods (BET, BSE, FreeSurfer, AFNI, BridgeBurner, and GCUT) on three publicly available datasets (IBSR, LPBA40, and OASIS, 137 scans in total) that include a wide range of acquisition hardware and a highly variable population (different age groups, healthy/diseased). The results show that ROBEX provides significantly improved performance measures for almost every method/dataset combination.
Collapse
Affiliation(s)
- Juan Eugenio Iglesias
- Department of Biomedical Engineering, University of California-Los Angeles, Los Angeles, CA 90024, USA.
| | | | | | | |
Collapse
|