1
|
Liu XP, Jin X, Seyed Ahmadian S, Yang X, Tian SF, Cai YX, Chawla K, Snijders AM, Xia Y, van Diest PJ, Weiss WA, Mao JH, Li ZQ, Vogel H, Chang H. Clinical significance and molecular annotation of cellular morphometric subtypes in lower-grade gliomas discovered by machine learning. Neuro Oncol 2023; 25:68-81. [PMID: 35716369 PMCID: PMC9825346 DOI: 10.1093/neuonc/noac154] [Citation(s) in RCA: 22] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2021] [Indexed: 01/12/2023] Open
Abstract
BACKGROUND Lower-grade gliomas (LGG) are heterogeneous diseases by clinical, histological, and molecular criteria. We aimed to personalize the diagnosis and therapy of LGG patients by developing and validating robust cellular morphometric subtypes (CMS) and to uncover the molecular signatures underlying these subtypes. METHODS Cellular morphometric biomarkers (CMBs) were identified with artificial intelligence technique from TCGA-LGG cohort. Consensus clustering was used to define CMS. Survival analysis was performed to assess the clinical impact of CMBs and CMS. A nomogram was constructed to predict 3- and 5-year overall survival (OS) of LGG patients. Tumor mutational burden (TMB) and immune cell infiltration between subtypes were analyzed using the Mann-Whitney U test. The double-blinded validation for important immunotherapy-related biomarkers was executed using immunohistochemistry (IHC). RESULTS We developed a machine learning (ML) pipeline to extract CMBs from whole-slide images of tissue histology; identifying and externally validating robust CMS of LGGs in multicenter cohorts. The subtypes had independent predicted OS across all three independent cohorts. In the TCGA-LGG cohort, patients within the poor-prognosis subtype responded poorly to primary and follow-up therapies. LGGs within the poor-prognosis subtype were characterized by high mutational burden, high frequencies of copy number alterations, and high levels of tumor-infiltrating lymphocytes and immune checkpoint genes. Higher levels of PD-1/PD-L1/CTLA-4 were confirmed by IHC staining. In addition, the subtypes learned from LGG demonstrate translational impact on glioblastoma (GBM). CONCLUSIONS We developed and validated a framework (CMS-ML) for CMS discovery in LGG associated with specific molecular alterations, immune microenvironment, prognosis, and treatment response.
Collapse
Affiliation(s)
- Xiao-Ping Liu
- Biological Systems and Engineering Division, Lawrence Berkeley National Laboratory, Berkeley, California, USA
- Berkeley Biomedical Data Science Center, Lawrence Berkeley National Laboratory, Berkeley, California, USA
| | - Xiaoqing Jin
- Biological Systems and Engineering Division, Lawrence Berkeley National Laboratory, Berkeley, California, USA
- Berkeley Biomedical Data Science Center, Lawrence Berkeley National Laboratory, Berkeley, California, USA
- Department of Emergency, Zhongnan Hospital of Wuhan University, Wuhan, Hubei, China
| | - Saman Seyed Ahmadian
- Department of Pathology, Stanford University Medical Center, Stanford, California, USA
| | - Xu Yang
- Biological Systems and Engineering Division, Lawrence Berkeley National Laboratory, Berkeley, California, USA
- Berkeley Biomedical Data Science Center, Lawrence Berkeley National Laboratory, Berkeley, California, USA
- Key Laboratory of Modern Toxicology of Ministry of Education, School of Public Health, Nanjing Medical University, Nanjing, Jiangsu, China
| | - Su-Fang Tian
- Department of Pathology, Zhongnan Hospital of Wuhan University, Wuhan, Hubei, China
| | - Yu-Xiang Cai
- Department of Pathology, Zhongnan Hospital of Wuhan University, Wuhan, Hubei, China
| | - Kuldeep Chawla
- Berkeley Biomedical Data Science Center, Lawrence Berkeley National Laboratory, Berkeley, California, USA
| | - Antoine M Snijders
- Biological Systems and Engineering Division, Lawrence Berkeley National Laboratory, Berkeley, California, USA
- Berkeley Biomedical Data Science Center, Lawrence Berkeley National Laboratory, Berkeley, California, USA
| | - Yankai Xia
- Key Laboratory of Modern Toxicology of Ministry of Education, School of Public Health, Nanjing Medical University, Nanjing, Jiangsu, China
| | - Paul J van Diest
- Department of Pathology, University Medical Center Utrecht, Utrecht, The Netherlands
| | - William A Weiss
- Departments of Neurology, Neurological Surgery, and Pediatrics, University of California, San Francisco, San Francisco, California, USA
| | - Jian-Hua Mao
- Biological Systems and Engineering Division, Lawrence Berkeley National Laboratory, Berkeley, California, USA
- Berkeley Biomedical Data Science Center, Lawrence Berkeley National Laboratory, Berkeley, California, USA
| | - Zhi-Qiang Li
- Department of Neurosurgery, Zhongnan Hospital of Wuhan University, Wuhan, Hubei, China
| | - Hannes Vogel
- Department of Pathology, Stanford University Medical Center, Stanford, California, USA
| | - Hang Chang
- Biological Systems and Engineering Division, Lawrence Berkeley National Laboratory, Berkeley, California, USA
- Berkeley Biomedical Data Science Center, Lawrence Berkeley National Laboratory, Berkeley, California, USA
| |
Collapse
|
2
|
Zhao L, Xu X, Hou R, Zhao W, Zhong H, Teng H, Han Y, Fu X, Sun J, Zhao J. Lung cancer subtype classification using histopathological images based on weakly supervised multi-instance learning. Phys Med Biol 2021; 66. [PMID: 34794136 DOI: 10.1088/1361-6560/ac3b32] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2021] [Accepted: 11/18/2021] [Indexed: 11/12/2022]
Abstract
Objective.Subtype classification plays a guiding role in the clinical diagnosis and treatment of non-small-cell lung cancer (NSCLC). However, due to the gigapixel of whole slide images (WSIs) and the absence of definitive morphological features, most automatic subtype classification methods for NSCLC require manually delineating the regions of interest (ROIs) on WSIs.Approach.In this paper, a weakly supervised framework is proposed for accurate subtype classification while freeing pathologists from pixel-level annotation. With respect to the characteristics of histopathological images, we design a two-stage structure with ROI localization and subtype classification. We first develop a method called multi-resolution expectation-maximization convolutional neural network (MR-EM-CNN) to locate ROIs for subsequent subtype classification. The EM algorithm is introduced to select the discriminative image patches for training a patch-wise network, with only WSI-wise labels available. A multi-resolution mechanism is designed for fine localization, similar to the coarse-to-fine process of manual pathological analysis. In the second stage, we build a novel hierarchical attention multi-scale network (HMS) for subtype classification. HMS can capture multi-scale features flexibly driven by the attention module and implement hierarchical features interaction.Results.Experimental results on the 1002-patient Cancer Genome Atlas dataset achieved an AUC of 0.9602 in the ROI localization and an AUC of 0.9671 for subtype classification.Significance.The proposed method shows superiority compared with other algorithms in the subtype classification of NSCLC. The proposed framework can also be extended to other classification tasks with WSIs.
Collapse
Affiliation(s)
- Lu Zhao
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, People's Republic of China
| | - Xiaowei Xu
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, People's Republic of China
| | - Runping Hou
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, People's Republic of China.,Department of radiation oncology, Shanghai Chest Hospital, Shanghai, People's Republic of China
| | - Wangyuan Zhao
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, People's Republic of China
| | - Hai Zhong
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, People's Republic of China
| | - Haohua Teng
- Department of pathology, Shanghai Chest Hospital, Shanghai, People's Republic of China
| | - Yuchen Han
- Department of pathology, Shanghai Chest Hospital, Shanghai, People's Republic of China
| | - Xiaolong Fu
- Department of radiation oncology, Shanghai Chest Hospital, Shanghai, People's Republic of China
| | - Jianqi Sun
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, People's Republic of China
| | - Jun Zhao
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, People's Republic of China
| |
Collapse
|
3
|
Wang X, Chen H, Gan C, Lin H, Dou Q, Tsougenis E, Huang Q, Cai M, Heng PA. Weakly Supervised Deep Learning for Whole Slide Lung Cancer Image Analysis. IEEE TRANSACTIONS ON CYBERNETICS 2020; 50:3950-3962. [PMID: 31484154 DOI: 10.1109/tcyb.2019.2935141] [Citation(s) in RCA: 152] [Impact Index Per Article: 30.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/21/2023]
Abstract
Histopathology image analysis serves as the gold standard for cancer diagnosis. Efficient and precise diagnosis is quite critical for the subsequent therapeutic treatment of patients. So far, computer-aided diagnosis has not been widely applied in pathological field yet as currently well-addressed tasks are only the tip of the iceberg. Whole slide image (WSI) classification is a quite challenging problem. First, the scarcity of annotations heavily impedes the pace of developing effective approaches. Pixelwise delineated annotations on WSIs are time consuming and tedious, which poses difficulties in building a large-scale training dataset. In addition, a variety of heterogeneous patterns of tumor existing in high magnification field are actually the major obstacle. Furthermore, a gigapixel scale WSI cannot be directly analyzed due to the immeasurable computational cost. How to design the weakly supervised learning methods to maximize the use of available WSI-level labels that can be readily obtained in clinical practice is quite appealing. To overcome these challenges, we present a weakly supervised approach in this article for fast and effective classification on the whole slide lung cancer images. Our method first takes advantage of a patch-based fully convolutional network (FCN) to retrieve discriminative blocks and provides representative deep features with high efficiency. Then, different context-aware block selection and feature aggregation strategies are explored to generate globally holistic WSI descriptor which is ultimately fed into a random forest (RF) classifier for the image-level prediction. To the best of our knowledge, this is the first study to exploit the potential of image-level labels along with some coarse annotations for weakly supervised learning. A large-scale lung cancer WSI dataset is constructed in this article for evaluation, which validates the effectiveness and feasibility of the proposed method. Extensive experiments demonstrate the superior performance of our method that surpasses the state-of-the-art approaches by a significant margin with an accuracy of 97.3%. In addition, our method also achieves the best performance on the public lung cancer WSIs dataset from The Cancer Genome Atlas (TCGA). We highlight that a small number of coarse annotations can contribute to further accuracy improvement. We believe that weakly supervised learning methods have great potential to assist pathologists in histology image diagnosis in the near future.
Collapse
|
4
|
Kumar A, Prateek M. Localization of Nuclei in Breast Cancer Using Whole Slide Imaging System Supported by Morphological Features and Shape Formulas. Cancer Manag Res 2020; 12:4573-4583. [PMID: 32606950 PMCID: PMC7305844 DOI: 10.2147/cmar.s248166] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2020] [Accepted: 05/25/2020] [Indexed: 11/23/2022] Open
Abstract
PURPOSE Cancer rates are exponentially increasing worldwide and over 15 million new cases are expected in the year 2020 according to the World Cancer Report. To support the clinical diagnosis of the disease, recent technical advancements in digital microscopy have been achieved to reduce the cost and increase the efficiency of the process. Food and Drug Administration (FDA or Agency) has issued the guidelines, in particular, the development of digital whole slide image scanning system. It is very helpful to the computer-aided diagnosis of breast cancer. METHODS Whole slide imaging supported by fluorescence, immunohistochemistry, and multispectral imaging concepts. Due to the high dimension of WSI images and computation, it is a challenging task to find the region of interest (ROI) on a malignant sample image. The unsupervised machine learning and quantitative analysis of malignant sample images are supported by morphological features and shape formulas to find the correct region of interest. Due to computational limitations, it starts to work on small patches, integrate the results, and automated localize or detect the ROI. It is also compared to the handcrafted and automated region of interest provided in the ICIAR2018 dataset. RESULTS A total of 10 hematoxylins and eosin (H&E) stained malignant breast histology microscopy whole slide image samples are labeled and annotated by two medical experts who are team members of the ICIAR 2018 challenge. After applying the proposed methodology, it is successfully able to localize the malignant patches of WSI sample images and getting the ROI with an average accuracy of 85.5%. CONCLUSION With the help of the k-means clustering algorithm, morphological features, and shape formula, it is possible to recognize the region of interest using the whole slide imaging concept.
Collapse
Affiliation(s)
- Anil Kumar
- School of Computer Science, University of Petroleum and Energy Studies, Dehradun 248007, India
| | - Manish Prateek
- School of Computer Science, University of Petroleum and Energy Studies, Dehradun 248007, India
| |
Collapse
|
5
|
Zheng H, Momeni A, Cedoz PL, Vogel H, Gevaert O. Whole slide images reflect DNA methylation patterns of human tumors. NPJ Genom Med 2020; 5:11. [PMID: 32194984 PMCID: PMC7064513 DOI: 10.1038/s41525-020-0120-9] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2019] [Accepted: 01/21/2020] [Indexed: 12/13/2022] Open
Abstract
DNA methylation is an important epigenetic mechanism regulating gene expression and its role in carcinogenesis has been extensively studied. High-throughput DNA methylation assays have been used broadly in cancer research. Histopathology images are commonly obtained in cancer treatment, given that tissue sampling remains the clinical gold-standard for diagnosis. In this work, we investigate the interaction between cancer histopathology images and DNA methylation profiles to provide a better understanding of tumor pathobiology at the epigenetic level. We demonstrate that classical machine learning algorithms can associate the DNA methylation profiles of cancer samples with morphometric features extracted from whole slide images. Furthermore, grouping the genes into methylation clusters greatly improves the performance of the models. The well-predicted genes are enriched in key pathways in carcinogenesis including hypoxia in glioma and angiogenesis in renal cell carcinoma. Our results provide new insights into the link between histopathological and molecular data.
Collapse
Affiliation(s)
- Hong Zheng
- Stanford Center for Biomedical Informatics Research (BMIR), Department of Medicine, Stanford University, Stanford, USA
| | - Alexandre Momeni
- Stanford Center for Biomedical Informatics Research (BMIR), Department of Medicine, Stanford University, Stanford, USA
| | - Pierre-Louis Cedoz
- Stanford Center for Biomedical Informatics Research (BMIR), Department of Medicine, Stanford University, Stanford, USA
| | - Hannes Vogel
- Department of Pathology, Stanford University, Stanford, USA
| | - Olivier Gevaert
- Stanford Center for Biomedical Informatics Research (BMIR), Department of Medicine, Stanford University, Stanford, USA
- Department of Biomedical Data Science, Stanford University, Stanford, USA
| |
Collapse
|
6
|
Kus P, Gurcan MN, Beamer G. Automatic Detection of Granuloma Necrosis in Pulmonary Tuberculosis Using a Two-Phase Algorithm: 2D-TB. Microorganisms 2019; 7:E661. [PMID: 31817882 PMCID: PMC6956251 DOI: 10.3390/microorganisms7120661] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2019] [Revised: 11/05/2019] [Accepted: 11/08/2019] [Indexed: 01/10/2023] Open
Abstract
Granuloma necrosis occurs in hosts susceptible to pathogenic mycobacteria and is a diagnostic visual feature of pulmonary tuberculosis (TB) in humans and in super-susceptible Diversity Outbred (DO) mice infected with Mycobacterium tuberculosis. Currently, no published automated algorithms can detect granuloma necrosis in pulmonary TB. However, such a method could reduce variability, and transform visual patterns into quantitative data for statistical and machine learning analyses. Here, we used histopathological images from super-susceptible DO mice to train, validate, and performance test an algorithm to detect regions of cell-poor necrosis. The algorithm, named 2D-TB, works on 2-dimensional histopathological images in 2 phases. In phase 1, granulomas are detected following background elimination. In phase 2, 2D-TB searches within granulomas for regions of cell-poor necrosis. We used 8 lung sections from 8 different super-susceptible DO mice for training and 10-fold cross validation. We used 13 new lung sections from 10 different super-susceptible DO mice for performance testing. 2D-TB reached 100.0% sensitivity and 91.8% positive prediction value. Compared to an expert pathologist, agreement was 95.5% and there was a statistically significant positive correlation for area detected by 2D-TB and the pathologist. These results show the development, validation, and accurate performance of 2D-TB to detect granuloma necrosis.
Collapse
Affiliation(s)
- Pelin Kus
- Department of Research, Development and Technology, Republic of Turkey Ministry of National Defence, 06100 Ankara, Turkey;
| | - Metin N. Gurcan
- Department of Internal Medicine, School of Medicine, Wake Forest University, Winston-Salem, NC 27109, USA;
| | - Gillian Beamer
- Department of Infectious Disease and Global Health, Cummings School of Veterinary Medicine, Tufts University, North Grafton, MA 01536, USA
| |
Collapse
|
7
|
High-Dimensional Phenotyping Identifies Age-Emergent Cells in Human Mammary Epithelia. Cell Rep 2019; 23:1205-1219. [PMID: 29694896 PMCID: PMC5946804 DOI: 10.1016/j.celrep.2018.03.114] [Citation(s) in RCA: 42] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2017] [Revised: 01/19/2018] [Accepted: 03/25/2018] [Indexed: 12/21/2022] Open
Abstract
Aging is associated with tissue-level changes in cellular composition that are correlated with increased susceptibility to disease. Aging human mammary tissue shows skewed progenitor cell potency, resulting in diminished tumor-suppressive cell types and the accumulation of defective epithelial progenitors. Quantitative characterization of these age-emergent human cell subpopulations is lacking, impeding our understanding of the relationship between age and cancer susceptibility. We conducted single-cell resolution proteomic phenotyping of healthy breast epithelia from 57 women, aged 16–91 years, using mass cytometry. Remarkable heterogeneity was quantified within the two mammary epithelial lineages. Population partitioning identified a subset of aberrant basal-like luminal cells that accumulate with age and originate from age-altered progenitors. Quantification of age-emergent phenotypes enabled robust classification of breast tissues by age in healthy women. This high-resolution mapping highlighted specific epithelial subpopulations that change with age in a manner consistent with increased susceptibility to breast cancer. CyTOF analysis reveals human mammary epithelial heterogeneity with age Age-emergent luminal cells share phenotypes with candidate breast cancer cells of origin Classification models correctly assign tissue samples to their age group Age-related changes are conserved between mammary epithelial tissue and primary cells
Collapse
|
8
|
Chang H, Han J, Zhong C, Snijders AM, Mao JH. Unsupervised Transfer Learning via Multi-Scale Convolutional Sparse Coding for Biomedical Applications. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2018; 40:1182-1194. [PMID: 28129148 PMCID: PMC5522776 DOI: 10.1109/tpami.2017.2656884] [Citation(s) in RCA: 59] [Impact Index Per Article: 8.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/23/2023]
Abstract
The capabilities of (I) learning transferable knowledge across domains; and (II) fine-tuning the pre-learned base knowledge towards tasks with considerably smaller data scale are extremely important. Many of the existing transfer learning techniques are supervised approaches, among which deep learning has the demonstrated power of learning domain transferrable knowledge with large scale network trained on massive amounts of labeled data. However, in many biomedical tasks, both the data and the corresponding label can be very limited, where the unsupervised transfer learning capability is urgently needed. In this paper, we proposed a novel multi-scale convolutional sparse coding (MSCSC) method, that (I) automatically learns filter banks at different scales in a joint fashion with enforced scale-specificity of learned patterns; and (II) provides an unsupervised solution for learning transferable base knowledge and fine-tuning it towards target tasks. Extensive experimental evaluation of MSCSC demonstrates the effectiveness of the proposed MSCSC in both regular and transfer learning tasks in various biomedical domains.
Collapse
Affiliation(s)
- Hang Chang
- Hang Chang and Ju Han and Cheng Zhong and Antoine M. Snijders and Jian-Hua Mao are with Berkeley Biomedical Data Science Center (BBDS: http://bbds.lbl.gov), Biological Systems and Engineering Division, Lawrence Berkeley National Laboratory, Berkeley, California, U.S.A
| | - Ju Han
- Hang Chang and Ju Han and Cheng Zhong and Antoine M. Snijders and Jian-Hua Mao are with Berkeley Biomedical Data Science Center (BBDS: http://bbds.lbl.gov), Biological Systems and Engineering Division, Lawrence Berkeley National Laboratory, Berkeley, California, U.S.A
| | - Cheng Zhong
- Hang Chang and Ju Han and Cheng Zhong and Antoine M. Snijders and Jian-Hua Mao are with Berkeley Biomedical Data Science Center (BBDS: http://bbds.lbl.gov), Biological Systems and Engineering Division, Lawrence Berkeley National Laboratory, Berkeley, California, U.S.A
| | - Antoine M. Snijders
- Hang Chang and Ju Han and Cheng Zhong and Antoine M. Snijders and Jian-Hua Mao are with Berkeley Biomedical Data Science Center (BBDS: http://bbds.lbl.gov), Biological Systems and Engineering Division, Lawrence Berkeley National Laboratory, Berkeley, California, U.S.A
| | - Jian-Hua Mao
- Hang Chang and Ju Han and Cheng Zhong and Antoine M. Snijders and Jian-Hua Mao are with Berkeley Biomedical Data Science Center (BBDS: http://bbds.lbl.gov), Biological Systems and Engineering Division, Lawrence Berkeley National Laboratory, Berkeley, California, U.S.A
| |
Collapse
|
9
|
Young Hwan Chang, Thibault G, Madin O, Azimi V, Meyers C, Johnson B, Link J, Margolin A, Gray JW. Deep learning based Nucleus Classification in pancreas histological images. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2017; 2017:672-675. [PMID: 29059962 DOI: 10.1109/embc.2017.8036914] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
Tumor specimens contain a variety of healthy cells as well as cancerous cells, and this heterogeneity underlies resistance to various cancer therapies. But this problem has not been thoroughly investigated until recently. Meanwhile, technological breakthroughs in imaging have led to an explosion of molecular and cellular profiling data from large numbers of samples, and modern machine learning approaches including deep learning have been shown to produce encouraging results by finding hidden structures and make accurate predictions. In this paper, we propose a Deep learning based Nucleus Classification (DeepNC) approach using paired histopathology and immunofluorescence images (for label), and demonstrate its classification prediction power. This method can solve current issue on discrepancy between genomic- or transcriptomic-based and pathology-based tumor purity estimates by improving histological evaluation. We also explain challenges in training a deep learning model for huge dataset.
Collapse
|
10
|
Xu Y, Jia Z, Wang LB, Ai Y, Zhang F, Lai M, Chang EIC. Large scale tissue histopathology image classification, segmentation, and visualization via deep convolutional activation features. BMC Bioinformatics 2017; 18:281. [PMID: 28549410 PMCID: PMC5446756 DOI: 10.1186/s12859-017-1685-x] [Citation(s) in RCA: 186] [Impact Index Per Article: 23.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2016] [Accepted: 05/15/2017] [Indexed: 02/07/2023] Open
Abstract
BACKGROUND Histopathology image analysis is a gold standard for cancer recognition and diagnosis. Automatic analysis of histopathology images can help pathologists diagnose tumor and cancer subtypes, alleviating the workload of pathologists. There are two basic types of tasks in digital histopathology image analysis: image classification and image segmentation. Typical problems with histopathology images that hamper automatic analysis include complex clinical representations, limited quantities of training images in a dataset, and the extremely large size of singular images (usually up to gigapixels). The property of extremely large size for a single image also makes a histopathology image dataset be considered large-scale, even if the number of images in the dataset is limited. RESULTS In this paper, we propose leveraging deep convolutional neural network (CNN) activation features to perform classification, segmentation and visualization in large-scale tissue histopathology images. Our framework transfers features extracted from CNNs trained by a large natural image database, ImageNet, to histopathology images. We also explore the characteristics of CNN features by visualizing the response of individual neuron components in the last hidden layer. Some of these characteristics reveal biological insights that have been verified by pathologists. According to our experiments, the framework proposed has shown state-of-the-art performance on a brain tumor dataset from the MICCAI 2014 Brain Tumor Digital Pathology Challenge and a colon cancer histopathology image dataset. CONCLUSIONS The framework proposed is a simple, efficient and effective system for histopathology image automatic analysis. We successfully transfer ImageNet knowledge as deep convolutional activation features to the classification and segmentation of histopathology images with little training data. CNN features are significantly more powerful than expert-designed features.
Collapse
Affiliation(s)
- Yan Xu
- State Key Laboratory of Software Development Environment and Key Laboratory of Biomechanics and Mechanobiology of Ministry of Education and Research Institute of Beihang University in Shenzhen, Beijing, China. .,Microsoft Research, Beijing, China.
| | - Zhipeng Jia
- Microsoft Research, Beijing, China.,Institute for Interdisciplinary Information Sciences, Tsinghua University, Beijing, China
| | - Liang-Bo Wang
- Microsoft Research, Beijing, China.,Graduate Institute of Biomedical Electronics and Bioinformatics, National Taiwan University, Taipei, Taiwan
| | - Yuqing Ai
- Microsoft Research, Beijing, China.,Institute for Interdisciplinary Information Sciences, Tsinghua University, Beijing, China
| | - Fang Zhang
- Microsoft Research, Beijing, China.,Institute for Interdisciplinary Information Sciences, Tsinghua University, Beijing, China
| | - Maode Lai
- Department of Pathology, School of Medicine, Zhejiang University, Hangzhou, China
| | | |
Collapse
|
11
|
Integrative Analysis of Cellular Morphometric Context Reveals Clinically Relevant Signatures in Lower Grade Glioma. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2016; 9900:72-80. [PMID: 28018994 DOI: 10.1007/978-3-319-46720-7_9] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/15/2023]
Abstract
Integrative analysis based on quantitative representation of whole slide images (WSIs) in a large histology cohort may provide predictive models of clinical outcome. On one hand, the efficiency and effectiveness of such representation is hindered as a result of large technical variations (e.g., fixation, staining) and biological heterogeneities (e.g., cell type, cell state) that are always present in a large cohort. On the other hand, perceptual interpretation/validation of important multivariate phenotypic signatures are often difficult due to the loss of visual information during feature transformation in hyperspace. To address these issues, we propose a novel approach for integrative analysis based on cellular morphometric context, which is a robust representation of WSI, with the emphasis on tumor architecture and tumor heterogeneity, built upon cellular level morphometric features within the spatial pyramid matching (SPM) framework. The proposed approach is applied to The Cancer Genome Atlas (TCGA) lower grade glioma (LGG) cohort, where experimental results (i) reveal several clinically relevant cellular morphometric types, which enables both perceptual interpretation/validation and further investigation through gene set enrichment analysis; and (ii) indicate the significantly increased survival rates in one of the cellular morphometric context subtypes derived from the cellular morphometric context.
Collapse
|
12
|
Zhong C, Han J, Borowsky A, Parvin B, Wang Y, Chang H. When machine vision meets histology: A comparative evaluation of model architecture for classification of histology sections. Med Image Anal 2016; 35:530-543. [PMID: 27644083 DOI: 10.1016/j.media.2016.08.010] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2016] [Revised: 08/12/2016] [Accepted: 08/26/2016] [Indexed: 12/18/2022]
Abstract
Classification of histology sections in large cohorts, in terms of distinct regions of microanatomy (e.g., stromal) and histopathology (e.g., tumor, necrosis), enables the quantification of tumor composition, and the construction of predictive models of genomics and clinical outcome. To tackle the large technical variations and biological heterogeneities, which are intrinsic in large cohorts, emerging systems utilize either prior knowledge from pathologists or unsupervised feature learning for invariant representation of the underlying properties in the data. However, to a large degree, the architecture for tissue histology classification remains unexplored and requires urgent systematical investigation. This paper is the first attempt to provide insights into three fundamental questions in tissue histology classification: I. Is unsupervised feature learning preferable to human engineered features? II. Does cellular saliency help? III. Does the sparse feature encoder contribute to recognition? We show that (a) in I, both Cellular Morphometric Feature and features from unsupervised feature learning lead to superior performance when compared to SIFT and [Color, Texture]; (b) in II, cellular saliency incorporation impairs the performance for systems built upon pixel-/patch-level features; and (c) in III, the effect of the sparse feature encoder is correlated with the robustness of features, and the performance can be consistently improved by the multi-stage extension of systems built upon both Cellular Morphmetric Feature and features from unsupervised feature learning. These insights are validated with two cohorts of Glioblastoma Multiforme (GBM) and Kidney Clear Cell Carcinoma (KIRC).
Collapse
Affiliation(s)
- Cheng Zhong
- Lawrence Berkeley National Laboratory, Berkeley CA USA
| | - Ju Han
- Lawrence Berkeley National Laboratory, Berkeley CA USA
| | - Alexander Borowsky
- Center for Comparative Medicine, University of California, Davis,CA, USA
| | - Bahram Parvin
- Department of Electrical and Biomedical Engineering, University of Nevada, Reno, NV USA
| | - Yunfu Wang
- Lawrence Berkeley National Laboratory, Berkeley CA USA; Department of Neurology, Taihe Hospital, Hubei University of Medicine, Shiyan, Hubei, China
| | - Hang Chang
- Lawrence Berkeley National Laboratory, Berkeley CA USA.
| |
Collapse
|
13
|
Han J, Fontenay GV, Wang Y, Mao JH, Chang H. PHENOTYPIC CHARACTERIZATION OF BREAST INVASIVE CARCINOMA VIA TRANSFERABLE TISSUE MORPHOMETRIC PATTERNS LEARNED FROM GLIOBLASTOMA MULTIFORME. PROCEEDINGS. IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING 2016; 2016:1025-1028. [PMID: 27390615 DOI: 10.1109/isbi.2016.7493440] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Quantitative analysis of whole slide images (WSIs) in a large cohort may provide predictive models of clinical outcome. However, the performance of the existing techniques is hindered as a result of large technical variations (e.g., fixation, staining) and biological heterogeneities (e.g., cell type, cell state) that are always present in a large cohort. Although unsupervised feature learning provides a promising way in learning pertinent features without human intervention, its capability can be greatly limited due to the lack of well-curated examples. In this paper, we explored the transferability of knowledge acquired from a well-curated Glioblastoma Multiforme (GBM) dataset through its application to the representation and characterization of tissue histology from the Cancer Genome Atlas (TCGA) Breast Invasive Carcinoma (BRCA) cohort. Our experimental results reveals two major phenotypic subtypes with statistically significantly different survival curves. Further differential expression analysis of these two subtypes indicates enrichment of genes regulated by NF-kB in response to TNF and genes up-regulated in response to IFNG.
Collapse
Affiliation(s)
- Ju Han
- Department of Electrical and Biomedical Engineering, University of Nevada, Reno, Nevada, USA
| | - Gerald V Fontenay
- Biological Systems and Engineering Division, Lawrence Berkeley National Laboratory, Berkeley, California, USA
| | - Yunfu Wang
- Biological Systems and Engineering Division, Lawrence Berkeley National Laboratory, Berkeley, California, USA; Department of Neurology, Taihe Hospital, Hubei University of Medicine, Shiyan, Hubei, China
| | - Jian-Hua Mao
- Biological Systems and Engineering Division, Lawrence Berkeley National Laboratory, Berkeley, California, USA
| | - Hang Chang
- Department of Electrical and Biomedical Engineering, University of Nevada, Reno, Nevada, USA; Biological Systems and Engineering Division, Lawrence Berkeley National Laboratory, Berkeley, California, USA
| |
Collapse
|
14
|
Automatic Diagnosis of Ovarian Carcinomas via Sparse Multiresolution Tissue Representation. ACTA ACUST UNITED AC 2015. [DOI: 10.1007/978-3-319-24553-9_77] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/12/2023]
|
15
|
Zhou Y, Chang H, Barner KE, Parvin B. NUCLEI SEGMENTATION VIA SPARSITY CONSTRAINED CONVOLUTIONAL REGRESSION. PROCEEDINGS. IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING 2015; 2015:1284-1287. [PMID: 28101301 PMCID: PMC5239217 DOI: 10.1109/isbi.2015.7164109] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
Abstract
Automated profiling of nuclear architecture, in histology sections, can potentially help predict the clinical outcomes. However, the task is challenging as a result of nuclear pleomorphism and cellular states (e.g., cell fate, cell cycle), which are compounded by the batch effect (e.g., variations in fixation and staining). Present methods, for nuclear segmentation, are based on human-designed features that may not effectively capture intrinsic nuclear architecture. In this paper, we propose a novel approach, called sparsity constrained convolutional regression (SCCR), for nuclei segmentation. Specifically, given raw image patches and the corresponding annotated binary masks, our algorithm jointly learns a bank of convolutional filters and a sparse linear regressor, where the former is used for feature extraction, and the latter aims to produce a likelihood for each pixel being nuclear region or background. During classification, the pixel label is simply determined by a thresholding operation applied on the likelihood map. The method has been evaluated using the benchmark dataset collected from The Cancer Genome Atlas (TCGA). Experimental results demonstrate that our method outperforms traditional nuclei segmentation algorithms and is able to achieve competitive performance compared to the state-of-the-art algorithm built upon human-designed features with biological prior knowledge.
Collapse
Affiliation(s)
- Yin Zhou
- Life Science Division, Lawrence Berkeley National Laboratory, Berkeley, CA, U.S.A
- University of Delaware, Newark, DE, U.S.A
| | - Hang Chang
- Life Science Division, Lawrence Berkeley National Laboratory, Berkeley, CA, U.S.A
- Department of Electrical and Computer Engineering, University of California, Riverside, U.S.A
| | | | - Bahram Parvin
- Life Science Division, Lawrence Berkeley National Laboratory, Berkeley, CA, U.S.A
- Biomedical Engineering Department, University of Nevada, Reno, NV, U.S.A
- Department of Electrical and Computer Engineering, University of California, Riverside, U.S.A
| |
Collapse
|
16
|
Mousavi HS, Monga V, Rao G, Rao AUK. Automated discrimination of lower and higher grade gliomas based on histopathological image analysis. J Pathol Inform 2015; 6:15. [PMID: 25838967 PMCID: PMC4382761 DOI: 10.4103/2153-3539.153914] [Citation(s) in RCA: 44] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2014] [Accepted: 01/05/2015] [Indexed: 11/04/2022] Open
Abstract
INTRODUCTION Histopathological images have rich structural information, are multi-channel in nature and contain meaningful pathological information at various scales. Sophisticated image analysis tools that can automatically extract discriminative information from the histopathology image slides for diagnosis remain an area of significant research activity. In this work, we focus on automated brain cancer grading, specifically glioma grading. Grading of a glioma is a highly important problem in pathology and is largely done manually by medical experts based on an examination of pathology slides (images). To complement the efforts of clinicians engaged in brain cancer diagnosis, we develop novel image processing algorithms and systems to automatically grade glioma tumor into two categories: Low-grade glioma (LGG) and high-grade glioma (HGG) which represent a more advanced stage of the disease. RESULTS We propose novel image processing algorithms based on spatial domain analysis for glioma tumor grading that will complement the clinical interpretation of the tissue. The image processing techniques are developed in close collaboration with medical experts to mimic the visual cues that a clinician looks for in judging of the grade of the disease. Specifically, two algorithmic techniques are developed: (1) A cell segmentation and cell-count profile creation for identification of Pseudopalisading Necrosis, and (2) a customized operation of spatial and morphological filters to accurately identify microvascular proliferation (MVP). In both techniques, a hierarchical decision is made via a decision tree mechanism. If either Pseudopalisading Necrosis or MVP is found present in any part of the histopathology slide, the whole slide is identified as HGG, which is consistent with World Health Organization guidelines. Experimental results on the Cancer Genome Atlas database are presented in the form of: (1) Successful detection rates of pseudopalisading necrosis and MVP regions, (2) overall classification accuracy into LGG and HGG categories, and (3) receiver operating characteristic curves which can facilitate a desirable trade-off between HGG detection and false-alarm rates. CONCLUSION The proposed method demonstrates fairly high accuracy and compares favorably against best-known alternatives such as the state-of-the-art WND-CHARM feature set provided by NIH combined with powerful support vector machine classifier. Our results reveal that the proposed method can be beneficial to a clinician in effectively separating histopathology slides into LGG and HGG categories, particularly where the analysis of a large number of slides is needed. Our work also reveals that MVP regions are much harder to detect than Pseudopalisading Necrosis and increasing accuracy of automated image processing for MVP detection emerges as a significant future research direction.
Collapse
Affiliation(s)
- Hojjat Seyed Mousavi
- Department of Electrical Engineering, The Pennsylvania State University, University Park, PA, USA
| | - Vishal Monga
- Department of Electrical Engineering, The Pennsylvania State University, University Park, PA, USA
| | - Ganesh Rao
- Department of Neurosurgery, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Arvind U K Rao
- Department of Bioinformatics and Computational Biology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| |
Collapse
|
17
|
Chang H, Parvin B. Classification of 3D Multicellular Organization in Phase Microscopy for High Throughput Screening of Therapeutic Targets. PROCEEDINGS. IEEE WORKSHOP ON APPLICATIONS OF COMPUTER VISION 2015; 2015:436-441. [PMID: 25729338 DOI: 10.1109/wacv.2015.64] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
The current trend in high throughput screening is the utilization of more complex model systems that mimic both structural and functional properties of cellular processes in vivo. In this context, 3D cell culture models have emerged as effective systems to study tumor initiation and cancer behavior, where colony organization represents distinct phenotypic signatures that enable differentiation of cancer cells in culture using phase imaging and in the absence of clinical markers. If the colony organization can be classified into different phenotypes, it will enable rapid drug screening using phase microscopy. In this paper, we propose a novel method based on locality-constrained dictionary learning for the discrimination of aberrant colony organization in phase images, which encodes original SIFT (Scale-Invariant Feature Transform) features into high dimensional sparse codes with locality-preserving landmark points on the nonlinear manifold, and summarizes the sparse features at various locations and scales through spatial pyramid matching for robust representation. Experimental results demonstrate the significant improvement of performance, compared to the state-of-art in the field.
Collapse
Affiliation(s)
- Hang Chang
- Life Sciences Division, Lawrence Berkeley National Laboratory, Berkeley, California, U.S.A
| | - Bahram Parvin
- Life Sciences Division, Lawrence Berkeley National Laboratory, Berkeley, California, U.S.A ; Biomedical Engineering Department, University of Nevada, Reno, Nevada, U.S.A
| |
Collapse
|
18
|
Chang H, Zhou Y, Borowsky A, Barner K, Spellman P, Parvin B. Stacked Predictive Sparse Decomposition for Classification of Histology Sections. Int J Comput Vis 2014; 113:3-18. [PMID: 27721567 DOI: 10.1007/s11263-014-0790-9] [Citation(s) in RCA: 35] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
Image-based classification of histology sections, in terms of distinct components (e.g., tumor, stroma, normal), provides a series of indices for histology composition (e.g., the percentage of each distinct components in histology sections), and enables the study of nuclear properties within each component. Furthermore, the study of these indices, constructed from each whole slide image in a large cohort, has the potential to provide predictive models of clinical outcome. For example, correlations can be established between the constructed indices and the patients' survival information at cohort level, which is a fundamental step towards personalized medicine. However, performance of the existing techniques is hindered as a result of large technical variations (e.g., variations of color/textures in tissue images due to non-standard experimental protocols) and biological heterogeneities (e.g., cell type, cell state) that are always present in a large cohort. We propose a system that automatically learns a series of dictionary elements for representing the underlying spatial distribution using stacked predictive sparse decomposition. The learned representation is then fed into the spatial pyramid matching framework with a linear support vector machine classifier. The system has been evaluated for classification of distinct histological components for two cohorts of tumor types. Throughput has been increased by using of graphical processing unit (GPU), and evaluation indicates a superior performance results, compared with previous research.
Collapse
Affiliation(s)
- Hang Chang
- Life Sciences Division, Lawrence Berkeley National Laboratory, Berkeley, CA, USA
| | - Yin Zhou
- Life Sciences Division, Lawrence Berkeley National Laboratory, Berkeley, CA, USA
| | | | | | - Paul Spellman
- Center for Spatial Systems Biomedicine, Oregon Health Sciences University, Portland, ON, USA
| | - Bahram Parvin
- Life Sciences Division, Lawrence Berkeley National Laboratory, Berkeley, CA, USA
| |
Collapse
|
19
|
Zhou Y, Chang H, Barner K, Spellman P, Parvin B. Classification of Histology Sections via Multispectral Convolutional Sparse Coding. CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS. IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION. WORKSHOPS 2014; 2014:3081-3088. [PMID: 25554749 DOI: 10.1109/cvpr.2014.394] [Citation(s) in RCA: 32] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Image-based classification of histology sections plays an important role in predicting clinical outcomes. However this task is very challenging due to the presence of large technical variations (e.g., fixation, staining) and biological heterogeneities (e.g., cell type, cell state). In the field of biomedical imaging, for the purposes of visualization and/or quantification, different stains are typically used for different targets of interest (e.g., cellular/subcellular events), which generates multi-spectrum data (images) through various types of microscopes and, as a result, provides the possibility of learning biological-component-specific features by exploiting multispectral information. We propose a multispectral feature learning model that automatically learns a set of convolution filter banks from separate spectra to efficiently discover the intrinsic tissue morphometric signatures, based on convolutional sparse coding (CSC). The learned feature representations are then aggregated through the spatial pyramid matching framework (SPM) and finally classified using a linear SVM. The proposed system has been evaluated using two large-scale tumor cohorts, collected from The Cancer Genome Atlas (TCGA). Experimental results show that the proposed model 1) outperforms systems utilizing sparse coding for unsupervised feature learning (e.g., PSD-SPM [5]); 2) is competitive with systems built upon features with biological prior knowledge (e.g., SMLSPM [4]).
Collapse
Affiliation(s)
- Yin Zhou
- ECE Department, University of Delaware, Newark, Delaware, U.S.A
| | - Hang Chang
- Center for Spatial Systems Biomedicine, Oregon Health Sciences University, Portland, Oregon, U.S.A
| | - Kenneth Barner
- Life Sciences Division, Lawrence Berkeley National Laboratory, Berkeley, California, U.S.A
| | | | | |
Collapse
|
20
|
Chang H, Zhou Y, Spellman P, Parvin B. Stacked Predictive Sparse Coding for Classification of Distinct Regions of Tumor Histopathology. PROCEEDINGS. IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION 2013:169-176. [PMID: 24770492 DOI: 10.1109/iccv.2013.28] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Image-based classification of tissue histology, in terms of distinct histopathology (e.g., tumor or necrosis regions), provides a series of indices for tumor composition. Furthermore, aggregation of these indices from each whole slide image (WSI) in a large cohort can provide predictive models of clinical outcome. However, the performance of the existing techniques is hindered as a result of large technical variations (e.g., fixation, staining) and biological heterogeneities (e.g., cell type, cell state) that are always present in a large cohort. We suggest that, compared with human engineered features widely adopted in existing systems, unsupervised feature learning is more tolerant to batch effect (e.g., technical variations associated with sample preparation) and pertinent features can be learned without user intervention. This leads to a novel approach for classification of tissue histology based on unsupervised feature learning and spatial pyramid matching (SPM), which utilize sparse tissue morphometric signatures at various locations and scales. This approach has been evaluated on two distinct datasets consisting of different tumor types collected from The Cancer Genome Atlas (TCGA), and the experimental results indicate that the proposed approach is (i) extensible to different tumor types; (ii) robust in the presence of wide technical variations and biological heterogeneities; and (iii) scalable with varying training sample sizes.
Collapse
Affiliation(s)
- Hang Chang
- Life Sciences Division, Lawrence Berkeley National Laboratory, Berkeley, California, U.S.A
| | - Yin Zhou
- Life Sciences Division, Lawrence Berkeley National Laboratory, Berkeley, California, U.S.A
| | - Paul Spellman
- Center for Spatial Systems Biomedicine, Oregon Health Sciences University, Portland, Oregon, U.S.A
| | - Bahram Parvin
- Life Sciences Division, Lawrence Berkeley National Laboratory, Berkeley, California, U.S.A
| |
Collapse
|