1
|
Huang YA, Pan GQ, Wang J, Li JQ, Chen J, Wu YH. Heterogeneous graph embedding model for predicting interactions between TF and target gene. Bioinformatics 2022; 38:2554-2560. [PMID: 35266510 DOI: 10.1093/bioinformatics/btac148] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2021] [Revised: 02/13/2022] [Accepted: 03/09/2022] [Indexed: 11/15/2022] Open
Abstract
MOTIVATION Identifying the target genes of transcription factors (TFs) is of great significance for biomedical researches. However, using biological experiments to identify TF-target gene interactions is still time consuming, expensive and limited to small scale. Existing computational methods for predicting underlying genes for TF to target is mainly proposed for their binding sites rather than the direct interaction. To bridge this gap, we in this work proposed a deep learning prediction model, named HGETGI, to identify the new TF-target gene interaction. Specifically, the proposed HGETGI model learns the patterns of the known interaction between TF and target gene complemented with their involvement in different human disease mechanisms. It performs prediction based on random walk for meta-path sampling and node embedding in a skip-gram manner. RESULTS We evaluated the prediction performance of the proposed method on a real dataset and the experimental results show that it can achieve the average area under the curve of 0.8519 ± 0.0731 in 5-fold cross validation. Besides, we conducted case studies on the prediction of two important kinds of TF, NFKB1 and TP53. As a result, 33 and 32 in the top-40 ranking lists of NFKB1 and TP53 were successfully confirmed by looking up another public database(hTftarget). It is envisioned that the proposed HGETGI method is feasible and effective for predicting TF-target gene interactions on a large scale. AVAILABILITY AND IMPLEMENTATION The source code and dataset are available at https://github.com/PGTSING/HGETGI. SUPPLEMENTARY INFORMATION Supplementary data are available at Bioinformatics online.
Collapse
Affiliation(s)
- Yu-An Huang
- College of Computer Science and Software Engineering, Shenzhen University, 3688 Nanhai Avenue, Shenzhen, China
| | - Gui-Qing Pan
- College of Computer Science and Software Engineering, Shenzhen University, 3688 Nanhai Avenue, Shenzhen, China
| | - Jia Wang
- College of Computer Science and Software Engineering, Shenzhen University, 3688 Nanhai Avenue, Shenzhen, China
| | - Jian-Qiang Li
- College of Computer Science and Software Engineering, Shenzhen University, 3688 Nanhai Avenue, Shenzhen, China
| | - Jie Chen
- College of Computer Science and Software Engineering, Shenzhen University, 3688 Nanhai Avenue, Shenzhen, China
| | - Yang-Han Wu
- College of Computer Science and Software Engineering, Shenzhen University, 3688 Nanhai Avenue, Shenzhen, China
| |
Collapse
|
2
|
Zhou L, Huang Y, Wang Q, Guo D. AaHY5 ChIP-seq based on transient expression system reveals the role of AaWRKY14 in artemisinin biosynthetic gene regulation. PLANT PHYSIOLOGY AND BIOCHEMISTRY : PPB 2021; 168:321-328. [PMID: 34678644 DOI: 10.1016/j.plaphy.2021.10.010] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/27/2021] [Accepted: 10/03/2021] [Indexed: 06/13/2023]
Abstract
ChIP-seq (Chromatin immunoprecipitation with sequencing) is the gold standard for determining genome-wide in vivo transcription factor binding sites, the first step for targets prediction and network construction. For non-model plants, it is challenging to perform ChIP-seq due to the difficulty in generating stable transgenic plants. AaHY5 is a positive regulator in artemisinin biosynthesis, whose detailed mode of action remains elusive. Here, we established a protoplast transformation procedure for Artemisia annua by optimizing different conditions in protoplast isolation and transfection. We then performed AaHY5 ChIP-seq based on the established transient expression system. Combining RNA-seq data for various tissues, we identified four transcription factors (one MYB and three WRKY family members) in AaHY5 targets that potentially regulated artemisinin biosynthesis. The three WRKY transcription factors could be induced by light and the overexpression of AaHY5 and upregulate two artemisinin biosynthetic genes, ADS and CYP71AV1. Furthermore, AaWRKY14 showed transcriptional activation activity on artemisinin biosynthetic gene CYP71AV1. Together, AaWRKY14 was identified as a potential transcription factor linking AaHY5 and the artemisinin biosynthetic gene regulation.
Collapse
Affiliation(s)
- Limeng Zhou
- State Key Laboratory of Agrobiotechnology, School of Life Science, The Chinese University of Hong Kong, 999077, Hong Kong, China
| | - Yingzhang Huang
- State Key Laboratory of Agrobiotechnology, School of Life Science, The Chinese University of Hong Kong, 999077, Hong Kong, China
| | - Qi Wang
- Artemisinin Research Center, Guangzhou University of Chinese Medicine, Guangzhou 510000, China
| | - Dianjing Guo
- State Key Laboratory of Agrobiotechnology, School of Life Science, The Chinese University of Hong Kong, 999077, Hong Kong, China.
| |
Collapse
|
3
|
Lim H, Xie L. A New Weighted Imputed Neighborhood-Regularized Tri-Factorization One-Class Collaborative Filtering Algorithm: Application to Target Gene Prediction of Transcription Factors. IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS 2021; 18:126-137. [PMID: 31995498 PMCID: PMC7382975 DOI: 10.1109/tcbb.2020.2968442] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Identifying target genes of transcription factors (TFs) is crucial to understand transcriptional regulation. However, our understanding of genome-wide TF targeting profile is limited due to the cost of large-scale experiments and intrinsic complexity of gene regulation. Thus, computational prediction methods are useful to predict unobserved TF-gene associations. Here, we develop a new Weighted Imputed Neighborhood-regularized Tri-Factorization one-class collaborative filtering algorithm, WINTF. It predicts unobserved target genes for TFs using known but noisy, incomplete, and biased TF-gene associations and protein-protein interaction networks. Our benchmark study shows that WINTF significantly outperforms its counterpart matrix factorization-based algorithms and tri-factorization methods that do not include weight, imputation, and neighbor-regularization, for TF-gene association prediction. When evaluated by independent datasets, accuracy is 37.8 percent on the top 495 predicted associations, an enrichment factor of 4.19 compared with random guess. Furthermore, many predicted novel associations are supported by literature evidence. Although we only use canonical TF-gene interaction data, WINTF can directly be applied to tissue-specific data when available. Thus, WINTF provides a potentially useful framework to integrate multiple omics data for further improvement of TF-gene prediction and applications to other sparse and noisy biological data. The benchmark dataset and source code are freely available at https://github.com/XieResearchGroup/WINTF.
Collapse
|
4
|
Zaborowski AB, Walther D. Determinants of correlated expression of transcription factors and their target genes. Nucleic Acids Res 2020; 48:11347-11369. [PMID: 33104784 PMCID: PMC7672440 DOI: 10.1093/nar/gkaa927] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2020] [Revised: 10/01/2020] [Accepted: 10/06/2020] [Indexed: 11/14/2022] Open
Abstract
While transcription factors (TFs) are known to regulate the expression of their target genes (TGs), only a weak correlation of expression between TFs and their TGs has generally been observed. As lack of correlation could be caused by additional layers of regulation, the overall correlation distribution may hide the presence of a subset of regulatory TF-TG pairs with tight expression coupling. Using reported regulatory pairs in the plant Arabidopsis thaliana along with comprehensive gene expression information and testing a wide array of molecular features, we aimed to discern the molecular determinants of high expression correlation of TFs and their TGs. TF-family assignment, stress-response process involvement, short genomic distances of the TF-binding sites to the transcription start site of their TGs, few required protein-protein-interaction connections to establish physical interactions between the TF and polymerase-II, unambiguous TF-binding motifs, increased numbers of miRNA target-sites in TF-mRNAs, and a young evolutionary age of TGs were found particularly indicative of high TF-TG correlation. The modulating roles of post-transcriptional, post-translational processes, and epigenetic factors have been characterized as well. Our study reveals that regulatory pairs with high expression coupling are associated with specific molecular determinants.
Collapse
Affiliation(s)
- Adam B Zaborowski
- Max Planck Institute of Molecular Plant Physiology, Am Mühlenberg 1, 14476 Potsdam-Golm, Germany
| | - Dirk Walther
- Max Planck Institute of Molecular Plant Physiology, Am Mühlenberg 1, 14476 Potsdam-Golm, Germany
| |
Collapse
|
5
|
Lim H, Xie L. Target Gene Prediction of Transcription Factor Using a New Neighborhood-regularized Tri-factorization One-class Collaborative Filtering Algorithm. ACM-BCB ... ... : THE ... ACM CONFERENCE ON BIOINFORMATICS, COMPUTATIONAL BIOLOGY AND BIOMEDICINE. ACM CONFERENCE ON BIOINFORMATICS, COMPUTATIONAL BIOLOGY AND BIOMEDICINE 2019; 2018:1-10. [PMID: 31061989 DOI: 10.1145/3233547.3233551] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
Abstract
Identifying the target genes of transcription factors (TFs) is one of the key factors to understand transcriptional regulation. However, our understanding of genome-wide TF targeting profile is limited due to the cost of large scale experiments and intrinsic complexity. Thus, computational prediction methods are useful to predict the unobserved associations. Here, we developed a new one-class collaborative filtering algorithm tREMAP that is based on regularized, weighted nonnegative matrix tri-factorization. The algorithm predicts unobserved target genes for TFs using known gene-TF associations and protein-protein interaction network. Our benchmark study shows that tREMAP significantly outperforms its counterpart REMAP, a bi-factorization-based algorithm, for transcription factor target gene prediction in all four performance metrics AUC, MAP, MPR, and HLU. When evaluated by independent data sets, the prediction accuracy is 37.8% on the top 495 predicted associations, an enrichment factor of 4.19 compared with the random guess. Furthermore, many of the predicted novel associations by tREMAP are supported by evidence from literature. Although we only use canonical TF-target gene interaction data in this study, tREMAP can be directly applied to tissue-specific data sets. tREMAP provides a framework to integrate multiple omics data for the further improvement of TF target gene prediction. Thus, tREMAP is a potentially useful tool in studying gene regulatory networks. The benchmark data set and the source code of tREMAP are freely available at https://github.com/hansaimlim/REMAP/tree/master/TriFacREMAP.
Collapse
Affiliation(s)
- Hansaim Lim
- PhD program in Biochemistry, Graduate Center of the City University of New York NY 10016 United States
| | - Lei Xie
- Department of Computer Science, Hunter College and Graduate Center, the City University of New York NY 10065 United States
| |
Collapse
|
6
|
Takahashi H, Kusuya Y, Hagiwara D, Takahashi-Nakaguchi A, Sakai K, Gonoi T. Global gene expression reveals stress-responsive genes in Aspergillus fumigatus mycelia. BMC Genomics 2017; 18:942. [PMID: 29202712 PMCID: PMC5715996 DOI: 10.1186/s12864-017-4316-z] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2017] [Accepted: 11/17/2017] [Indexed: 11/10/2022] Open
Abstract
Background Aspergillus fumigatus is a human fungal pathogen that causes aspergillosis in immunocompromised hosts. A. fumigatus is believed to be exposed to diverse environmental stresses in the host cells. The adaptation mechanisms are critical for infections in human bodies. Transcriptional networks in response to diverse environmental challenges remain to be elucidated. To gain insights into the adaptation to environmental stresses in A. fumigatus mycelia, we conducted time series transcriptome analyses. Results With the aid of RNA-seq, we explored the global gene expression profiles of mycelia in A. fumigatus upon exposure to diverse environmental changes, including heat, superoxide, and osmotic stresses. From the perspective of global transcriptomes, transient responses to superoxide and osmotic stresses were observed while responses to heat stresses were gradual. We identified the stress-responsive genes for particular stresses, and the 266 genes whose expression levels drastically fluctuated upon exposure to all tested stresses. Among these, the 77 environmental stress response genes are conserved in S. cerevisiae, suggesting that these genes might be more general prerequisites for adaptation to environmental stresses. Finally, we revealed the strong correlations among expression profiles of genes related to ‘rRNA processing’. Conclusions The time series transcriptome analysis revealed the stress-responsive genes underlying the adaptation mechanisms in A. fumigatus mycelia. These results will shed light on the regulatory networks underpinning the adaptation of the filamentous fungi. Electronic supplementary material The online version of this article (10.1186/s12864-017-4316-z) contains supplementary material, which is available to authorized users.
Collapse
Affiliation(s)
- Hiroki Takahashi
- Medical Mycology Research Center, Chiba University, 1-8-1 Inohana, Chuo-ku, Chiba, 260-8673, Japan. .,Molecular Chirality Research Center, Chiba University, 1-33 Yayoi-cho, Inage-ku, Chiba, 263-8522, Japan.
| | - Yoko Kusuya
- Medical Mycology Research Center, Chiba University, 1-8-1 Inohana, Chuo-ku, Chiba, 260-8673, Japan
| | - Daisuke Hagiwara
- Medical Mycology Research Center, Chiba University, 1-8-1 Inohana, Chuo-ku, Chiba, 260-8673, Japan
| | | | - Kanae Sakai
- Medical Mycology Research Center, Chiba University, 1-8-1 Inohana, Chuo-ku, Chiba, 260-8673, Japan
| | - Tohru Gonoi
- Medical Mycology Research Center, Chiba University, 1-8-1 Inohana, Chuo-ku, Chiba, 260-8673, Japan
| |
Collapse
|
7
|
Clustering and Differential Alignment Algorithm: Identification of Early Stage Regulators in the Arabidopsis thaliana Iron Deficiency Response. PLoS One 2015; 10:e0136591. [PMID: 26317202 PMCID: PMC4552565 DOI: 10.1371/journal.pone.0136591] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2015] [Accepted: 08/05/2015] [Indexed: 11/25/2022] Open
Abstract
Time course transcriptome datasets are commonly used to predict key gene regulators associated with stress responses and to explore gene functionality. Techniques developed to extract causal relationships between genes from high throughput time course expression data are limited by low signal levels coupled with noise and sparseness in time points. We deal with these limitations by proposing the Cluster and Differential Alignment Algorithm (CDAA). This algorithm was designed to process transcriptome data by first grouping genes based on stages of activity and then using similarities in gene expression to predict influential connections between individual genes. Regulatory relationships are assigned based on pairwise alignment scores generated using the expression patterns of two genes and some inferred delay between the regulator and the observed activity of the target. We applied the CDAA to an iron deficiency time course microarray dataset to identify regulators that influence 7 target transcription factors known to participate in the Arabidopsis thaliana iron deficiency response. The algorithm predicted that 7 regulators previously unlinked to iron homeostasis influence the expression of these known transcription factors. We validated over half of predicted influential relationships using qRT-PCR expression analysis in mutant backgrounds. One predicted regulator-target relationship was shown to be a direct binding interaction according to yeast one-hybrid (Y1H) analysis. These results serve as a proof of concept emphasizing the utility of the CDAA for identifying unknown or missing nodes in regulatory cascades, providing the fundamental knowledge needed for constructing predictive gene regulatory networks. We propose that this tool can be used successfully for similar time course datasets to extract additional information and infer reliable regulatory connections for individual genes.
Collapse
|
8
|
Spies D, Ciaudo C. Dynamics in Transcriptomics: Advancements in RNA-seq Time Course and Downstream Analysis. Comput Struct Biotechnol J 2015; 13:469-77. [PMID: 26430493 PMCID: PMC4564389 DOI: 10.1016/j.csbj.2015.08.004] [Citation(s) in RCA: 45] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2015] [Revised: 08/05/2015] [Accepted: 08/07/2015] [Indexed: 12/17/2022] Open
Abstract
Analysis of gene expression has contributed to a plethora of biological and medical research studies. Microarrays have been intensively used for the profiling of gene expression during diverse developmental processes, treatments and diseases. New massively parallel sequencing methods, often named as RNA-sequencing (RNA-seq) are extensively improving our understanding of gene regulation and signaling networks. Computational methods developed originally for microarrays analysis can now be optimized and applied to genome-wide studies in order to have access to a better comprehension of the whole transcriptome. This review addresses current challenges on RNA-seq analysis and specifically focuses on new bioinformatics tools developed for time series experiments. Furthermore, possible improvements in analysis, data integration as well as future applications of differential expression analysis are discussed.
Collapse
Affiliation(s)
- Daniel Spies
- Swiss Federal Institute of Technology Zurich, Department of Biology, Institute of Molecular Health Sciences, Zurich, Otto-Stern Weg 7, 8093 Zurich, Switzerland
- Life Science Zurich Graduate School, Molecular Life Science Program, University of Zurich, Institute of Molecular Life Sciences, Winterthurerstrasse 190, 8057 Zurich, Switzerland
| | - Constance Ciaudo
- Swiss Federal Institute of Technology Zurich, Department of Biology, Institute of Molecular Health Sciences, Zurich, Otto-Stern Weg 7, 8093 Zurich, Switzerland
| |
Collapse
|
9
|
Yang TH, Wu WS. Inferring functional transcription factor-gene binding pairs by integrating transcription factor binding data with transcription factor knockout data. BMC SYSTEMS BIOLOGY 2013; 7 Suppl 6:S13. [PMID: 24565265 PMCID: PMC4029220 DOI: 10.1186/1752-0509-7-s6-s13] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
Abstract
Background Chromatin immunoprecipitation (ChIP) experiments are now the most comprehensive experimental approaches for mapping the binding of transcription factors (TFs) to their target genes. However, ChIP data alone is insufficient for identifying functional binding target genes of TFs for two reasons. First, there is an inherent high false positive/negative rate in ChIP-chip or ChIP-seq experiments. Second, binding signals in the ChIP data do not necessarily imply functionality. Methods It is known that ChIP-chip data and TF knockout (TFKO) data reveal complementary information on gene regulation. While ChIP-chip data can provide TF-gene binding pairs, TFKO data can provide TF-gene regulation pairs. Therefore, we propose a novel network approach for identifying functional TF-gene binding pairs by integrating the ChIP-chip data with the TFKO data. In our method, a TF-gene binding pair from the ChIP-chip data is regarded to be functional if it also has high confident curated TFKO TF-gene regulatory relation or deduced hypostatic TF-gene regulatory relation. Results and conclusions We first validated our method on a gathered ground truth set. Then we applied our method to the ChIP-chip data to identify functional TF-gene binding pairs. The biological significance of our identified functional TF-gene binding pairs was shown by assessing their functional enrichment, the prevalence of protein-protein interaction, and expression coherence. Our results outperformed the results of three existing methods across all measures. And our identified functional targets of TFs also showed statistical significance over the randomly assigned TF-gene pairs. We also showed that our method is dataset independent and can apply to ChIP-seq data and the E. coli genome. Finally, we provided an example showing the biological applicability of our notion.
Collapse
|
10
|
Wang S, Sun H, Ma J, Zang C, Wang C, Wang J, Tang Q, Meyer CA, Zhang Y, Liu XS. Target analysis by integration of transcriptome and ChIP-seq data with BETA. Nat Protoc 2013; 8:2502-15. [PMID: 24263090 DOI: 10.1038/nprot.2013.150] [Citation(s) in RCA: 324] [Impact Index Per Article: 29.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The combination of ChIP-seq and transcriptome analysis is a compelling approach to unravel the regulation of gene expression. Several recently published methods combine transcription factor (TF) binding and gene expression for target prediction, but few of them provide an efficient software package for the community. Binding and expression target analysis (BETA) is a software package that integrates ChIP-seq of TFs or chromatin regulators with differential gene expression data to infer direct target genes. BETA has three functions: (i) to predict whether the factor has activating or repressive function; (ii) to infer the factor's target genes; and (iii) to identify the motif of the factor and its collaborators, which might modulate the factor's activating or repressive function. Here we describe the implementation and features of BETA to demonstrate its application to several data sets. BETA requires ~1 GB of RAM, and the procedure takes 20 min to complete. BETA is available open source at http://cistrome.org/BETA/.
Collapse
Affiliation(s)
- Su Wang
- Department of Bioinformatics, School of Life Science and Technology, Tongji University, Shanghai, China
| | | | | | | | | | | | | | | | | | | |
Collapse
|
11
|
Redestig H, Costa IG. Detection and interpretation of metabolite-transcript coresponses using combined profiling data. ACTA ACUST UNITED AC 2011; 27:i357-65. [PMID: 21685093 PMCID: PMC3117345 DOI: 10.1093/bioinformatics/btr231] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/29/2023]
Abstract
Motivation: Studying the interplay between gene expression and metabolite levels can yield important information on the physiology of stress responses and adaptation strategies. Performing transcriptomics and metabolomics in parallel during time-series experiments represents a systematic way to gain such information. Several combined profiling datasets have been added to the public domain and they form a valuable resource for hypothesis generating studies. Unfortunately, detecting coresponses between transcript levels and metabolite abundances is non-trivial: they cannot be assumed to overlap directly with underlying biochemical pathways and they may be subject to time delays and obscured by considerable noise. Results: Our aim was to predict pathway comemberships between metabolites and genes based on their coresponses to applied stress. We found that in the presence of strong noise and time-shifted responses, a hidden Markov model-based similarity outperforms the simpler Pearson correlation but performs comparably or worse in their absence. Therefore, we propose a supervised method that applies pathway information to summarize similarity statistics to a consensus statistic that is more informative than any of the single measures. Using four combined profiling datasets, we show that comembership between metabolites and genes can be predicted for numerous KEGG pathways; this opens opportunities for the detection of transcriptionally regulated pathways and novel metabolically related genes. Availability: A command-line software tool is available at http://www.cin.ufpe.br/~igcf/Metabolites. Contact:henning@psc.riken.jp; igcf@cin.ufpe.br Supplementary information:Supplementary data are available at Bioinformatics online.
Collapse
|
12
|
Michaelson JJ, Trump S, Rudzok S, Gräbsch C, Madureira DJ, Dautel F, Mai J, Attinger S, Schirmer K, von Bergen M, Lehmann I, Beyer A. Transcriptional signatures of regulatory and toxic responses to benzo-[a]-pyrene exposure. BMC Genomics 2011; 12:502. [PMID: 21995607 PMCID: PMC3215681 DOI: 10.1186/1471-2164-12-502] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2011] [Accepted: 10/13/2011] [Indexed: 01/01/2023] Open
Abstract
Background Small molecule ligands often have multiple effects on the transcriptional program of a cell: they trigger a receptor specific response and additional, indirect responses ("side effects"). Distinguishing those responses is important for understanding side effects of drugs and for elucidating molecular mechanisms of toxic chemicals. Results We explored this problem by exposing cells to the environmental contaminant benzo-[a]-pyrene (B[a]P). B[a]P exposure activates the aryl hydrocarbon receptor (Ahr) and causes toxic stress resulting in transcriptional changes that are not regulated through Ahr. We sought to distinguish these two types of responses based on a time course of expression changes measured after B[a]P exposure. Using Random Forest machine learning we classified 81 primary Ahr responders and 1,308 genes regulated as side effects. Subsequent weighted clustering gave further insight into the connection between expression pattern, mode of regulation, and biological function. Finally, the accuracy of the predictions was supported through extensive experimental validation. Conclusion Using a combination of machine learning followed by extensive experimental validation, we have further expanded the known catalog of genes regulated by the environmentally sensitive transcription factor Ahr. More broadly, this study presents a strategy for distinguishing receptor-dependent responses and side effects based on expression time courses.
Collapse
Affiliation(s)
- Jacob J Michaelson
- Cellular Networks and Systems Biology, Biotechnology Center, TU Dresden, Dresden, Germany
| | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
13
|
Caldana C, Degenkolbe T, Cuadros-Inostroza A, Klie S, Sulpice R, Leisse A, Steinhauser D, Fernie AR, Willmitzer L, Hannah MA. High-density kinetic analysis of the metabolomic and transcriptomic response of Arabidopsis to eight environmental conditions. THE PLANT JOURNAL : FOR CELL AND MOLECULAR BIOLOGY 2011; 67:869-84. [PMID: 21575090 DOI: 10.1111/j.1365-313x.2011.04640.x] [Citation(s) in RCA: 166] [Impact Index Per Article: 12.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/22/2023]
Abstract
The time-resolved response of Arabidopsis thaliana towards changing light and/or temperature at the transcriptome and metabolome level is presented. Plants grown at 21°C with a light intensity of 150 μE m⁻² sec⁻¹ were either kept at this condition or transferred into seven different environments (4°C, darkness; 21°C, darkness; 32°C, darkness; 4°C, 85 μE m⁻² sec⁻¹; 21 °C, 75 μE m⁻² sec⁻¹; 21°C, 300 μE m⁻² sec⁻¹ ; 32°C, 150 μE m⁻² sec⁻¹). Samples were taken before (0 min) and at 22 time points after transfer resulting in (8×) 22 time points covering both a linear and a logarithmic time series totaling 177 states. Hierarchical cluster analysis shows that individual conditions (defined by temperature and light) diverge into distinct trajectories at condition-dependent times and that the metabolome follows different kinetics from the transcriptome. The metabolic responses are initially relatively faster when compared with the transcriptional responses. Gene Ontology over-representation analysis identifies a common response for all changed conditions at the transcriptome level during the early response phase (5-60 min). Metabolic networks reconstructed via metabolite-metabolite correlations reveal extensive environment-specific rewiring. Detailed analysis identifies conditional connections between amino acids and intermediates of the tricarboxylic acid cycle. Parallel analysis of transcriptional changes strongly support a model where in the absence of photosynthesis at normal/high temperatures protein degradation occurs rapidly and subsequent amino acid catabolism serves as the main cellular energy supply. These results thus demonstrate the engagement of the electron transfer flavoprotein system under short-term environmental perturbations.
Collapse
Affiliation(s)
- Camila Caldana
- Max Planck Institute of Molecular Plant Physiology, Am Mühlenberg 1, 14476 Potsdam, Germany
| | | | | | | | | | | | | | | | | | | |
Collapse
|
14
|
Uncovering the transcriptional circuitry in skeletal muscle regeneration. Mamm Genome 2011; 22:272-81. [PMID: 21509518 DOI: 10.1007/s00335-011-9322-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2010] [Accepted: 03/07/2011] [Indexed: 02/04/2023]
Abstract
Skeletal muscle has a remarkable ability to regenerate after repeated and complete destruction of the tissue. The healing phases for an injured muscle undergo an activation program controlled by a dynamically inducible transcriptional regulatory network. Mapping a complex mammalian transcriptional network is confronted by significant challenges and requires the integration of multiple experimental data types. In this work we present a system approach to describe the transcriptional circuitry during skeletal muscle regeneration using time-course expression data and motif scanning information. Time-lagged correlation analysis was utilized to evaluate the transcription factor (TF) → target associations. Our analysis identified six TFs that potentially play a central role throughout the regeneration process. Four of them have previously been described to be important for muscle regeneration and differentiation. The remaining two TFs are identified as novel regulators that may have a role in the regeneration process. We hope that our work may provide useful clues to help accelerate the recovery process in injured skeletal muscle.
Collapse
|
15
|
Hafemeister C, Costa IG, Schönhuth A, Schliep A. Classifying short gene expression time-courses with Bayesian estimation of piecewise constant functions. ACTA ACUST UNITED AC 2011; 27:946-52. [PMID: 21266444 DOI: 10.1093/bioinformatics/btr037] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
MOTIVATION Analyzing short time-courses is a frequent and relevant problem in molecular biology, as, for example, 90% of gene expression time-course experiments span at most nine time-points. The biological or clinical questions addressed are elucidating gene regulation by identification of co-expressed genes, predicting response to treatment in clinical, trial-like settings or classifying novel toxic compounds based on similarity of gene expression time-courses to those of known toxic compounds. The latter problem is characterized by irregular and infrequent sample times and a total lack of prior assumptions about the incoming query, which comes in stark contrast to clinical settings and requires to implicitly perform a local, gapped alignment of time series. The current state-of-the-art method (SCOW) uses a variant of dynamic time warping and models time series as higher order polynomials (splines). RESULTS We suggest to model time-courses monitoring response to toxins by piecewise constant functions, which are modeled as left-right Hidden Markov Models. A Bayesian approach to parameter estimation and inference helps to cope with the short, but highly multivariate time-courses. We improve prediction accuracy by 7% and 4%, respectively, when classifying toxicology and stress response data. We also reduce running times by at least a factor of 140; note that reasonable running times are crucial when classifying response to toxins. In conclusion, we have demonstrated that appropriate reduction of model complexity can result in substantial improvements both in classification performance and running time. AVAILABILITY A Python package implementing the methods described is freely available under the GPL from http://bioinformatics.rutgers.edu/Software/MVQueries/.
Collapse
Affiliation(s)
- Christoph Hafemeister
- Department of Computational Molecular Biology, Max Planck Institute for Molecular Genetics, Berlin, Germany.
| | | | | | | |
Collapse
|
16
|
Takahashi H, Morioka R, Ito R, Oshima T, Altaf-Ul-Amin M, Ogasawara N, Kanaya S. Dynamics of time-lagged gene-to-metabolite networks of Escherichia coli elucidated by integrative omics approach. OMICS-A JOURNAL OF INTEGRATIVE BIOLOGY 2010; 15:15-23. [PMID: 20863252 DOI: 10.1089/omi.2010.0074] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/24/2023]
Abstract
In the postgenomics era, integrative analysis of several "omics" data is absolutely required for understanding the cell as a system. Integrative analysis of transcriptomics and metabolomics can lead to elucidation of gene-to-metabolite networks. When integrating different time series "omics" data, it is necessary to take into consideration a time lag between those data. In the present study, we conducted an integrative analysis of time series transcriptomics and metabolomics data of Escherichia coli generated by cDNA microarray and Fourier transform ion cyclotron resonance mass spectrometry (FT-ICR/MS), respectively. We identified a 60-min time lag between transition points of transcriptomics and metabolomics data by using a Linear Dynamical System. Furthermore, we investigated gene-to-metabolite correlations in the context of time lag, obtained the maximum number of correlated pairs at transcripts leading 60-min time lag, and finally revealed gene-to-metabolite relations in the phospholipid biosynthesis pathway. Taking into consideration the time lag between transcriptomics and metabolomics data in time series analysis could unravel novel gene-to-metabolite relations. According to gene-to-metabolite correlations, phosphatidylglycerol plays a more critical role for membrane balance than phosphatidylethanolamine in E. coli.
Collapse
Affiliation(s)
- Hiroki Takahashi
- Department of Bioinformatics and Genomics, Graduate School of Information Science, Nara Institute of Science and Technology, Nara, Japan
| | | | | | | | | | | | | |
Collapse
|
17
|
Kiełbasa SM, Blüthgen N, Fähling M, Mrowka R. Targetfinder.org: a resource for systematic discovery of transcription factor target genes. Nucleic Acids Res 2010; 38:W233-8. [PMID: 20460454 PMCID: PMC2896086 DOI: 10.1093/nar/gkq374] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2023] Open
Abstract
Targetfinder.org (http://targetfinder.org/) provides a web-based resource for finding genes that show a similar expression pattern to a group of user-selected genes. It is based on a large-scale gene expression compendium (>1200 experiments, >13 000 genes). The primary application of Targetfinder.org is to expand a list of known transcription factor targets by new candidate target genes. The user submits a group of genes (the ‘seed’), and as a result the web site provides a list of other genes ranked by similarity of their expression to the expression of the seed genes. Additionally, the web site provides information on a recovery/cross-validation test to check for consistency of the provided seed and the quality of the ranking. Furthermore, the web site allows to analyse affinities of a selected transcription factor to the promoter regions of the top-ranked genes in order to select the best new candidate target genes for further experimental analysis.
Collapse
Affiliation(s)
- Szymon M. Kiełbasa
- Max Planck Institute of Molecular Genetics, Ihnestraße 73, D-14195 Berlin, Institute of Pathology, Institute of Theoretical Biology, Charité Universitätsmedizin Berlin, Charitéplatz 1 and Institute of Physiology, AG Systems Biology, Charité Universitätsmedizin Berlin, Tucholskystr. 2, D-10117 Berlin, Germany
- *To whom correspondence should be addressed. Tel: +49 30 8413 1169; Fax: +49 30 8413 1152;
| | - Nils Blüthgen
- Max Planck Institute of Molecular Genetics, Ihnestraße 73, D-14195 Berlin, Institute of Pathology, Institute of Theoretical Biology, Charité Universitätsmedizin Berlin, Charitéplatz 1 and Institute of Physiology, AG Systems Biology, Charité Universitätsmedizin Berlin, Tucholskystr. 2, D-10117 Berlin, Germany
| | - Michael Fähling
- Max Planck Institute of Molecular Genetics, Ihnestraße 73, D-14195 Berlin, Institute of Pathology, Institute of Theoretical Biology, Charité Universitätsmedizin Berlin, Charitéplatz 1 and Institute of Physiology, AG Systems Biology, Charité Universitätsmedizin Berlin, Tucholskystr. 2, D-10117 Berlin, Germany
| | - Ralf Mrowka
- Max Planck Institute of Molecular Genetics, Ihnestraße 73, D-14195 Berlin, Institute of Pathology, Institute of Theoretical Biology, Charité Universitätsmedizin Berlin, Charitéplatz 1 and Institute of Physiology, AG Systems Biology, Charité Universitätsmedizin Berlin, Tucholskystr. 2, D-10117 Berlin, Germany
| |
Collapse
|
18
|
Nero D, Katari MS, Kelfer J, Tranchina D, Coruzzi GM. In silico evaluation of predicted regulatory interactions in Arabidopsis thaliana. BMC Bioinformatics 2009; 10:435. [PMID: 20025756 PMCID: PMC2803859 DOI: 10.1186/1471-2105-10-435] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2009] [Accepted: 12/21/2009] [Indexed: 01/18/2023] Open
Abstract
Background Prediction of transcriptional regulatory mechanisms in Arabidopsis has become increasingly critical with the explosion of genomic data now available for both gene expression and gene sequence composition. We have shown in previous work [1], that a combination of correlation measurements and cis-regulatory element (CRE) detection methods are effective in predicting targets for candidate transcription factors for specific case studies which were validated. However, to date there has been no quantitative assessment as to which correlation measures or CRE detection methods used alone or in combination are most effective in predicting TF→target relationships on a genome-wide scale. Results We tested several widely used methods, based on correlation (Pearson and Spearman Rank correlation) and cis-regulatory element (CRE) detection (≥1 CRE or CRE over-representation), to determine which of these methods individually or in combination is the most effective by various measures for making regulatory predictions. To predict the regulatory targets of a transcription factor (TF) of interest, we applied these methods to microarray expression data for genes that were regulated over treatment and control conditions in wild type (WT) plants. Because the chosen data sets included identical experimental conditions used on TF over-expressor or T-DNA knockout plants, we were able to test the TF→target predictions made using microarray data from WT plants, with microarray data from mutant/transgenic plants. For each method, or combination of methods, we computed sensitivity, specificity, positive and negative predictive value and the F-measure of balance between sensitivity and positive predictive value (precision). This analysis revealed that the ≥1 CRE and Spearman correlation (used alone or in combination) were the most balanced CRE detection and correlation methods, respectively with regard to their power to accurately predict regulatory-target interactions. Conclusion These findings provide an approach and guidance for researchers interested in predicting transcriptional regulatory mechanisms using microarray data that they generate (or microarray data that is publically available) combined with CRE detection in promoter sequence data.
Collapse
Affiliation(s)
- Damion Nero
- Department of Biology, New York University, Center for Genomics and Systems Biology, New York, NY 10003, USA.
| | | | | | | | | |
Collapse
|
19
|
Schmeier S, MacPherson CR, Essack M, Kaur M, Schaefer U, Suzuki H, Hayashizaki Y, Bajic VB. Deciphering the transcriptional circuitry of microRNA genes expressed during human monocytic differentiation. BMC Genomics 2009; 10:595. [PMID: 20003307 PMCID: PMC2797535 DOI: 10.1186/1471-2164-10-595] [Citation(s) in RCA: 60] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2008] [Accepted: 12/10/2009] [Indexed: 12/19/2022] Open
Abstract
Background Macrophages are immune cells involved in various biological processes including host defence, homeostasis, differentiation, and organogenesis. Disruption of macrophage biology has been linked to increased pathogen infection, inflammation and malignant diseases. Differential gene expression observed in monocytic differentiation is primarily regulated by interacting transcription factors (TFs). Current research suggests that microRNAs (miRNAs) degrade and repress translation of mRNA, but also may target genes involved in differentiation. We focus on getting insights into the transcriptional circuitry regulating miRNA genes expressed during monocytic differentiation. Results We computationally analysed the transcriptional circuitry of miRNA genes during monocytic differentiation using in vitro time-course expression data for TFs and miRNAs. A set of TF→miRNA associations was derived from predicted TF binding sites in promoter regions of miRNA genes. Time-lagged expression correlation analysis was utilised to evaluate the TF→miRNA associations. Our analysis identified 12 TFs that potentially play a central role in regulating miRNAs throughout the differentiation process. Six of these 12 TFs (ATF2, E2F3, HOXA4, NFE2L1, SP3, and YY1) have not previously been described to be important for monocytic differentiation. The remaining six TFs are CEBPB, CREB1, ELK1, NFE2L2, RUNX1, and USF2. For several miRNAs (miR-21, miR-155, miR-424, and miR-17-92), we show how their inferred transcriptional regulation impacts monocytic differentiation. Conclusions The study demonstrates that miRNAs and their transcriptional regulatory control are integral molecular mechanisms during differentiation. Furthermore, it is the first study to decipher on a large-scale, how miRNAs are controlled by TFs during human monocytic differentiation. Subsequently, we have identified 12 candidate key controllers of miRNAs during this differentiation process.
Collapse
Affiliation(s)
- Sebastian Schmeier
- South African National Bioinformatics Institute, University of the Western Cape, Modderdam Road, Bellville, South Africa.
| | | | | | | | | | | | | | | |
Collapse
|
20
|
Barakat A, DiLoreto DS, Zhang Y, Smith C, Baier K, Powell WA, Wheeler N, Sederoff R, Carlson JE. Comparison of the transcriptomes of American chestnut (Castanea dentata) and Chinese chestnut (Castanea mollissima) in response to the chestnut blight infection. BMC PLANT BIOLOGY 2009; 9:51. [PMID: 19426529 PMCID: PMC2688492 DOI: 10.1186/1471-2229-9-51] [Citation(s) in RCA: 96] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/27/2008] [Accepted: 05/09/2009] [Indexed: 05/07/2023]
Abstract
UNLABELLED BACKGROUND1471-2229-9-51: American chestnut (Castanea dentata) was devastated by an exotic pathogen in the beginning of the twentieth century. This chestnut blight is caused by Cryphonectria parasitica, a fungus that infects stem tissues and kills the trees by girdling them. Because of the great economic and ecological value of this species, significant efforts have been made over the century to combat this disease, but it wasn't until recently that a focused genomics approach was initiated. Prior to the Genomic Tool Development for the Fagaceae project, genomic resources available in public databases for this species were limited to a few hundred ESTs. To identify genes involved in resistance to C. parasitica, we have sequenced the transcriptome from fungal infected and healthy stem tissues collected from blight-sensitive American chestnut and blight-resistant Chinese chestnut (Castanea mollissima) trees using ultra high throughput pyrosequencing. RESULTS We produced over a million 454 reads, totaling over 250 million bp, from which we generated 40,039 and 28,890 unigenes in total from C. mollissima and C. dentata respectively. The functions of the unigenes, from GO annotation, cover a diverse set of molecular functions and biological processes, among which we identified a large number of genes associated with resistance to stresses and response to biotic stimuli. In silico expression analyses showed that many of the stress response unigenes were expressed more in canker tissues versus healthy stem tissues in both American and Chinese chestnut. Comparative analysis also identified genes belonging to different pathways of plant defense against biotic stresses that are differentially expressed in either American or Chinese chestnut canker tissues. CONCLUSION Our study resulted in the identification of a large set of cDNA unigenes from American chestnut and Chinese chestnut. The ESTs and unigenes from this study constitute an important resource to the scientific community interested in the discovery of genes involved in various biological processes in Chestnut and other species. The identification of many defense-related genes differentially expressed in canker vs. healthy stem in chestnuts provides many new candidate genes for developing resistance to the chestnut blight and for studying pathways involved in responses of trees to necrotrophic pathogens. We also identified several candidate genes that may underline the difference in resistance to Cryphonectria parasitica between American chestnut and Chinese chestnut.
Collapse
Affiliation(s)
- Abdelali Barakat
- The School of Forest Resources, Department of Horticulture, The Huck Institutes of the Life Sciences, The Pennsylvania State University, 323 Forest Resources Building, University Park, PA 16802, USA
| | - Denis S DiLoreto
- The School of Forest Resources, Department of Horticulture, The Huck Institutes of the Life Sciences, The Pennsylvania State University, 323 Forest Resources Building, University Park, PA 16802, USA
| | - Yi Zhang
- The School of Forest Resources, Department of Horticulture, The Huck Institutes of the Life Sciences, The Pennsylvania State University, 323 Forest Resources Building, University Park, PA 16802, USA
| | - Chris Smith
- Forest Biotechnology Group, North Carolina State University, Raleigh, North Carolina 27695, USA
| | - Kathleen Baier
- Department of Environmental Science and Forestry, State University of New York, Syracuse, NY, USA
| | - William A Powell
- Department of Environmental Science and Forestry, State University of New York, Syracuse, NY, USA
| | - Nicholas Wheeler
- Forest Biotechnology Group, North Carolina State University, Raleigh, North Carolina 27695, USA
| | - Ron Sederoff
- Forest Biotechnology Group, North Carolina State University, Raleigh, North Carolina 27695, USA
| | - John E Carlson
- The School of Forest Resources, Department of Horticulture, The Huck Institutes of the Life Sciences, The Pennsylvania State University, 323 Forest Resources Building, University Park, PA 16802, USA
| |
Collapse
|
21
|
Wang S, Yang S, Yin Y, Guo X, Wang S, Hao D. An in silico strategy identified the target gene candidates regulated by dehydration responsive element binding proteins (DREBs) in Arabidopsis genome. PLANT MOLECULAR BIOLOGY 2009; 69:167-78. [PMID: 18931920 DOI: 10.1007/s11103-008-9414-5] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/20/2008] [Accepted: 10/01/2008] [Indexed: 05/23/2023]
Abstract
Identification of downstream target genes of stress-relating transcription factors (TFs) is desirable in understanding cellular responses to various environmental stimuli. However, this has long been a difficult work for both experimental and computational practices. In this research, we presented a novel computational strategy which combined the analysis of the transcription factor binding site (TFBS) contexts and machine learning approach. Using this strategy, we conducted a genome-wide investigation into novel direct target genes of dehydration responsive element binding proteins (DREBs), the members of AP2-EREBPs transcription factor super family which is reported to be responsive to various abiotic stresses in Arabidopsis. The genome-wide searching yielded in total 474 target gene candidates. With reference to the microarray data for abiotic stresses-inducible gene expression profile, 268 target gene candidates out of the total 474 genes predicted, were induced during the 24-h exposure to abiotic stresses. This takes about 57% of total predicted targets. Furthermore, GO annotations revealed that these target genes are likely involved in protein amino acid phosphorylation, protein binding and Endomembrane sorting system. The results suggested that the predicted target gene candidates were adequate to meet the essential biological principle of stress-resistance in plants.
Collapse
Affiliation(s)
- Shichen Wang
- College of Animal Science and Veterinary Medicine, Jilin University, Changchun 130062, People's Republic of China
| | | | | | | | | | | |
Collapse
|
22
|
Wang X, Wu M, Li Z, Chan C. Short time-series microarray analysis: methods and challenges. BMC SYSTEMS BIOLOGY 2008; 2:58. [PMID: 18605994 PMCID: PMC2474593 DOI: 10.1186/1752-0509-2-58] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/13/2008] [Accepted: 07/07/2008] [Indexed: 01/01/2023]
Abstract
The detection and analysis of steady-state gene expression has become routine. Time-series microarrays are of growing interest to systems biologists for deciphering the dynamic nature and complex regulation of biosystems. Most temporal microarray data only contain a limited number of time points, giving rise to short-time-series data, which imposes challenges for traditional methods of extracting meaningful information. To obtain useful information from the wealth of short-time series data requires addressing the problems that arise due to limited sampling. Current efforts have shown promise in improving the analysis of short time-series microarray data, although challenges remain. This commentary addresses recent advances in methods for short-time series analysis including simplification-based approaches and the integration of multi-source information. Nevertheless, further studies and development of computational methods are needed to provide practical solutions to fully exploit the potential of this data.
Collapse
Affiliation(s)
- Xuewei Wang
- Department of Chemical Engineering and Material Science, Michigan State University, East Lansing, MI 48824, USA.
| | | | | | | |
Collapse
|