1
|
Zhang J, Liu L, Wei X, Zhao C, Luo Y, Li J, Le TD. Scanning sample-specific miRNA regulation from bulk and single-cell RNA-sequencing data. BMC Biol 2024; 22:218. [PMID: 39334271 PMCID: PMC11438147 DOI: 10.1186/s12915-024-02020-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2024] [Accepted: 09/24/2024] [Indexed: 09/30/2024] Open
Abstract
BACKGROUND RNA-sequencing technology provides an effective tool for understanding miRNA regulation in complex human diseases, including cancers. A large number of computational methods have been developed to make use of bulk and single-cell RNA-sequencing data to identify miRNA regulations at the resolution of multiple samples (i.e. group of cells or tissues). However, due to the heterogeneity of individual samples, there is a strong need to infer miRNA regulation specific to individual samples to uncover miRNA regulation at the single-sample resolution level. RESULTS Here, we develop a framework, Scan, for scanning sample-specific miRNA regulation. Since a single network inference method or strategy cannot perform well for all types of new data, Scan incorporates 27 network inference methods and two strategies to infer tissue-specific or cell-specific miRNA regulation from bulk or single-cell RNA-sequencing data. Results on bulk and single-cell RNA-sequencing data demonstrate the effectiveness of Scan in inferring sample-specific miRNA regulation. Moreover, we have found that incorporating the prior information of miRNA targets can generally improve the accuracy of miRNA target prediction. In addition, Scan can contribute to construct cell/tissue correlation networks and recover aggregate miRNA regulatory networks. Finally, the comparison results have shown that the performance of network inference methods is likely to be data-specific, and selecting optimal network inference methods is required for more accurate prediction of miRNA targets. CONCLUSIONS Scan provides a useful method to help infer sample-specific miRNA regulation for new data, benchmark new network inference methods and deepen the understanding of miRNA regulation at the resolution of individual samples.
Collapse
Affiliation(s)
- Junpeng Zhang
- School of Engineering, Dali University, Dali, 671003, Yunnan, China.
| | - Lin Liu
- UniSA STEM, University of South Australia, Mawson Lakes, SA, 5095, Australia
| | - Xuemei Wei
- School of Engineering, Dali University, Dali, 671003, Yunnan, China
| | - Chunwen Zhao
- School of Engineering, Dali University, Dali, 671003, Yunnan, China
| | - Yanbi Luo
- School of Engineering, Dali University, Dali, 671003, Yunnan, China
| | - Jiuyong Li
- UniSA STEM, University of South Australia, Mawson Lakes, SA, 5095, Australia
| | - Thuc Duy Le
- UniSA STEM, University of South Australia, Mawson Lakes, SA, 5095, Australia.
| |
Collapse
|
2
|
Machine Learning Based Methods and Best Practices of microRNA-Target Prediction and Validation. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2022; 1385:109-131. [DOI: 10.1007/978-3-031-08356-3_4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
3
|
Shaker F, Nikravesh A, Arezumand R, Aghaee-Bakhtiari SH. Web-based tools for miRNA studies analysis. Comput Biol Med 2020; 127:104060. [DOI: 10.1016/j.compbiomed.2020.104060] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2020] [Revised: 10/12/2020] [Accepted: 10/12/2020] [Indexed: 02/07/2023]
|
4
|
Garcia-Moreno A, Carmona-Saez P. Computational Methods and Software Tools for Functional Analysis of miRNA Data. Biomolecules 2020; 10:biom10091252. [PMID: 32872205 PMCID: PMC7563698 DOI: 10.3390/biom10091252] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2020] [Revised: 08/24/2020] [Accepted: 08/26/2020] [Indexed: 12/15/2022] Open
Abstract
miRNAs are important regulators of gene expression that play a key role in many biological processes. High-throughput techniques allow researchers to discover and characterize large sets of miRNAs, and enrichment analysis tools are becoming increasingly important in decoding which miRNAs are implicated in biological processes. Enrichment analysis of miRNA targets is the standard technique for functional analysis, but this approach carries limitations and bias; alternatives are currently being proposed, based on direct and curated annotations. In this review, we describe the two workflows of miRNAs enrichment analysis, based on target gene or miRNA annotations, highlighting statistical tests, software tools, up-to-date databases, and functional annotations resources in the study of metazoan miRNAs.
Collapse
Affiliation(s)
- Adrian Garcia-Moreno
- Bioinformatics Unit, Centre for Genomics and Oncological Research (GENyO)—Pfizer/University of Granada/Andalusian Regional Government, PTS Granada, 18016 Granada, Spain;
| | - Pedro Carmona-Saez
- Bioinformatics Unit, Centre for Genomics and Oncological Research (GENyO)—Pfizer/University of Granada/Andalusian Regional Government, PTS Granada, 18016 Granada, Spain;
- Department of Statistics, University of Granada, 18071 Granada, Spain
- Correspondence:
| |
Collapse
|
5
|
Wang P, Li Q, Sun N, Gao Y, Liu JS, Deng K, He J. MiRACLe: an individual-specific approach to improve microRNA-target prediction based on a random contact model. Brief Bioinform 2020; 22:5868068. [PMID: 34020537 DOI: 10.1093/bib/bbaa117] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2020] [Revised: 04/30/2020] [Accepted: 05/16/2020] [Indexed: 12/13/2022] Open
Abstract
Deciphering microRNA (miRNA) targets is important for understanding the function of miRNAs as well as miRNA-based diagnostics and therapeutics. Given the highly cell-specific nature of miRNA regulation, recent computational approaches typically exploit expression data to identify the most physiologically relevant target messenger RNAs (mRNAs). Although effective, those methods usually require a large sample size to infer miRNA-mRNA interactions, thus limiting their applications in personalized medicine. In this study, we developed a novel miRNA target prediction algorithm called miRACLe (miRNA Analysis by a Contact modeL). It integrates sequence characteristics and RNA expression profiles into a random contact model, and determines the target preferences by relative probability of effective contacts in an individual-specific manner. Evaluation by a variety of measures shows that fitting TargetScan, a frequently used prediction tool, into the framework of miRACLe can improve its predictive power with a significant margin and consistently outperform other state-of-the-art methods in prediction accuracy, regulatory potential and biological relevance. Notably, the superiority of miRACLe is robust to various biological contexts, types of expression data and validation datasets, and the computation process is fast and efficient. Additionally, we show that the model can be readily applied to other sequence-based algorithms to improve their predictive power, such as DIANA-microT-CDS, miRanda-mirSVR and MirTarget4. MiRACLe is publicly available at https://github.com/PANWANG2014/miRACLe.
Collapse
Affiliation(s)
- Pan Wang
- Department of Thoracic Surgery, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Qi Li
- Center for Statistical Science & Department of Industry Engineering, Tsinghua University, Beijing, China
| | - Nan Sun
- Department of Thoracic Surgery, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Yibo Gao
- Department of Thoracic Surgery, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Jun S Liu
- Department of Statistics, Harvard University, Cambridge, MA, USA
| | - Ke Deng
- Center for Statistical Science & Department of Industry Engineering, Tsinghua University, Beijing, China
| | - Jie He
- Department of Thoracic Surgery, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| |
Collapse
|
6
|
Quillet A, Saad C, Ferry G, Anouar Y, Vergne N, Lecroq T, Dubessy C. Improving Bioinformatics Prediction of microRNA Targets by Ranks Aggregation. Front Genet 2020; 10:1330. [PMID: 32047509 PMCID: PMC6997536 DOI: 10.3389/fgene.2019.01330] [Citation(s) in RCA: 70] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2019] [Accepted: 12/05/2019] [Indexed: 12/18/2022] Open
Abstract
microRNAs are noncoding RNAs which downregulate a large number of target mRNAs and modulate cell activity. Despite continued progress, bioinformatics prediction of microRNA targets remains a challenge since available software still suffer from a lack of accuracy and sensitivity. Moreover, these tools show fairly inconsistent results from one another. Thus, in an attempt to circumvent these difficulties, we aggregated all human results of four important prediction algorithms (miRanda, PITA, SVmicrO, and TargetScan) showing additional characteristics in order to rerank them into a single list. Instead of deciding which prediction tool to use, our method clearly helps biologists getting the best microRNA target predictions from all aggregated databases. The resulting database is freely available through a webtool called miRabel1 which can take either a list of miRNAs, genes, or signaling pathways as search inputs. Receiver operating characteristic curves and precision-recall curves analysis carried out using experimentally validated data and very large data sets show that miRabel significantly improves the prediction of miRNA targets compared to the four algorithms used separately. Moreover, using the same analytical methods, miRabel shows significantly better predictions than other popular algorithms such as MBSTAR, miRWalk, ExprTarget and miRMap. Interestingly, an F-score analysis revealed that miRabel also significantly improves the relevance of the top results. The aggregation of results from different databases is therefore a powerful and generalizable approach to many other species to improve miRNA target predictions. Thus, miRabel is an efficient tool to guide biologists in their search for miRNA targets and integrate them into a biological context.
Collapse
Affiliation(s)
- Aurélien Quillet
- Normandie Univ, UNIROUEN, INSERM, Laboratoire Différenciation et Communication Neuronale et Neuroendocrine, Rouen, France
| | - Chadi Saad
- Normandie Univ, UNIROUEN, INSERM, Laboratoire Différenciation et Communication Neuronale et Neuroendocrine, Rouen, France
| | - Gaëtan Ferry
- Normandie Univ, UNIROUEN, UNIHAVRE, INSA Rouen, Laboratoire d'Informatique du Traitement de l'Information et des Systèmes, Rouen, France
| | - Youssef Anouar
- Normandie Univ, UNIROUEN, INSERM, Laboratoire Différenciation et Communication Neuronale et Neuroendocrine, Rouen, France
| | - Nicolas Vergne
- Normandie Univ, UNIROUEN, CNRS, Laboratoire de Mathématiques Raphaël Salem, Rouen, France
| | - Thierry Lecroq
- Normandie Univ, UNIROUEN, UNIHAVRE, INSA Rouen, Laboratoire d'Informatique du Traitement de l'Information et des Systèmes, Rouen, France
| | - Christophe Dubessy
- Normandie Univ, UNIROUEN, INSERM, Laboratoire Différenciation et Communication Neuronale et Neuroendocrine, Rouen, France
| |
Collapse
|
7
|
Data-driven discovery of causal interactions. INTERNATIONAL JOURNAL OF DATA SCIENCE AND ANALYTICS 2019. [DOI: 10.1007/s41060-018-0168-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
|
8
|
Le TD, Hoang T, Li J, Liu L, Liu H, Hu S. A Fast PC Algorithm for High Dimensional Causal Discovery with Multi-Core PCs. IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS 2019; 16:1483-1495. [PMID: 27429444 DOI: 10.1109/tcbb.2016.2591526] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Discovering causal relationships from observational data is a crucial problem and it has applications in many research areas. The PC algorithm is the state-of-the-art constraint based method for causal discovery. However, runtime of the PC algorithm, in the worst-case, is exponential to the number of nodes (variables), and thus it is inefficient when being applied to high dimensional data, e.g., gene expression datasets. On another note, the advancement of computer hardware in the last decade has resulted in the widespread availability of multi-core personal computers. There is a significant motivation for designing a parallelized PC algorithm that is suitable for personal computers and does not require end users' parallel computing knowledge beyond their competency in using the PC algorithm. In this paper, we develop parallel-PC, a fast and memory efficient PC algorithm using the parallel computing technique. We apply our method to a range of synthetic and real-world high dimensional datasets. Experimental results on a dataset from the DREAM 5 challenge show that the original PC algorithm could not produce any results after running more than 24 hours; meanwhile, our parallel-PC algorithm managed to finish within around 12 hours with a 4-core CPU computer, and less than six hours with a 8-core CPU computer. Furthermore, we integrate parallel-PC into a causal inference method for inferring miRNA-mRNA regulatory relationships. The experimental results show that parallel-PC helps improve both the efficiency and accuracy of the causal inference algorithm.
Collapse
|
9
|
Wilk G, Braun R. Integrative analysis reveals disrupted pathways regulated by microRNAs in cancer. Nucleic Acids Res 2019; 46:1089-1101. [PMID: 29294105 PMCID: PMC5814839 DOI: 10.1093/nar/gkx1250] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2017] [Accepted: 12/01/2017] [Indexed: 02/06/2023] Open
Abstract
MicroRNAs (miRNAs) are small endogenous regulatory molecules that modulate gene expression post-transcriptionally. Although differential expression of miRNAs have been implicated in many diseases (including cancers), the underlying mechanisms of action remain unclear. Because each miRNA can target multiple genes, miRNAs may potentially have functional implications for the overall behavior of entire pathways. Here, we investigate the functional consequences of miRNA dysregulation through an integrative analysis of miRNA and mRNA expression data using a novel approach that incorporates pathway information a priori. By searching for miRNA-pathway associations that differ between healthy and tumor tissue, we identify specific relationships at the systems level which are disrupted in cancer. Our approach is motivated by the hypothesis that if an miRNA and pathway are associated, then the expression of the miRNA and the collective behavior of the genes in a pathway will be correlated. As such, we first obtain an expression-based summary of pathway activity using Isomap, a dimension reduction method which can articulate non-linear structure in high-dimensional data. We then search for miRNAs that exhibit differential correlations with the pathway summary between phenotypes as a means of finding aberrant miRNA-pathway coregulation in tumors. We apply our method to cancer data using gene and miRNA expression datasets from The Cancer Genome Atlas and compare ∼105 miRNA-pathway relationships between healthy and tumor samples from four tissues (breast, prostate, lung and liver). Many of the flagged pairs we identify have a biological basis for disruption in cancer.
Collapse
Affiliation(s)
- Gary Wilk
- Department of Chemical and Biological Engineering, Northwestern University, Evanston, IL 60208, USA
| | - Rosemary Braun
- Biostatistics Division, Feinberg School of Medicine, Northwestern University, Chicago, IL 60611, USA.,Department of Engineering Sciences and Applied Mathematics, Northwestern University, Evanston, IL 60208, USA
| |
Collapse
|
10
|
Sedaghat N, Fathy M, Modarressi MH, Shojaie A. Combining Supervised and Unsupervised Learning for Improved miRNA Target Prediction. IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS 2018; 15:1594-1604. [PMID: 28715336 PMCID: PMC7001746 DOI: 10.1109/tcbb.2017.2727042] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
MicroRNAs (miRNAs) are short non-coding RNAs which bind to mRNAs and regulate their expression. MiRNAs have been found to be associated with initiation and progression of many complex diseases. Investigating miRNAs and their targets can thus help develop new therapies by designing anti-miRNA oligonucleotides. While existing computational approaches can predict miRNA targets, these predictions have low accuracy. In this paper, we propose a two-step approach to refine the results of sequence-based prediction algorithms. The first step, which is based on our previous work, uses an ensemble learning approach that combines multiple existing methods. The second step utilizes support vector machine (SVM) classifiers in one- and two-class modes to infer miRNA-mRNA interactions based on both binding features, as well as network features extracted from gene regulatory network. Experimental results using two real data sets from TCGA indicate that the use of two-class SVM classification significantly improves the precision of miRNA-mRNA prediction.
Collapse
|
11
|
Predicting miRNA targets for head and neck squamous cell carcinoma using an ensemble method. Int J Biol Markers 2018; 33:87-93. [PMID: 28665450 DOI: 10.5301/ijbm.5000285] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
Abstract
BACKGROUND This study aimed to uncover potential microRNA (miRNA) targets in head and neck squamous cell carcinoma (HNSCC) using an ensemble method which combined 3 different methods: Pearson's correlation coefficient (PCC), Lasso and a causal inference method (i.e., intervention calculus when the directed acyclic graph (DAG) is absent [IDA]), based on Borda count election. METHODS The Borda count election method was used to integrate the top 100 predicted targets of each miRNA generated by individual methods. Afterwards, to validate the performance ability of our method, we checked the TarBase v6.0, miRecords v2013, miRWalk v2.0 and miRTarBase v4.5 databases to validate predictions for miRNAs. Pathway enrichment analysis of target genes in the top 1,000 miRNA-messenger RNA (mRNA) interactions was conducted to focus on significant KEGG pathways. Finally, we extracted target genes based on occurrence frequency ≥3. RESULTS Based on an absolute value of PCC >0.7, we found 33 miRNAs and 288 mRNAs for further analysis. We extracted 10 target genes with predicted frequencies not less than 3. The target gene MYO5C possessed the highest frequency, which was predicted by 7 different miRNAs. Significantly, a total of 8 pathways were identified; the pathways of cytokine-cytokine receptor interaction and chemokine signaling pathway were the most significant. CONCLUSIONS We successfully predicted target genes and pathways for HNSCC relying on miRNA expression data, mRNA expression profile, an ensemble method and pathway information. Our results may offer new information for the diagnosis and estimation of the prognosis of HNSCC.
Collapse
|
12
|
Chen R, Shi YH, Zhang H, Hu JY, Luo Y. Systematic prediction of target genes and pathways in cervical cancer from microRNA expression data. Oncol Lett 2018; 15:9994-10000. [PMID: 29928371 DOI: 10.3892/ol.2018.8566] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2016] [Accepted: 11/24/2017] [Indexed: 12/22/2022] Open
Abstract
Cervical cancer (CC) is a leading cause of cancer-associated mortality in women; thus, the present study aimed to investigated potential target genes and pathways in patients with CC by utilizing an ensemble method and pathway enrichment analysis. The ensemble method integrated a correlation method [Pearson's correlation coefficient (PCC)], a causal inference method (IDA) and a regression method [least absolute shrinkage and selection operator (Lasso)] using the Borda count election algorithm, forming the PCC, IDA and Lasso (PIL) method. Subsequently, the PIL method was validated to be a feasible approach to predict microRNA (miRNA) targets by comparing predicted miRNA targets against those from a confirmed database. Finally, Kyoto Encyclopedia of Genes and Genomes pathway enrichment analysis was conducted for target genes in the 1,000 most frequently predicted miRNA-mRNA interactions to determine target pathways. A total of 10 target genes were obtained that were predicted >5 times, including secreted frizzled-related protein 4, maternally expressed 3 and NIPA like domain containing 4. Additionally, a total of 17 target pathways were identified, of which cytokine-cytokine receptor interaction (P=8.91×10-7) was the most significantly associated with CC of all pathways. In conclusion, the present study predicted target genes and pathways for patients with CC based on miRNA expression data, the PIL method and pathway analysis. The results of the present study may provide an insight into the pathological mechanisms underlying CC, and provide potential biomarkers for the diagnosis and treatment of this tumor type. However, these biomarkers have yet to be validated; these validations will be performed in future studies.
Collapse
Affiliation(s)
- Rui Chen
- Department of Gynecology, Qingpu Branch of Zhongshan Hospital, Fudan University, Shanghai 201799, P.R. China
| | - Yong-Hua Shi
- Department of Pathology, Xinjiang Medical University, Urumchi, Xinjiang Uygur Autonomous Region 830011, P.R. China
| | - Hong Zhang
- Department of Gynecology, Qingpu Branch of Zhongshan Hospital, Fudan University, Shanghai 201799, P.R. China
| | - Jian-Yun Hu
- Department of Gynecology, Qingpu Branch of Zhongshan Hospital, Fudan University, Shanghai 201799, P.R. China
| | - Yi Luo
- Department of Gynecology, Qingpu Branch of Zhongshan Hospital, Fudan University, Shanghai 201799, P.R. China
| |
Collapse
|
13
|
miRNAtools: Advanced Training Using the miRNA Web of Knowledge. Noncoding RNA 2018; 4:ncrna4010005. [PMID: 29657302 PMCID: PMC5890392 DOI: 10.3390/ncrna4010005] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2018] [Revised: 02/13/2018] [Accepted: 02/14/2018] [Indexed: 01/06/2023] Open
Abstract
Micro-RNAs (miRNAs) are small non-coding RNAs that act as negative regulators of the genomic output. Their intrinsic importance within cell biology and human disease is well known. Their mechanism of action based on the base pairing binding to their cognate targets have helped the development not only of many computer applications for the prediction of miRNA target recognition but also of specific applications for functional assessment and analysis. Learning about miRNA function requires practical training in the use of specific computer and web-based applications that are complementary to wet-lab studies. In order to guide the learning process about miRNAs, we have created miRNAtools (http://mirnatools.eu), a web repository of miRNA tools and tutorials. This article compiles tools with which miRNAs and their regulatory action can be analyzed and that function to collect and organize information dispersed on the web. The miRNAtools website contains a collection of tutorials that can be used by students and tutors engaged in advanced training courses. The tutorials engage in analyses of the functions of selected miRNAs, starting with their nomenclature and genomic localization and finishing with their involvement in specific cellular functions.
Collapse
|
14
|
Zhao L, Gu C, Ye M, Zhang Z, Li L, Fan W, Meng Y. Integration analysis of microRNA and mRNA paired expression profiling identifies deregulated microRNA-transcription factor-gene regulatory networks in ovarian endometriosis. Reprod Biol Endocrinol 2018; 16:4. [PMID: 29357938 PMCID: PMC5776778 DOI: 10.1186/s12958-017-0319-5] [Citation(s) in RCA: 49] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/30/2017] [Accepted: 12/25/2017] [Indexed: 01/26/2023] Open
Abstract
BACKGROUND The etiology and pathophysiology of endometriosis remain unclear. Accumulating evidence suggests that aberrant microRNA (miRNA) and transcription factor (TF) expression may be involved in the pathogenesis and development of endometriosis. This study therefore aims to survey the key miRNAs, TFs and genes and further understand the mechanism of endometriosis. METHODS Paired expression profiling of miRNA and mRNA in ectopic endometria compared with eutopic endometria were determined by high-throughput sequencing techniques in eight patients with ovarian endometriosis. Binary interactions and circuits among the miRNAs, TFs, and corresponding genes were identified by the Pearson correlation coefficients. miRNA-TF-gene regulatory networks were constructed using bioinformatic methods. Eleven selected miRNAs and TFs were validated by quantitative reverse transcription-polymerase chain reaction in 22 patients. RESULTS Overall, 107 differentially expressed miRNAs and 6112 differentially expressed mRNAs were identified by comparing the sequencing of the ectopic endometrium group and the eutopic endometrium group. The miRNA-TF-gene regulatory network consists of 22 miRNAs, 12 TFs and 430 corresponding genes. Specifically, some key regulators from the miR-449 and miR-34b/c cluster, miR-200 family, miR-106a-363 cluster, miR-182/183, FOX family, GATA family, and E2F family as well as CEBPA, SOX9 and HNF4A were suggested to play vital regulatory roles in the pathogenesis of endometriosis. CONCLUSION Integration analysis of the miRNA and mRNA expression profiles presents a unique insight into the regulatory network of this enigmatic disorder and possibly provides clues regarding replacement therapy for endometriosis.
Collapse
Affiliation(s)
- Luyang Zhao
- Department of Gynecology and Obstetrics, People’s Liberation Army (PLA) Medical School, Chinese PLA General Hospital, Beijing, 100853 China
- Department of Gynecology and Obstetrics, Peking University People’s Hospital, Beijing, China
| | - Chenglei Gu
- Department of Gynecology and Obstetrics, People’s Liberation Army (PLA) Medical School, Chinese PLA General Hospital, Beijing, 100853 China
- Department of Gynecology and Obstetrics, the 309th Hospital of Chinese PLA, Beijing, China
| | - Mingxia Ye
- Department of Gynecology and Obstetrics, People’s Liberation Army (PLA) Medical School, Chinese PLA General Hospital, Beijing, 100853 China
| | - Zhe Zhang
- Department of Gynecology and Obstetrics, People’s Liberation Army (PLA) Medical School, Chinese PLA General Hospital, Beijing, 100853 China
| | - Li’an Li
- Department of Gynecology and Obstetrics, People’s Liberation Army (PLA) Medical School, Chinese PLA General Hospital, Beijing, 100853 China
| | - Wensheng Fan
- Department of Gynecology and Obstetrics, People’s Liberation Army (PLA) Medical School, Chinese PLA General Hospital, Beijing, 100853 China
| | - Yuanguang Meng
- Department of Gynecology and Obstetrics, People’s Liberation Army (PLA) Medical School, Chinese PLA General Hospital, Beijing, 100853 China
| |
Collapse
|
15
|
Wei C, Wang L, Zhang H. An Ensemble Method to Predict Target Genes and Pathways in Uveal Melanoma. Open Life Sci 2018; 13:90-96. [PMID: 33817073 PMCID: PMC7874707 DOI: 10.1515/biol-2018-0013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2017] [Accepted: 01/16/2018] [Indexed: 11/19/2022] Open
Abstract
Objective: This work proposes to predict target genes and pathways for uveal melanoma (UM) based on an ensemble method and pathway analyses. METHODS The ensemble method integrated a correlation method (Pearson correlation coefficient, PCC), a causal inference method (IDA) and a regression method (Lasso) utilizing the Borda count election method. Subsequently, to validate the performance of PIL method, comparisons between confirmed database and predicted miRNA targets were performed. Ultimately, pathway enrichment analysis was conducted on target genes in top 1000 miRNA-mRNA interactions to identify target pathways for UM patients. RESULTS Thirty eight of the predicted interactions were matched with the confirmed interactions, indicating that the ensemble method was a suitable and feasible approach to predict miRNA targets. We obtained 50 seed miRNA-mRNA interactions of UM patients and extracted target genes from these interactions, such as ASPG, BSDC1 and C4BP. The 601 target genes in top 1,000 miRNA-mRNA interactions were enriched in 12 target pathways, of which Phototransduction was the most significant one. CONCLUSION The target genes and pathways might provide a new way to reveal the molecular mechanism of UM and give hand for target treatments and preventions of this malignant tumor.
Collapse
Affiliation(s)
- Chao Wei
- Department of Ophthalmology, The Second Hospital of Shandong University, Jinan, 250033, Shandong Province, China
| | - Lei Wang
- Department of Ophthalmology, The Second Hospital of Shandong University, Jinan, 250033, Shandong Province, China
| | - Han Zhang
- Department of Ophthalmology, The Second Hospital of Shandong University, Jinan, 250033, Shandong Province, China
| |
Collapse
|
16
|
Luo D, Wang SL, Fang J, Zhang W. MIMPFC: Identifying miRNA-mRNA regulatory modules by combining phase-only correlation and improved rough-fuzzy clustering. J Bioinform Comput Biol 2017; 16:1750028. [PMID: 29281954 DOI: 10.1142/s0219720017500287] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/16/2023]
Abstract
MicroRNAs (miRNAs) play a key role in gene expression and regulation in various organisms. They control a wide range of biological processes and are involved in several types of cancers by causing mRNA degradation or translational inhibition. However, the functions of most miRNAs and their precise regulatory mechanisms remain elusive. With the accumulation of the expression data of miRNAs and mRNAs, many computational methods have been proposed to predict miRNA-mRNA regulatory relationship. However, most existing methods require the number of modules predefined that may be difficult to determine beforehand. Here, we propose a novel computational method to discover miRNA-mRNA regulatory modules by combining Phase-only correlation and improved rough-Fuzzy Clustering (MIMPFC). The proposed method is evaluated on three heterogeneous datasets, and the obtained results are further validated through relevant literatures, biological significance and functional enrichment analysis. The analysis results show that the identified modules are highly correlated with the biological conditions. A large part of the regulatory relationships found by MIMPFC has been confirmed in the experimentally verified databases. It demonstrates that the modules found by MIMPFC are biologically significant.
Collapse
Affiliation(s)
- Dan Luo
- * College of Computer Science and Electronics Engineering, Hunan University, Changsha 410082, Hunan, P. R. China
| | - Shu-Lin Wang
- * College of Computer Science and Electronics Engineering, Hunan University, Changsha 410082, Hunan, P. R. China
| | - Jianwen Fang
- † Biometric Research Program, Division of Cancer Treatment and Diagnosis, National Cancer Institute, Rockville, MD 20850, USA
| | - Wei Zhang
- * College of Computer Science and Electronics Engineering, Hunan University, Changsha 410082, Hunan, P. R. China
| |
Collapse
|
17
|
Liu GW, Qin ZM, Shen QH. An ensemble method integrated with miRNA expression data for predicting miRNA targets in stomach adenocarcinoma. Cancer Biomark 2017; 20:617-625. [DOI: 10.3233/cbm-170595] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Affiliation(s)
- Guang-Wei Liu
- Department of Gastroenterology, The First Affiliated Hospital, Henan University of Traditional Chinese Medicine, Zhengzhou, Henan, China
| | - Zhao-Min Qin
- Department of Nursing, Shandong Medical College, Jinan, Shandong, China
| | - Qin-Hai Shen
- Department of Medicine, Shandong Medical College, Jinan, Shandong, China
| |
Collapse
|
18
|
Davis JA, Saunders SJ, Mann M, Backofen R. Combinatorial ensemble miRNA target prediction of co-regulation networks with non-prediction data. Nucleic Acids Res 2017; 45:8745-8757. [PMID: 28911111 PMCID: PMC5587804 DOI: 10.1093/nar/gkx605] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2016] [Accepted: 07/06/2017] [Indexed: 12/11/2022] Open
Abstract
MicroRNAs (miRNAs) are key regulators of cell-fate decisions in development and disease with a vast array of target interactions that can be investigated using computational approaches. For this study, we developed metaMIR, a combinatorial approach to identify miRNAs that co-regulate identified subsets of genes from a user-supplied list. We based metaMIR predictions on an improved dataset of human miRNA–target interactions, compiled using a machine-learning-based meta-analysis of established algorithms. Simultaneously, the inverse dataset of negative interactions not likely to occur was extracted to increase classifier performance, as measured using an expansive set of experimentally validated interactions from a variety of sources. In a second differential mode, candidate miRNAs are predicted by indicating genes to be targeted and others to be avoided to potentially increase specificity of results. As an example, we investigate the neural crest, a transient structure in vertebrate development where miRNAs play a pivotal role. Patterns of metaMIR-predicted miRNA regulation alone partially recapitulated functional relationships among genes, and separate differential analysis revealed miRNA candidates that would downregulate components implicated in cancer progression while not targeting tumour suppressors. Such an approach could aid in therapeutic application of miRNAs to reduce unintended effects. The utility is available at http://rna.informatik.uni-freiburg.de/metaMIR/.
Collapse
Affiliation(s)
- Jason A Davis
- Department of Molecular Embryology, Institute of Anatomy and Cell Biology, Faculty of Medicine, University of Freiburg, 79104 Freiburg, Germany
| | - Sita J Saunders
- Bioinformatics Group, Department of Computer Science, Albert-Ludwigs-University Freiburg, Georges-Köhler-Allee 106, 79110 Freiburg, Germany
| | - Martin Mann
- Bioinformatics Group, Department of Computer Science, Albert-Ludwigs-University Freiburg, Georges-Köhler-Allee 106, 79110 Freiburg, Germany
| | - Rolf Backofen
- Bioinformatics Group, Department of Computer Science, Albert-Ludwigs-University Freiburg, Georges-Köhler-Allee 106, 79110 Freiburg, Germany.,ZBSA Centre for Biological Systems Analysis, Albert-Ludwigs-University Freiburg, Habsburgerstr. 49, 79104 Freiburg, Germany.,BIOSS Centre for Biological Signalling Studies, Cluster of Excellence, Albert-Ludwigs-University Freiburg, Germany.,Centre for non-coding RNA in Technology and Health, University of Copenhagen, Gr⊘nnegårdsvej 3, DK-1870 Frederiksberg C, Denmark
| |
Collapse
|
19
|
Paces J, Nic M, Novotny T, Svoboda P. Literature review of baseline information to support the risk assessment of RNAi‐based GM plants. ACTA ACUST UNITED AC 2017. [PMCID: PMC7163844 DOI: 10.2903/sp.efsa.2017.en-1246] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Affiliation(s)
- Jan Paces
- Institute of Molecular Genetics of the Academy of Sciences of the Czech Republic (IMG)
| | | | | | - Petr Svoboda
- Institute of Molecular Genetics of the Academy of Sciences of the Czech Republic (IMG)
| |
Collapse
|
20
|
Abstract
Background MicroRNAs (miRNAs) play important regulatory roles in the wide range of biological processes by inducing target mRNA degradation or translational repression. Based on the correlation between expression profiles of a miRNA and its target mRNA, various computational methods have previously been proposed to identify miRNA-mRNA association networks by incorporating the matched miRNA and mRNA expression profiles. However, there remain three major issues to be resolved in the conventional computation approaches for inferring miRNA-mRNA association networks from expression profiles. 1) Inferred correlations from the observed expression profiles using conventional correlation-based methods include numerous erroneous links or over-estimated edge weight due to the transitive information flow among direct associations. 2) Due to the high-dimension-low-sample-size problem on the microarray dataset, it is difficult to obtain an accurate and reliable estimate of the empirical correlations between all pairs of expression profiles. 3) Because the previously proposed computational methods usually suffer from varying performance across different datasets, a more reliable model that guarantees optimal or suboptimal performance across different datasets is highly needed. Results In this paper, we present DMirNet, a new framework for identifying direct miRNA-mRNA association networks. To tackle the aforementioned issues, DMirNet incorporates 1) three direct correlation estimation methods (namely Corpcor, SPACE, Network deconvolution) to infer direct miRNA-mRNA association networks, 2) the bootstrapping method to fully utilize insufficient training expression profiles, and 3) a rank-based Ensemble aggregation to build a reliable and robust model across different datasets. Our empirical experiments on three datasets demonstrate the combinatorial effects of necessary components in DMirNet. Additional performance comparison experiments show that DMirNet outperforms the state-of-the-art Ensemble-based model [1] which has shown the best performance across the same three datasets, with a factor of up to 1.29. Further, we identify 43 putative novel multi-cancer-related miRNA-mRNA association relationships from an inferred Top 1000 direct miRNA-mRNA association network. Conclusions We believe that DMirNet is a promising method to identify novel direct miRNA-mRNA relations and to elucidate the direct miRNA-mRNA association networks. Since DMirNet infers direct relationships from the observed data, DMirNet can contribute to reconstructing various direct regulatory pathways, including, but not limited to, the direct miRNA-mRNA association networks. Electronic supplementary material The online version of this article (doi:10.1186/s12918-016-0373-1) contains supplementary material, which is available to authorized users.
Collapse
Affiliation(s)
- Minsu Lee
- Department of Computer Science and Engineering, Ewha Womans University, Seoul, South Korea
| | - HyungJune Lee
- Department of Computer Science and Engineering, Ewha Womans University, Seoul, South Korea.
| |
Collapse
|
21
|
Walsh CJ, Hu P, Batt J, Dos Santos CC. Discovering MicroRNA-Regulatory Modules in Multi-Dimensional Cancer Genomic Data: A Survey of Computational Methods. Cancer Inform 2016; 15:25-42. [PMID: 27721651 PMCID: PMC5051584 DOI: 10.4137/cin.s39369] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2016] [Revised: 08/14/2016] [Accepted: 08/16/2016] [Indexed: 12/20/2022] Open
Abstract
MicroRNAs (miRs) are small single-stranded noncoding RNA that function in RNA silencing and post-transcriptional regulation of gene expression. An increasing number of studies have shown that miRs play an important role in tumorigenesis, and understanding the regulatory mechanism of miRs in this gene regulatory network will help elucidate the complex biological processes at play during malignancy. Despite advances, determination of miR–target interactions (MTIs) and identification of functional modules composed of miRs and their specific targets remain a challenge. A large amount of data generated by high-throughput methods from various sources are available to investigate MTIs. The development of data-driven tools to harness these multi-dimensional data has resulted in significant progress over the past decade. In parallel, large-scale cancer genomic projects are allowing new insights into the commonalities and disparities of miR–target regulation across cancers. In the first half of this review, we explore methods for identification of pairwise MTIs, and in the second half, we explore computational tools for discovery of miR-regulatory modules in a cancer-specific and pan-cancer context. We highlight strengths and limitations of each of these tools as a practical guide for the computational biologists.
Collapse
Affiliation(s)
- Christopher J Walsh
- Keenan and Li Ka Shing Knowledge Institute of Saint Michael's Hospital, Toronto, ON, Canada.; Institute of Medical Sciences and Department of Medicine, University of Toronto, Toronto, ON, Canada
| | - Pingzhao Hu
- Department of Biochemistry and Medical Genetics, University of Manitoba, Winnipeg, MB, Canada
| | - Jane Batt
- Keenan and Li Ka Shing Knowledge Institute of Saint Michael's Hospital, Toronto, ON, Canada.; Institute of Medical Sciences and Department of Medicine, University of Toronto, Toronto, ON, Canada
| | - Claudia C Dos Santos
- Keenan and Li Ka Shing Knowledge Institute of Saint Michael's Hospital, Toronto, ON, Canada.; Institute of Medical Sciences and Department of Medicine, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
22
|
Predicting miRNA Targets by Integrating Gene Regulatory Knowledge with Expression Profiles. PLoS One 2016; 11:e0152860. [PMID: 27064982 PMCID: PMC4827848 DOI: 10.1371/journal.pone.0152860] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2015] [Accepted: 03/21/2016] [Indexed: 11/19/2022] Open
Abstract
MOTIVATION microRNAs (miRNAs) play crucial roles in post-transcriptional gene regulation of both plants and mammals, and dysfunctions of miRNAs are often associated with tumorigenesis and development through the effects on their target messenger RNAs (mRNAs). Identifying miRNA functions is critical for understanding cancer mechanisms and determining the efficacy of drugs. Computational methods analyzing high-throughput data offer great assistance in understanding the diverse and complex relationships between miRNAs and mRNAs. However, most of the existing methods do not fully utilise the available knowledge in biology to reduce the uncertainty in the modeling process. Therefore it is desirable to develop a method that can seamlessly integrate existing biological knowledge and high-throughput data into the process of discovering miRNA regulation mechanisms. RESULTS In this article we present an integrative framework, CIDER (Causal miRNA target Discovery with Expression profile and Regulatory knowledge), to predict miRNA targets. CIDER is able to utilise a variety of gene regulation knowledge, including transcriptional and post-transcriptional knowledge, and to exploit gene expression data for the discovery of miRNA-mRNA regulatory relationships. The benefits of our framework is demonstrated by both simulation study and the analysis of the epithelial-to-mesenchymal transition (EMT) and the breast cancer (BRCA) datasets. Our results reveal that even a limited amount of either Transcription Factor (TF)-miRNA or miRNA-mRNA regulatory knowledge improves the performance of miRNA target prediction, and the combination of the two types of knowledge enhances the improvement further. Another useful property of the framework is that its performance increases monotonically with the increase of regulatory knowledge.
Collapse
|
23
|
Masud Karim SM, Liu L, Le TD, Li J. Identification of miRNA-mRNA regulatory modules by exploring collective group relationships. BMC Genomics 2016; 17 Suppl 1:7. [PMID: 26817421 PMCID: PMC4895272 DOI: 10.1186/s12864-015-2300-z] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/02/2023] Open
Abstract
Background microRNAs (miRNAs) play an essential role in the post-transcriptional gene regulation in plants and animals. They regulate a wide range of biological processes by targeting messenger RNAs (mRNAs). Evidence suggests that miRNAs and mRNAs interact collectively in gene regulatory networks. The collective relationships between groups of miRNAs and groups of mRNAs may be more readily interpreted than those between individual miRNAs and mRNAs, and thus are useful for gaining insight into gene regulation and cell functions. Several computational approaches have been developed to discover miRNA-mRNA regulatory modules (MMRMs) with a common aim to elucidate miRNA-mRNA regulatory relationships. However, most existing methods do not consider the collective relationships between a group of miRNAs and the group of targeted mRNAs in the process of discovering MMRMs. Our aim is to develop a framework to discover MMRMs and reveal miRNA-mRNA regulatory relationships from the heterogeneous expression data based on the collective relationships. Results We propose DIscovering COllective group RElationships (DICORE), an effective computational framework for revealing miRNA-mRNA regulatory relationships. We utilize the notation of collective group relationships to build the computational framework. The method computes the collaboration scores of the miRNAs and mRNAs on the basis of their interactions with mRNAs and miRNAs, respectively. Then it determines the groups of miRNAs and groups of mRNAs separately based on their respective collaboration scores. Next, it calculates the strength of the collective relationship between each pair of miRNA group and mRNA group using canonical correlation analysis, and the group pairs with significant canonical correlations are considered as the MMRMs. We applied this method to three gene expression datasets, and validated the computational discoveries. Conclusions Analysis of the results demonstrates that a large portion of the regulatory relationships discovered by DICORE is consistent with the experimentally confirmed databases. Furthermore, it is observed that the top mRNAs that are regulated by the miRNAs in the identified MMRMs are highly relevant to the biological conditions of the given datasets. It is also shown that the MMRMs identified by DICORE are more biologically significant and functionally enriched. Electronic supplementary material The online version of this article (doi:10.1186/s12864-015-2300-z) contains supplementary material, which is available to authorized users.
Collapse
Affiliation(s)
- S M Masud Karim
- School of Information Technology and Mathematical Sciences, University of South Australia, Mawson Lakes, Adelaide, 5095, SA, Australia.
| | - Lin Liu
- School of Information Technology and Mathematical Sciences, University of South Australia, Mawson Lakes, Adelaide, 5095, SA, Australia.
| | - Thuc Duy Le
- School of Information Technology and Mathematical Sciences, University of South Australia, Mawson Lakes, Adelaide, 5095, SA, Australia.
| | - Jiuyong Li
- School of Information Technology and Mathematical Sciences, University of South Australia, Mawson Lakes, Adelaide, 5095, SA, Australia.
| |
Collapse
|
24
|
Le TD, Zhang J, Liu L, Liu H, Li J. miRLAB: An R Based Dry Lab for Exploring miRNA-mRNA Regulatory Relationships. PLoS One 2015; 10:e0145386. [PMID: 26716983 PMCID: PMC4696828 DOI: 10.1371/journal.pone.0145386] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2015] [Accepted: 12/03/2015] [Indexed: 11/19/2022] Open
Abstract
microRNAs (miRNAs) are important gene regulators at post-transcriptional level, and inferring miRNA-mRNA regulatory relationships is a crucial problem. Consequently, several computational methods of predicting miRNA targets have been proposed using expression data with or without sequence based miRNA target information. A typical procedure for applying and evaluating such a method is i) collecting matched miRNA and mRNA expression profiles in a specific condition, e.g. a cancer dataset from The Cancer Genome Atlas (TCGA), ii) applying the new computational method to the selected dataset, iii) validating the predictions against knowledge from literature and third-party databases, and comparing the performance of the method with some existing methods. This procedure is time consuming given the time elapsed when collecting and processing data, repeating the work from existing methods, searching for knowledge from literature and third-party databases to validate the results, and comparing the results from different methods. The time consuming procedure prevents researchers from quickly testing new computational models, analysing new datasets, and selecting suitable methods for assisting with the experiment design. Here, we present an R package, miRLAB, for automating the procedure of inferring and validating miRNA-mRNA regulatory relationships. The package provides a complete set of pipelines for testing new methods and analysing new datasets. miRLAB includes a pipeline to obtain matched miRNA and mRNA expression datasets directly from TCGA, 12 benchmark computational methods for inferring miRNA-mRNA regulatory relationships, the functions for validating the predictions using experimentally validated miRNA target data and miRNA perturbation data, and the tools for comparing the results from different computational methods.
Collapse
Affiliation(s)
- Thuc Duy Le
- School of Information Technology and Mathematical Sciences, University of South Australia, Adelaide, South Australia, Australia
- * E-mail: (TDL); (JL)
| | - Junpeng Zhang
- Faculty of Engineering, Dali University, Dali, China
| | - Lin Liu
- School of Information Technology and Mathematical Sciences, University of South Australia, Adelaide, South Australia, Australia
| | - Huawen Liu
- Department of Computer Science, Zhejiang Normal University, China
| | - Jiuyong Li
- School of Information Technology and Mathematical Sciences, University of South Australia, Adelaide, South Australia, Australia
- * E-mail: (TDL); (JL)
| |
Collapse
|