1
|
Peng S, Wang W, Chen Y, Zhong X, Hu Q. Regression-Based Hyperparameter Learning for Support Vector Machines. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:18799-18813. [PMID: 37847631 DOI: 10.1109/tnnls.2023.3321685] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/19/2023]
Abstract
Unification of classification and regression is a major challenge in machine learning and has attracted increasing attentions from researchers. In this article, we present a new idea for this challenge, where we convert the classification problem into a regression problem, and then use the methods in regression to solve the problem in classification. To this end, we leverage the widely used maximum margin classification algorithm and its typical representative, support vector machine (SVM). More specifically, we convert SVM into a piecewise linear regression task and propose a regression-based SVM (RBSVM) hyperparameter learning algorithm, where regression methods are used to solve several key problems in classification, such as learning of hyperparameters, calculation of prediction probabilities, and measurement of model uncertainty. To analyze the uncertainty of the model, we propose a new concept of model entropy, where the leave-one-out prediction probability of each sample is converted into entropy, and then used to quantify the uncertainty of the model. The model entropy is different from the classification margin, in the sense that it considers the distribution of all samples, not just the support vectors. Therefore, it can assess the uncertainty of the model more accurately than the classification margin. In the case of the same classification margin, the farther the sample distribution is from the classification hyperplane, the lower the model entropy. Experiments show that our algorithm (RBSVM) provides higher prediction accuracy and lower model uncertainty, when compared with state-of-the-art algorithms, such as Bayesian hyperparameter search and gradient-based hyperparameter learning algorithms.
Collapse
|
2
|
Xing Y, Pearlson GD, Kochunov P, Calhoun VD, Du Y. Local-structure-preservation and redundancy-removal-based feature selection method and its application to the identification of biomarkers for schizophrenia. Neuroimage 2024; 299:120839. [PMID: 39251116 PMCID: PMC11491165 DOI: 10.1016/j.neuroimage.2024.120839] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2024] [Revised: 08/10/2024] [Accepted: 09/04/2024] [Indexed: 09/11/2024] Open
Abstract
Accurate diagnosis of mental disorders is expected to be achieved through the identification of reliable neuroimaging biomarkers with the help of cutting-edge feature selection techniques. However, existing feature selection methods often fall short in capturing the local structural characteristics among samples and effectively eliminating redundant features, resulting in inadequate performance in disorder prediction. To address this gap, we propose a novel supervised method named local-structure-preservation and redundancy-removal-based feature selection (LRFS), and then apply it to the identification of meaningful biomarkers for schizophrenia (SZ). LRFS method leverages graph-based regularization to preserve original sample similarity relationships during data transformation, thus retaining crucial local structure information. Additionally, it introduces redundancy-removal regularization based on interrelationships among features to exclude similar and redundant features from high-dimensional data. Moreover, LRFS method incorporates l2,1 sparse regularization that enables selecting a sparse and noise-robust feature subset. Experimental evaluations on eight public datasets with diverse properties demonstrate the superior performance of our method over nine popular feature selection methods in identifying discriminative features, with average classification accuracy gains ranging from 1.30 % to 9.11 %. Furthermore, the LRFS method demonstrates superior discriminability in four functional magnetic resonance imaging (fMRI) datasets from 708 healthy controls (HCs) and 537 SZ patients, with an average increase in classification accuracy ranging from 1.89 % to 9.24 % compared to other nine methods. Notably, our method reveals reproducible and significant changes in SZ patients relative to HCs across the four datasets, predominantly in the thalamus-related functional network connectivity, which exhibit a significant correlation with clinical symptoms. Convergence analysis, parameter sensitivity analysis, and ablation studies further demonstrate the effectiveness and robustness of our method. In short, our proposed feature selection method effectively identifies discriminative and reliable features that hold the potential to be biomarkers, paving the way for the elucidation of brain abnormalities and the advancement of precise diagnosis of mental disorders.
Collapse
Affiliation(s)
- Ying Xing
- School of Computer and Information Technology, Shanxi University, Taiyuan, China
| | - Godfrey D Pearlson
- Departments of Psychiatry and Neurobiology, Yale University, New Haven, CT, USA
| | - Peter Kochunov
- Maryland Psychiatric Research Center and Department of Psychiatry, University of Maryland, School of Medicine, Baltimore, MD, USA
| | - Vince D Calhoun
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science, Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA, USA
| | - Yuhui Du
- School of Computer and Information Technology, Shanxi University, Taiyuan, China.
| |
Collapse
|
3
|
Espinosa R, Jimenez F, Palma J. Surrogate-Assisted and Filter-Based Multiobjective Evolutionary Feature Selection for Deep Learning. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:9591-9605. [PMID: 37018667 DOI: 10.1109/tnnls.2023.3234629] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
Feature selection (FS) for deep learning prediction models is a difficult topic for researchers to tackle. Most of the approaches proposed in the literature consist of embedded methods through the use of hidden layers added to the neural network architecture that modify the weights of the units associated with each input attribute so that the worst attributes have less weight in the learning process. Other approaches used for deep learning are filter methods, which are independent of the learning algorithm, which can limit the precision of the prediction model. Wrapper methods are impractical with deep learning due to their high computational cost. In this article, we propose new attribute subset evaluation FS methods for deep learning of the wrapper, filter and wrapper-filter hybrid types, where multiobjective and many-objective evolutionary algorithms are used as search strategies. A novel surrogate-assisted approach is used to reduce the high computational cost of the wrapper-type objective function, while the filter-type objective functions are based on correlation and an adaptation of the reliefF algorithm. The proposed techniques have been applied in a time series forecasting problem of air quality in the Spanish south-east and an indoor temperature forecasting problem in a domotic house, with promising results compared to other FS techniques used in the literature.
Collapse
|
4
|
Guo H, Li M, Liu H, Chen X, Cheng Z, Li X, Yu H, He Q. Multi-threshold Image Segmentation based on an improved Salp Swarm Algorithm: Case study of breast cancer pathology images. Comput Biol Med 2024; 168:107769. [PMID: 38039898 DOI: 10.1016/j.compbiomed.2023.107769] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Revised: 11/02/2023] [Accepted: 11/26/2023] [Indexed: 12/03/2023]
Abstract
Breast cancer poses a significant risk to women's health, and it is essential to provide proper diagnostic support. Medical image processing technology is a key component of all supporting diagnostic techniques, with Image Segmentation (IS) being one of its primary steps. Among various methods, Multilevel Image Segmentation (MIS) is considered one of the most effective and straightforward approaches. Many researchers have attempted to improve the quality of image segmentation by combining different metaheuristic algorithms with MIS. However, these methods often suffer from issues such as low convergence accuracy and a proclivity for converging towards Local Optima (LO). To overcome these challenges, this study introduces an integrated approach that combines the Salp Swarm Algorithm (SSA), Slime Mould Algorithm (SMA) and Differential Evolution (DE) algorithm. In this manuscript, we introduce an innovative hybrid MIS model termed SDSSA, which leverages elements from the SSA, SMA and DE algorithms. The SDSSA model fundamentally relies on non-local means 2D histogram and 2D Kapur's entropy. To evaluate the proposed method effectively, we compare it initially with similar algorithms using the IEEE CEC2014 benchmark functions. The SDSSA showcases enhanced convergence velocity and precision relative to similar algorithms. Furthermore, this paper proposes an excellent MIS method. Subsequently, IS experiments were conducted separately at both low and high threshold levels. The test results demonstrate that the segmentation outcomes of MIS, at both low and high threshold levels, outperform other methods. This validates SDSSA as a superior segmentation technique that provides practical assistance for future research in breast cancer pathology image processing.
Collapse
Affiliation(s)
- Hongliang Guo
- College of Information Technology, Jilin Agricultural University, Changchun 130118, China.
| | - Mingyang Li
- College of Information Technology, Jilin Agricultural University, Changchun 130118, China.
| | - Hanbo Liu
- College of Information Technology, Jilin Agricultural University, Changchun 130118, China.
| | - Xiao Chen
- College of Information Technology, Jilin Agricultural University, Changchun 130118, China.
| | - Zhiqiang Cheng
- College of Resources and Environment, Jilin Agricultural University, Changchun 130118, China; Scientific and Technological Innovation Center of Health Products and Medical Materials with Characteristic Resources of Jilin Province, Changchun 130000, China.
| | - Xiaohua Li
- Library, Wenzhou University, Wenzhou, Zhejiang, 325035, China.
| | - Helong Yu
- College of Information Technology, Jilin Agricultural University, Changchun 130118, China.
| | - Qiuxiang He
- Department of Pathology, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou 325000, China.
| |
Collapse
|
5
|
Yang X, Wang Y, Wang R, Li J. Ensemble Feature Selection With Block-Regularized m × 2 Cross-Validation. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2023; 34:6628-6641. [PMID: 34851832 DOI: 10.1109/tnnls.2021.3128173] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Ensemble feature selection (EFS) has attracted significant interest in the literature due to its great potential in reducing the discovery rate of noise features and stabilizing the feature selection results. In view of the superior performance of block-regularized m × 2 cross-validation on generalization performance and algorithm comparison, a novel EFS technology based on block-regularized m × 2 cross-validation is proposed in this study. Contrary to the traditional ensemble learning with a binomial distribution, the distribution of feature selection frequency in the proposed technique is approximated by a beta distribution more accurately. Furthermore, theoretical analysis of the proposed technique shows that it yields a higher selection probability for important features, lower selected risk for noise features, more true positives, and fewer false positives. Finally, the above conclusions are verified by the simulated and real data experiments.
Collapse
|
6
|
Brahim Belhaouari S, Shakeel MB, Erbad A, Oflaz Z, Kassoul K. Bird's Eye View feature selection for high-dimensional data. Sci Rep 2023; 13:13303. [PMID: 37587137 PMCID: PMC10432524 DOI: 10.1038/s41598-023-39790-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Accepted: 07/31/2023] [Indexed: 08/18/2023] Open
Abstract
In machine learning, an informative dataset is crucial for accurate predictions. However, high dimensional data often contains irrelevant features, outliers, and noise, which can negatively impact model performance and consume computational resources. To tackle this challenge, the Bird's Eye View (BEV) feature selection technique is introduced. This approach is inspired by the natural world, where a bird searches for important features in a sparse dataset, similar to how a bird search for sustenance in a sprawling jungle. BEV incorporates elements of Evolutionary Algorithms with a Genetic Algorithm to maintain a population of top-performing agents, Dynamic Markov Chain to steer the movement of agents in the search space, and Reinforcement Learning to reward and penalize agents based on their progress. The proposed strategy in this paper leads to improved classification performance and a reduced number of features compared to conventional methods, as demonstrated by outperforming state-of-the-art feature selection techniques across multiple benchmark datasets.
Collapse
Affiliation(s)
- Samir Brahim Belhaouari
- Division of Information and Computing Technology, College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar.
| | - Mohammed Bilal Shakeel
- Division of Information and Computing Technology, College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| | - Aiman Erbad
- Division of Information and Computing Technology, College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| | - Zarina Oflaz
- Department of Industrial Engineering, Faculty of Engineering and Natural Sciences, KTO Karatay University, Konya, Turkey
| | - Khelil Kassoul
- Geneva School of Economics and Management (GSEM), University of Geneva, 1211, Geneva, Switzerland.
| |
Collapse
|
7
|
Wang ZJ, Gao HB, Wang XH, Zhao SY, Li H, Zhang XQ. Adaptive learning rate optimization algorithms with dynamic bound based on Barzilai-Borwein method. Inf Sci (N Y) 2023. [DOI: 10.1016/j.ins.2023.03.050] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/13/2023]
|
8
|
Gao C, Zhang R, Chen X, Yao T, Song Q, Ye W, Li P, Wang Z, Yi D, Wu Y. Integrating Internet multisource big data to predict the occurrence and development of COVID-19 cryptic transmission. NPJ Digit Med 2022; 5:161. [PMID: 36307547 DOI: 10.1038/s41746-022-00704-8] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2022] [Accepted: 10/07/2022] [Indexed: 11/09/2022] Open
Abstract
With the recent prevalence of COVID-19, cryptic transmission is worthy of attention and research. Early perception of the occurrence and development risk of cryptic transmission is an important part of controlling the spread of COVID-19. Previous relevant studies have limited data sources, and no effective analysis has been carried out on the occurrence and development of cryptic transmission. Hence, we collect Internet multisource big data (including retrieval, migration, and media data) and propose comprehensive and relative application strategies to eliminate the impact of national and media data. We use statistical classification and regression to construct an early warning model for occurrence and development. Under the guidance of the improved coronavirus herd immunity optimizer (ICHIO), we construct a "sampling-feature-hyperparameter-weight" synchronous optimization strategy. In occurrence warning, we propose an undersampling synchronous evolutionary ensemble (USEE); in development warning, we propose a bootstrap-sampling synchronous evolutionary ensemble (BSEE). Regarding the internal training data (Heilongjiang Province), the ROC-AUC of USEE3 incorporating multisource data is 0.9553, the PR-AUC is 0.8327, and the R2 of BSEE2 fused by the "nonlinear + linear" method is 0.8698. Regarding the external validation data (Shaanxi Province), the ROC-AUC and PR-AUC values of USEE3 were 0.9680 and 0.9548, respectively, and the R2 of BSEE2 was 0.8255. Our method has good accuracy and generalization and can be flexibly used in the prediction of cryptic transmission in various regions. We propose strategy research that integrates multiple early warning tasks based on multisource Internet big data and combines multiple ensemble models. It is an extension of the research in the field of traditional infectious disease monitoring and has important practical significance and innovative theoretical value.
Collapse
Affiliation(s)
- Chengcheng Gao
- Department of Health Statistics, College of Preventive Medicine, Army Medical University, Chongqing, 400038, China
| | - Rui Zhang
- Department of Health Statistics, College of Preventive Medicine, Army Medical University, Chongqing, 400038, China
| | - Xicheng Chen
- Department of Health Statistics, College of Preventive Medicine, Army Medical University, Chongqing, 400038, China
| | - Tianhua Yao
- Department of Health Statistics, College of Preventive Medicine, Army Medical University, Chongqing, 400038, China
| | - Qiuyue Song
- Department of Health Statistics, College of Preventive Medicine, Army Medical University, Chongqing, 400038, China
| | - Wei Ye
- Department of Health Statistics, College of Preventive Medicine, Army Medical University, Chongqing, 400038, China
| | - PengPeng Li
- Department of Health Statistics, College of Preventive Medicine, Army Medical University, Chongqing, 400038, China
| | - Zhenyan Wang
- Department of Health Statistics, College of Preventive Medicine, Army Medical University, Chongqing, 400038, China
| | - Dong Yi
- Department of Health Statistics, College of Preventive Medicine, Army Medical University, Chongqing, 400038, China.
| | - Yazhou Wu
- Department of Health Statistics, College of Preventive Medicine, Army Medical University, Chongqing, 400038, China.
| |
Collapse
|
9
|
Neural network input feature selection using structured l2 − norm penalization. APPL INTELL 2022. [DOI: 10.1007/s10489-022-03539-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
Abstract
AbstractArtificial neural networks are referred to as universal approximators due to their inherent ability to reconstruct complex linear and nonlinear output maps conceived as input-output relationships from data sets. This can be done by reducing large networks via regularization in order to establish compact models containing fewer parameters aimed at describing vital dependencies in data sets. In situations where the data sets contain non-informative input features, devising a continuous, optimal input feature selection technique can lead to improved prediction or classification. We propose a continuous input selection technique through a dimensional reduction mechanism using a ‘structured’ l2 − norm regularization. The implementation is done by identifying the most informative feature subsets from a given data set via an adaptive training mechanism. The adaptation involves introducing a novel, modified gradient approach during training to deal with the non-differentiability associated with the gradient of the structured norm penalty. When the method is applied to process data sets, results indicate that the most informative inputs of artificial neural networks can be selected using a structured l2 − norm penalization.
Collapse
|
10
|
Li F, Yin J, Lu M, Yang Q, Zeng Z, Zhang B, Li Z, Qiu Y, Dai H, Chen Y, Zhu F. ConSIG: consistent discovery of molecular signature from OMIC data. Brief Bioinform 2022; 23:6618243. [PMID: 35758241 DOI: 10.1093/bib/bbac253] [Citation(s) in RCA: 55] [Impact Index Per Article: 18.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2022] [Revised: 05/09/2022] [Accepted: 05/31/2022] [Indexed: 12/12/2022] Open
Abstract
The discovery of proper molecular signature from OMIC data is indispensable for determining biological state, physiological condition, disease etiology, and therapeutic response. However, the identified signature is reported to be highly inconsistent, and there is little overlap among the signatures identified from different biological datasets. Such inconsistency raises doubts about the reliability of reported signatures and significantly hampers its biological and clinical applications. Herein, an online tool, ConSIG, was constructed to realize consistent discovery of gene/protein signature from any uploaded transcriptomic/proteomic data. This tool is unique in a) integrating a novel strategy capable of significantly enhancing the consistency of signature discovery, b) determining the optimal signature by collective assessment, and c) confirming the biological relevance by enriching the disease/gene ontology. With the increasingly accumulated concerns about signature consistency and biological relevance, this online tool is expected to be used as an essential complement to other existing tools for OMIC-based signature discovery. ConSIG is freely accessible to all users without login requirement at https://idrblab.org/consig/.
Collapse
Affiliation(s)
- Fengcheng Li
- College of Pharmaceutical Sciences, The Second Affiliated Hospital, Zhejiang University School of Medicine, Zhejiang University, Hangzhou 310058, China
| | - Jiayi Yin
- College of Pharmaceutical Sciences, The Second Affiliated Hospital, Zhejiang University School of Medicine, Zhejiang University, Hangzhou 310058, China
| | - Mingkun Lu
- College of Pharmaceutical Sciences, The Second Affiliated Hospital, Zhejiang University School of Medicine, Zhejiang University, Hangzhou 310058, China
| | - Qingxia Yang
- College of Pharmaceutical Sciences, The Second Affiliated Hospital, Zhejiang University School of Medicine, Zhejiang University, Hangzhou 310058, China
| | - Zhenyu Zeng
- Innovation Institute for Artificial Intelligence in Medicine of Zhejiang University, Alibaba-Zhejiang University Joint Research Center of Future Digital Healthcare, Hangzhou 330110, China
| | - Bing Zhang
- Innovation Institute for Artificial Intelligence in Medicine of Zhejiang University, Alibaba-Zhejiang University Joint Research Center of Future Digital Healthcare, Hangzhou 330110, China
| | - Zhaorong Li
- Innovation Institute for Artificial Intelligence in Medicine of Zhejiang University, Alibaba-Zhejiang University Joint Research Center of Future Digital Healthcare, Hangzhou 330110, China
| | - Yunqing Qiu
- State Key Laboratory for Diagnosis and Treatment of Infectious Disease, Collaborative Innovation Center for Diagnosis and Treatment of Infectious Diseases, Zhejiang Provincial Key Laboratory for Drug Clinical Research and Evaluation, The First Affiliated Hospital, Zhejiang University, 79 QingChun Road, Hangzhou, Zhejiang 310000, China
| | - Haibin Dai
- College of Pharmaceutical Sciences, The Second Affiliated Hospital, Zhejiang University School of Medicine, Zhejiang University, Hangzhou 310058, China
| | - Yuzong Chen
- State Key Laboratory of Chemical Oncogenomics, Key Laboratory of Chemical Biology, The Graduate School at Shenzhen, Tsinghua University, Shenzhen 518055, China.,Qian Xuesen Collaborative Research Center of Astrochemistry and Space Life Sciences, Institute of Drug Discovery Technology, Ningbo University, Ningbo 315211, China
| | - Feng Zhu
- College of Pharmaceutical Sciences, The Second Affiliated Hospital, Zhejiang University School of Medicine, Zhejiang University, Hangzhou 310058, China.,Innovation Institute for Artificial Intelligence in Medicine of Zhejiang University, Alibaba-Zhejiang University Joint Research Center of Future Digital Healthcare, Hangzhou 330110, China
| |
Collapse
|
11
|
Shafik W, Matinkhah SM, Shokoor F, Sharif L. A reawakening of Machine Learning Application in Unmanned Aerial Vehicle: Future Research Motivation. EAI ENDORSED TRANSACTIONS ON INTERNET OF THINGS 2022. [DOI: 10.4108/eetiot.v8i29.987] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
Machine learning (ML) entails artificial procedures that improve robotically through experience and using data. Supervised, unsupervised, semi-supervised, and Reinforcement Learning (RL) are the main types of ML. This study mainly focuses on RL and Deep learning, since necessitates mainly sequential and consecutive decision-making context. This is a comparison to supervised and non-supervised learning due to the interactive nature of the environment. Exploiting a forthcoming accumulative compensation and its stimulus of machines, complex policy decisions. The study further analyses and presents ML perspectives depicting state-of-the-art developments with advancement, relatively depicting the future trend of RL based on its applicability in technology. It's a challenge to an Internet of Things (IoT) and demonstrates what possibly can be adopted as a solution. This study presented a summarized perspective on identified arenas on the analysis of RL. The study scrutinized that a reasonable number of the techniques engrossed in alternating policy values instead of modifying other gears in an exact state of intellectual. The study presented a strong foundation for the current studies to be adopted by the researchers from different research backgrounds to develop models, and architectures that are relevant.
Collapse
|
12
|
Tsanas A. Relevance, redundancy, and complementarity trade-off (RRCT): A principled, generic, robust feature-selection tool. PATTERNS (NEW YORK, N.Y.) 2022; 3:100471. [PMID: 35607618 PMCID: PMC9122960 DOI: 10.1016/j.patter.2022.100471] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/07/2021] [Revised: 01/19/2022] [Accepted: 02/24/2022] [Indexed: 12/21/2022]
Abstract
We present a new heuristic feature-selection (FS) algorithm that integrates in a principled algorithmic framework the three key FS components: relevance, redundancy, and complementarity. Thus, we call it relevance, redundancy, and complementarity trade-off (RRCT). The association strength between each feature and the response and between feature pairs is quantified via an information theoretic transformation of rank correlation coefficients, and the feature complementarity is quantified using partial correlation coefficients. We empirically benchmark the performance of RRCT against 19 FS algorithms across four synthetic and eight real-world datasets in indicative challenging settings evaluating the following: (1) matching the true feature set and (2) out-of-sample performance in binary and multi-class classification problems when presenting selected features into a random forest. RRCT is very competitive in both tasks, and we tentatively make suggestions on the generalizability and application of the best-performing FS algorithms across settings where they may operate effectively.
Collapse
Affiliation(s)
- Athanasios Tsanas
- Usher Institute, Edinburgh Medical School, University of Edinburgh, NINE Edinburgh BioQuarter, 9 Little France road, Edinburgh, UK.,School of Mathematics, University of Edinburgh, Edinburgh, UK.,Alan Turing Institute, British Library, London, UK
| |
Collapse
|
13
|
Chan S, Zheng J, Wang L, Wang T, Zhou X, Xu Y, Fang K. Rotating object detection in remote-sensing environment. Soft comput 2022. [DOI: 10.1007/s00500-022-07058-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
14
|
Mirmozaffari M, Yazdani R, Shadkam E, Khalili SM, Tavassoli LS, Boskabadi A. A Novel Hybrid Parametric and Non-Parametric Optimisation Model for Average Technical Efficiency Assessment in Public Hospitals during and Post-COVID-19 Pandemic. BIOENGINEERING (BASEL, SWITZERLAND) 2021; 9:bioengineering9010007. [PMID: 35049716 PMCID: PMC8772782 DOI: 10.3390/bioengineering9010007] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/29/2021] [Revised: 12/13/2021] [Accepted: 12/21/2021] [Indexed: 11/16/2022]
Abstract
The COVID-19 pandemic has had a significant impact on hospitals and healthcare systems around the world. The cost of business disruption combined with lingering COVID-19 costs has placed many public hospitals on a course to insolvency. To quickly return to financial stability, hospitals should implement efficiency measure. An average technical efficiency (ATE) model made up of data envelopment analysis (DEA) and stochastic frontier analysis (SFA) for assessing efficiency in public hospitals during and after the COVID-19 pandemic is offered. The DEA method is a non-parametric method that requires no information other than the input and output quantities. SFA is a parametric method that considers stochastic noise in data and allows statistical testing of hypotheses about production structure and degree of inefficiency. The rationale for using these two competing approaches is to balance each method's strengths, weaknesses and introduce a novel integrated approach. To show the applicability and efficacy of the proposed hybrid VRS-CRS-SFA (VCS) model, a case study is presented.
Collapse
Affiliation(s)
- Mirpouya Mirmozaffari
- Department of Industrial Engineering, Dalhousie University, 5269 Morris Street, Halifax, NS B3H 4R2, Canada
- Correspondence:
| | - Reza Yazdani
- Department of Accounting, Technical and Vocational University (TVU), Tehran 1345120727, Iran;
| | - Elham Shadkam
- Department of Industrial Engineering, Faculty of Engineering, Khayyam University, Mashhad 9189747178, Iran; (E.S.); (S.M.K.)
| | - Seyed Mohammad Khalili
- Department of Industrial Engineering, Faculty of Engineering, Khayyam University, Mashhad 9189747178, Iran; (E.S.); (S.M.K.)
| | - Leyla Sadat Tavassoli
- Department of Industrial Manufacturing and Systems Engineering, University of Texas at Arlington, Arlington, TX 76019, USA;
| | - Azam Boskabadi
- Department of Finance and Management Science, Carson College of Business, Washington State University, Pullman, WA 99163, USA;
| |
Collapse
|
15
|
Mohamed AH, Omar AA, Attya AM, Elashtokhy MMA, Zayed EM, Rizk RM. Morphological and Molecular Characterization of Some Egyptian Six-Rowed Barley ( Hordeum vulgare L.). PLANTS (BASEL, SWITZERLAND) 2021; 10:2527. [PMID: 34834891 PMCID: PMC8619447 DOI: 10.3390/plants10112527] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/22/2021] [Revised: 10/21/2021] [Accepted: 11/18/2021] [Indexed: 11/17/2022]
Abstract
Barley production is essential in Egypt. In the present study, 15 different six-rowed Egyptian barley cultivars were studied. To differentiate between the different cultivars under study in terms of morphological characteristics and ISSR, molecular characterization reactions were carried out. Moreover, four cultivars (Giza 123, Giza 126, Giza 136, and Giza 138) were selected for further studies using scanning electron microscopy (SEM). Computational analysis of the DNA barcoding sequences of the two plastid markers rbcL and matK was executed, and the results were deposited in the NCBI database. The morphological traits showed low statistical significance among the different cultivars under study via the data collected from two seasons, suggesting that the mean field performance of these Egyptian cultivars may be equal under these conditions. The results showed that the phylogenetic tree was divided into four groups, one of which contained the most closely related genotypes in the genetic distance, including Giza 124, Giza 130, Giza 138, Giza 136, and Giza 137, which converge in the indicative uses of farmers. The seed coat of the studied cultivars was "rugose". The elevation folding of the rugose pattern ranged from 11 ± 1.73 µm (Giza 126) to 14.67 ± 2.43 µm (Giza 123), suggesting variation in seed quality and its uses in feed and the food industry. According to the similarity matrix of ISSR analysis, the highest similarity value (93%) was recorded between Giza 133 and Giza 132, as well as between Giza 2000 and Giza 126. On the other hand, the lowest similarity value (80%) was recorded between Giza 130 and (Giza 133 and Giza 132), indicating that these cultivars were distantly related. Polymorphism information content (PIC) ranged from 0.26 for the primer ISSR UBC 835 to 0.37 for the primers ISSR UBC 814 and ISSR UBC 840. The current study showed that the matK gene is more mutable than the rbcL gene among the tested cultivars.
Collapse
Affiliation(s)
- Azza H. Mohamed
- Department of Agricultural Chemistry, College of Agriculture, Mansoura University, Mansoura 35516, Egypt
- Citrus Research and Education Center, University of Florida (IFAS), Lake Alfred, FL 33850, USA
| | - Ahmad A. Omar
- Citrus Research and Education Center, University of Florida (IFAS), Lake Alfred, FL 33850, USA
- Biochemistry Department, Faculty of Agriculture, Zagazig University, Zagazig 44519, Egypt
| | - Ahmed M. Attya
- Barley Research Department, Field Crops Research Institute, Agricultural Research Center, Giza 12619, Egypt;
| | | | - Ehab M. Zayed
- Cell Study Research Department, Field Crops Research Institute, Agricultural Research Center, Giza 12619, Egypt;
| | - Rehab M. Rizk
- Botany Department, Faculty of Science, Mansoura University, Mansoura 35516, Egypt;
| |
Collapse
|
16
|
Hu J, Heidari AA, Zhang L, Xue X, Gui W, Chen H, Pan Z. Chaotic diffusion‐limited aggregation enhanced grey wolf optimizer: Insights, analysis, binarization, and feature selection. INT J INTELL SYST 2021. [DOI: 10.1002/int.22744] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
Affiliation(s)
- Jiao Hu
- Department of Computer Science and Artificial Intelligence Wenzhou University Wenzhou China
| | - Ali Asghar Heidari
- Department of Computer Science and Artificial Intelligence Wenzhou University Wenzhou China
| | - Lejun Zhang
- College of Information Engineering Yangzhou University Yangzhou China
| | - Xiao Xue
- College of Computer Science and Technology Henan Polytechnic University Zhengzhou China
| | - Wenyong Gui
- Department of Computer Science and Artificial Intelligence Wenzhou University Wenzhou China
| | - Huiling Chen
- Department of Computer Science and Artificial Intelligence Wenzhou University Wenzhou China
| | - Zhifang Pan
- Zhejiang Engineering Research Center of Intelligent Medicine The First Affiliated Hospital of Wenzhou Medical University Wenzhou China
| |
Collapse
|
17
|
Qiao Z, Shan W, Jiang N, Heidari AA, Chen H, Teng Y, Turabieh H, Mafarja M. Gaussian bare‐bones gradient‐based optimization: Towards mitigating the performance concerns. INT J INTELL SYST 2021. [DOI: 10.1002/int.22658] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
Affiliation(s)
- Zenglin Qiao
- School of Emergency Management, Institute of Disaster Prevention Langfang China
| | - Weifeng Shan
- School of Emergency Management, Institute of Disaster Prevention Langfang China
- Institute of Geophysics, China Earthquake Administration Beijing China
| | - Nan Jiang
- College of Information Engineering, East China Jiaotong University Nanchang Jiangxi China
| | - Ali Asghar Heidari
- Department of Computer Science and Artificial Intelligence Wenzhou University Wenzhou China
| | - Huiling Chen
- Department of Computer Science and Artificial Intelligence Wenzhou University Wenzhou China
| | - Yuntian Teng
- Institute of Geophysics, China Earthquake Administration Beijing China
| | - Hamza Turabieh
- Department of Information Technology College of Computers and Information Technology, Taif University Taif Saudi Arabia
| | - Majdi Mafarja
- Department of Computer Science Birzeit University West Bank Palestine
| |
Collapse
|
18
|
Shi B, Ye H, Zheng L, Lyu J, Chen C, Heidari AA, Hu Z, Chen H, Wu P. Evolutionary warning system for COVID-19 severity: Colony predation algorithm enhanced extreme learning machine. Comput Biol Med 2021; 136:104698. [PMID: 34426165 PMCID: PMC8323529 DOI: 10.1016/j.compbiomed.2021.104698] [Citation(s) in RCA: 32] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2021] [Revised: 07/20/2021] [Accepted: 07/23/2021] [Indexed: 12/22/2022]
Abstract
Coronavirus Disease 2019 (COVID-19) was distributed globally at the end of December 2019 due to severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Early diagnosis and successful COVID-19 assessment are missing, clinical care is ineffective, and deaths are high. In this study, we investigate whether the level of biochemical indicators helps to discriminate and classify the severity of the COVID-19 using the machine learning method. This research creates an efficient intelligence method for the diagnosis of COVID-19 from the perspective of biochemical indexes. The framework is proposed by integrating an enhanced new stochastic called the colony predation algorithm (CPA) with a kernel extreme learning machine (KELM), abbreviated as ECPA-KELM. The core feature of the approach is the ECPA algorithm which incorporates the two main operators that have been abstained from the grey wolf optimizer and moth-flame optimizer to improve and restore the CPA research functions and are simultaneously used to optimize the parameters and to select features for KELM. The ECPA output is checked thoroughly using IEEE CEC2017 benchmark to verify the capacity of the proposed methodology. Finally, in the diagnosis of COVID-19 using biochemical indexes, the designed ECPA-KELM model and other competing KELM models based on other optimization are used. Checking statistical results will display improved predictive properties for all metrics and higher stability. ECPA-KELM can also be used to discriminate and classify the severity of the COVID-19 as a possible computer-aided method and provide effective early warning for the treatment and diagnosis of COVID-19.
Collapse
Affiliation(s)
- Beibei Shi
- Affiliated People's Hospital of Jiangsu University, 8 Dianli Road, Zhenjiang, Jiangsu, 212000, China.
| | - Hua Ye
- Department of Pulmonary and Critical Care Medicine, Affiliated Yueqing Hospital, Wenzhou Medical University, Yueqing, 325600, China.
| | - Long Zheng
- Department of Pulmonary and Critical Care Medicine, Affiliated Yueqing Hospital, Wenzhou Medical University, Yueqing, 325600, China.
| | - Juncheng Lyu
- Weifang Medical University School of Public Health, China.
| | - Cheng Chen
- Center of Clinical Research, Wuxi People's Hospital of Nanjing Medical University, Wuxi, Jiangsu, 214023, China.
| | - Ali Asghar Heidari
- School of Surveying and Geospatial Engineering, College of Engineering, University of Tehran, Tehran, Iran.
| | - Zhongyi Hu
- College of Computer Science and Artificial Intelligence, Wenzhou University, Wenzhou, 325035, China.
| | - Huiling Chen
- College of Computer Science and Artificial Intelligence, Wenzhou University, Wenzhou, 325035, China.
| | - Peiliang Wu
- Department of Pulmonary and Critical Care Medicine, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou 325000, China.
| |
Collapse
|
19
|
Wu JMT, Wei M, Wu ME, Tayeb S. Top- k dominating queries on incomplete large dataset. THE JOURNAL OF SUPERCOMPUTING 2021; 78:3976-3997. [PMID: 34421217 PMCID: PMC8369331 DOI: 10.1007/s11227-021-04005-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 07/17/2021] [Indexed: 06/13/2023]
Abstract
Top-k dominating (TKD) query is one of the methods to find the interesting objects by returning the k objects that dominate other objects in a given dataset. Incomplete datasets have missing values in uncertain dimensions, so it is difficult to obtain useful information with traditional data mining methods on complete data. BitMap Index Guided Algorithm (BIG) is a good choice for solving this problem. However, it is even harder to find top-k dominance objects on incomplete big data. When the dataset is too large, the requirements for the feasibility and performance of the algorithm will become very high. In this paper, we proposed an algorithm to apply MapReduce on the whole process with a pruning strategy, called Efficient Hadoop BitMap Index Guided Algorithm (EHBIG). This algorithm can realize TKD query on incomplete datasets through BitMap Index and use MapReduce architecture to make TKD query possible on large datasets. By using the pruning strategy, the runtime and memory usage are greatly reduced. What's more, we also proposed an improved version of EHBIG (denoted as IEHBIG) which optimizes the whole algorithm flow. Our in-depth work in this article culminates with some experimental results that clearly show that our proposed algorithm can perform well on TKD query in an incomplete large dataset and shows great performance in a Hadoop computing cluster.
Collapse
Affiliation(s)
- Jimmy Ming-Tai Wu
- College of Computer Science and Engineering, Shandong University of Science and Technology, Qindao, China
| | - Min Wei
- College of Computer Science and Engineering, Shandong University of Science and Technology, Qindao, China
| | - Mu-En Wu
- Department of Information and Finance Management, National Taipei University of Technology, Taipei, Taiwan
| | - Shahab Tayeb
- Department of Electrical and Computer Engineering, California State University, Fresno, CA USA
| |
Collapse
|
20
|
Isola LA, Chen TC, Elveny M, Alkaim AF, Thangavelu L, Kianfar E. Application of micro and porous materials as nano-reactors. REV INORG CHEM 2021. [DOI: 10.1515/revic-2021-0007] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Abstract
In general, nanostructured materials with specific size, shape and geometry have unique and different properties from bulk materials. Using reaction media with nanometer and micrometer dimensions, they can produce new nanomaterials with interesting and remarkable properties. In general, nano-reactors are nanometer-sized chambers in which chemical reactions can take place. of course, nanoreactors are somehow part of the reaction, and this is the main difference between them and micro-reactors. One of the useful solutions to achieve the environment of nanoreactors is the use of porous materials, so due to the importance of nanoreactors, porous structures of silicate and zeolite are among the most prominent and widely used compounds in this group.
Collapse
Affiliation(s)
- Lawal Adedoyin Isola
- Department of Accounting and Finance , Landmark University , Omu-Aran , Nigeria
- Sustainable Development Goal 17 (Partnership for the Goals) Research Cluster, Landmark University , Omu-Aran , Nigeria
- SDG1 (Zero Hunger) Research Cluster, Landmark University , Omu-Aran , Nigeria
- SDG6 (Clean Energy) Research Cluster, Landmark University , Omu-Aran , Nigeria
| | | | - Marischa Elveny
- Data Science & Computational Intelligence Research Group , Universitas Sumatera Utara , Medan , Indonesia
| | - Ayad F. Alkaim
- Chemistry Department , College of Science for Women, University of Babylon , Hillah , Iraq
| | - Lakshmi Thangavelu
- Department of Pharmacology , Saveetha Dental College and Hospital, Saveetha Institute of Medical and Technical Sciences, Saveetha University , Chennai , India
| | - Ehsan Kianfar
- SDG 8 (Decent Work and Economic Growth) Research Cluster, Landmark University , Omu-Aran , Nigeria
- Department of Chemical Engineering , Arak Branch, Islamic Azad University , Arak , Iran
- Young Researchers and Elite Club , Gachsaran Branch, Islamic Azad University , Gachsaran , Iran
| |
Collapse
|
21
|
Jalali SMJ, Ahmadian M, Ahmadian S, Khosravi A, Alazab M, Nahavandi S. An oppositional-Cauchy based GSK evolutionary algorithm with a novel deep ensemble reinforcement learning strategy for COVID-19 diagnosis. Appl Soft Comput 2021; 111:107675. [PMID: 34305489 PMCID: PMC8272021 DOI: 10.1016/j.asoc.2021.107675] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2020] [Revised: 05/08/2021] [Accepted: 06/28/2021] [Indexed: 12/19/2022]
Abstract
A novel coronavirus (COVID-19) has globally attracted attention as a severe respiratory condition. The epidemic has been first tracked in Wuhan, China, and has progressively been expanded in the entire world. The growing expansion of COVID-19 around the globe has made X-ray images crucial for accelerated diagnostics. Therefore, an effective computerized system must be established as a matter of urgency, to facilitate health care professionals in recognizing X-ray images from COVID-19 patients. In this work, we design a novel artificial intelligent-based automated X-ray image analysis framework based on an ensemble of deep optimized convolutional neural networks (CNNs) in order to distinguish coronavirus patients from non-patients. By developing a modified version of gaining-sharing knowledge (GSK) optimization algorithm using the Opposition-based learning (OBL) and Cauchy mutation operators, the architectures of the deployed deep CNNs are optimized automatically without performing the general trial and error procedures. After obtaining the optimized CNNs, it is also very critical to identify how to decrease the number of ensemble deep CNN classifiers to ensure the classification effectiveness. To this end, a selective ensemble approach is proposed for COVID-19 X-ray based image classification using a deep Q network that combines reinforcement learning (RL) with the optimized CNNs. This approach increases the model performance in particular and therefore decreases the ensemble size of classifiers. The experimental results show that the proposed deep RL optimized ensemble approach has an excellent performance over two popular X-ray image based COVID-19 datasets. Our proposed advanced algorithm can accurately identify the COVID-19 patients from the normal individuals with a significant accuracy of 0.991441, precision of 0.993568, recall (sensitivity) of 0.981445, F-measure of 0.989666 and AUC of 0.990337 for Kaggle dataset as well as an excellent accuracy of 0.987742, precision of 0.984334, recall (sensitivity) of 0.989123, F-measure of 0.984939 and AUC of 0.988466 for Mendely dataset.
Collapse
Affiliation(s)
| | - Milad Ahmadian
- Deparment of Computer Engineering, Razi University, Kermanshah, Iran
| | - Sajad Ahmadian
- Faculty of Information Technology, Kermanshah University of Technology, Kermanshah, Iran
| | - Abbas Khosravi
- Institute for Intelligent Systems Research and Innovation, (IISRI), Deakin University, Geelong, Australia
| | - Mamoun Alazab
- College of Engineering, IT and Environment, Charles Darwin University, Australia
| | - Saeid Nahavandi
- Institute for Intelligent Systems Research and Innovation, (IISRI), Deakin University, Geelong, Australia
| |
Collapse
|
22
|
Nanoreactors: properties, applications and characterization. INTERNATIONAL JOURNAL OF CHEMICAL REACTOR ENGINEERING 2021. [DOI: 10.1515/ijcre-2021-0069] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Abstract
Nanoreactors are a type of chemical reactor that is used mostly in nanotechnology and nanobiotechnology. These unique reactors are critical to the operation of a nano foundry, which is essentially a foundry that produces goods on a nanoscale. Active sites, such as transitional metal species, can also be added to nanoreactors. In this situation, the NR’s limited area might impact reaction rate and mechanism by increasing the contacts between reactants and active sites and changing the concentration of the reactant at the active site. Immobilization of chiral active centers inside porous materials has received a lot of interest in this context, and there have been a lot of publications proving the benefits of nano space confinement in chemical processes. The specific mechanism in which enantioselectivities are strengthened has been clarified using molecular dynamics simulations. Nanoreactors are nanometer-sized chambers with the potential to improve chemical conversions by shielding catalysts from external effects and encapsulating reactors and catalysts in a tiny space for an extended period of time. Natural and synthetic nanoreactors are the two types of nanoreactors that can be found in general. The first group has a more selective function while also having a more complicated structure, whereas the second group has more variation and a simpler structure. Synthetic nanoreactors have so far been made with a variety of molecules and large types of molecules. The space inside the nanoreactors is a good environment for the production of various nanostructures, in addition to a wide range of chemical reactions. When chemical reactions are carried out in confined spaces with nanometer dimensions and micrometer volumes, the kinetics and the entire process path are altered. Nanoreactors are restricted areas used to execute specialized chemical processes. In the cells of living organisms, numerous simultaneous reactions are based on the same concept. As a result, various biological and chemical structures with nanoreactor characteristics are used in this strategy.
Collapse
|
23
|
Kianfar E. Protein nanoparticles in drug delivery: animal protein, plant proteins and protein cages, albumin nanoparticles. J Nanobiotechnology 2021; 19:159. [PMID: 34051806 PMCID: PMC8164776 DOI: 10.1186/s12951-021-00896-3] [Citation(s) in RCA: 180] [Impact Index Per Article: 45.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2021] [Accepted: 05/12/2021] [Indexed: 12/19/2022] Open
Abstract
In this article, we will describe the properties of albumin and its biological functions, types of sources that can be used to produce albumin nanoparticles, methods of producing albumin nanoparticles, its therapeutic applications and the importance of albumin nanoparticles in the production of pharmaceutical formulations. In view of the increasing use of Abraxane and its approval for use in the treatment of several types of cancer and during the final stages of clinical trials for other cancers, to evaluate it and compare its effectiveness with conventional non formulations of chemotherapy Paclitaxel is paid. In this article, we will examine the role and importance of animal proteins in Nano medicine and the various benefits of these biomolecules for the preparation of drug delivery carriers and the characteristics of plant protein Nano carriers and protein Nano cages and their potentials in diagnosis and treatment. Finally, the advantages and disadvantages of protein nanoparticles are mentioned, as well as the methods of production of albumin nanoparticles, its therapeutic applications and the importance of albumin nanoparticles in the production of pharmaceutical formulations.
Collapse
Affiliation(s)
- Ehsan Kianfar
- ERNAM-Erciyes University Nanotechnology Application and Research Center, Kayseri, 38039, Turkey.
- Department of Analytical Chemistry, Faculty of Pharmacy, Erciyes University, Kayseri, 38039, Turkey.
| |
Collapse
|
24
|
Suggesting a Stochastic Fractal Search Paradigm in Combination with Artificial Neural Network for Early Prediction of Cooling Load in Residential Buildings. ENERGIES 2021. [DOI: 10.3390/en14061649] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/29/2023]
Abstract
Early prediction of thermal loads plays an essential role in analyzing energy-efficient buildings’ energy performance. On the other hand, stochastic algorithms have recently shown high proficiency in dealing with this issue. These are the reasons that this study is dedicated to evaluating an innovative hybrid method for predicting the cooling load (CL) in buildings with residential usage. The proposed model is a combination of artificial neural networks and stochastic fractal search (SFS–ANNs). Two benchmark algorithms, namely the grasshopper optimization algorithm (GOA) and firefly algorithm (FA) are also considered to be compared with the SFS. The non-linear effect of eight independent factors on the CL is analyzed using each model’s optimal structure. Evaluation of the results outlined that all three metaheuristic algorithms (with more than 90% correlation) can adequately optimize the ANN. In this regard, this tool’s prediction error declined by nearly 23%, 18%, and 36% by applying the GOA, FA, and SFS techniques. Moreover, all used accuracy criteria indicated the superiority of the SFS over the benchmark schemes. Therefore, it is inferred that utilizing the SFS along with ANN provides a reliable hybrid model for the early prediction of CL.
Collapse
|
25
|
Synthesizing Multi-Layer Perceptron Network with Ant Lion Biogeography-Based Dragonfly Algorithm Evolutionary Strategy Invasive Weed and League Champion Optimization Hybrid Algorithms in Predicting Heating Load in Residential Buildings. SUSTAINABILITY 2021. [DOI: 10.3390/su13063198] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
The significance of accurate heating load (HL) approximation is the primary motivation of this research to distinguish the most efficient predictive model among several neural-metaheuristic models. The proposed models are formulated through synthesizing a multi-layer perceptron network (MLP) with ant lion optimization (ALO), biogeography-based optimization (BBO), the dragonfly algorithm (DA), evolutionary strategy (ES), invasive weed optimization (IWO), and league champion optimization (LCA) hybrid algorithms. Each ensemble is optimized in terms of the operating population. Accordingly, the ALO-MLP, BBO-MLP, DA-MLP, ES-MLP, IWO-MLP, and LCA-MLP presented their best performance for population sizes of 350, 400, 200, 500, 50, and 300, respectively. The comparison was carried out by implementing a ranking system. Based on the obtained overall scores (OSs), the BBO (OS = 36) featured as the most capable optimization technique, followed by ALO (OS = 27) and ES (OS = 20). Due to the efficient performance of these algorithms, the corresponding MLPs can be promising substitutes for traditional methods used for HL analysis.
Collapse
|
26
|
Yan C, Chang X, Luo M, Zheng Q, Zhang X, Li Z, Nie F. Self-weighted Robust LDA for Multiclass Classification with Edge Classes. ACM T INTEL SYST TEC 2021. [DOI: 10.1145/3418284] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Abstract
Linear discriminant analysis (LDA) is a popular technique to learn the most discriminative features for multi-class classification. A vast majority of existing LDA algorithms are prone to be dominated by the class with very large deviation from the others, i.e., edge class, which occurs frequently in multi-class classification. First, the existence of edge classes often makes the total mean biased in the calculation of between-class scatter matrix. Second, the exploitation of ℓ
2
-norm based between-class distance criterion magnifies the extremely large distance corresponding to edge class. In this regard, a novel self-weighted robust LDA with ℓ
2,1
-norm based pairwise between-class distance criterion, called SWRLDA, is proposed for multi-class classification especially with edge classes. SWRLDA can automatically avoid the optimal mean calculation and simultaneously learn adaptive weights for each class pair without setting any additional parameter. An efficient re-weighted algorithm is exploited to derive the global optimum of the challenging ℓ
2,1
-norm maximization problem. The proposed SWRLDA is easy to implement and converges fast in practice. Extensive experiments demonstrate that SWRLDA performs favorably against other compared methods on both synthetic and real-world datasets while presenting superior computational efficiency in comparison with other techniques.
Collapse
Affiliation(s)
- Caixia Yan
- School of Electronic and Information Engineering, Xi’an Jiaotong University, Shaanxi, China
| | - Xiaojun Chang
- Faculty of Information Technology, Monash University, Australia
| | - Minnan Luo
- School of Electronic and Information Engineering, Xi’an Jiaotong University, Shaanxi, China
| | - Qinghua Zheng
- School of Electronic and Information Engineering, Xi’an Jiaotong University, Shaanxi, China
| | - Xiaoqin Zhang
- College of Computer Science and Artificial Intelligence, Wenzhou University, China
| | - Zhihui Li
- Qilu University of Technology (Shandong Academy of Sciences), Jinan, Shandong, China
| | - Feiping Nie
- Center for Optical Image Analysis and Learning, Northwestern Polytechnical University, Shaanxi, China
| |
Collapse
|
27
|
An Innovative Metaheuristic Strategy for Solar Energy Management through a Neural Networks Framework. ENERGIES 2021. [DOI: 10.3390/en14041196] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
Proper management of solar energy as an effective renewable source is of high importance toward sustainable energy harvesting. This paper offers a novel sophisticated method for predicting solar irradiance (SIr) from environmental conditions. To this end, an efficient metaheuristic technique, namely electromagnetic field optimization (EFO), is employed for optimizing a neural network. This algorithm quickly mines a publicly available dataset for nonlinearly tuning the network parameters. To suggest an optimal configuration, five influential parameters of the EFO are optimized by an extensive trial and error practice. Analyzing the results showed that the proposed model can learn the SIr pattern and predict it for unseen conditions with high accuracy. Furthermore, it provided about 10% and 16% higher accuracy compared to two benchmark optimizers, namely shuffled complex evolution and shuffled frog leaping algorithm. Hence, the EFO-supervised neural network can be a promising tool for the early prediction of SIr in practice. The findings of this research may shed light on the use of advanced intelligent models for efficient energy development.
Collapse
|
28
|
Electrical Power Prediction through a Combination of Multilayer Perceptron with Water Cycle Ant Lion and Satin Bowerbird Searching Optimizers. SUSTAINABILITY 2021. [DOI: 10.3390/su13042336] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
Predicting the electrical power (PE) output is a significant step toward the sustainable development of combined cycle power plants. Due to the effect of several parameters on the simulation of PE, utilizing a robust method is of high importance. Hence, in this study, a potent metaheuristic strategy, namely, the water cycle algorithm (WCA), is employed to solve this issue. First, a nonlinear neural network framework is formed to link the PE with influential parameters. Then, the network is optimized by the WCA algorithm. A publicly available dataset is used to feed the hybrid model. Since the WCA is a population-based technique, its sensitivity to the population size is assessed by a trial-and-error effort to attain the most suitable configuration. The results in the training phase showed that the proposed WCA can find an optimal solution for capturing the relationship between the PE and influential factors with less than 1% error. Likewise, examining the test results revealed that this model can forecast the PE with high accuracy. Moreover, a comparison with two powerful benchmark techniques, namely, ant lion optimization and a satin bowerbird optimizer, pointed to the WCA as a more accurate technique for the sustainable design of the intended system. Lastly, two potential predictive formulas, based on the most efficient WCAs, are extracted and presented.
Collapse
|
29
|
Evolutionary competitive swarm exploring optimal support vector machines and feature weighting. Soft comput 2021. [DOI: 10.1007/s00500-020-05439-w] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
30
|
Predicting Coronary Atherosclerotic Heart Disease: An Extreme Learning Machine with Improved Salp Swarm Algorithm. Symmetry (Basel) 2020. [DOI: 10.3390/sym12101651] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023] Open
Abstract
To provide an available diagnostic model for diagnosing coronary atherosclerotic heart disease to provide an auxiliary function for doctors, we proposed a new evolutionary classification model in this paper. The core of the prediction model is a kernel extreme learning machine (KELM) optimized by an improved salp swarm algorithm (SSA). To get a better subset of parameters and features, the space transformation mechanism is introduced in the optimization core to improve SSA for obtaining an optimal KELM model. The KELM model for the diagnosis of coronary atherosclerotic heart disease (STSSA-KELM) is developed based on the optimal parameters and a subset of features. In the experiment, STSSA-KELM is compared with some widely adopted machine learning methods (MLM) in coronary atherosclerotic heart disease prediction. The experimental results show that STSSA-KELM can realize excellent classification performance and more robust stability under four indications. We also compare the convergence of STSSA-KELM with other MLM; the STSSA-KELM model has demonstrated a higher classification performance. Therefore, the STSSA-KELM model can effectively help doctors to diagnose coronary heart disease.
Collapse
|
31
|
Computer Simulation Study on Adsorption and Conformation of Polymer Chains Driven by External Force. CHINESE JOURNAL OF POLYMER SCIENCE 2020. [DOI: 10.1007/s10118-020-2491-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|