1
|
Liu W, Sun J, Liu G, Fu S, Liu M, Zhu Y, Gao Q. Improved GWO and its application in parameter optimization of Elman neural network. PLoS One 2023; 18:e0288071. [PMID: 37418374 DOI: 10.1371/journal.pone.0288071] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2023] [Accepted: 06/17/2023] [Indexed: 07/09/2023] Open
Abstract
Traditional neural networks used gradient descent methods to train the network structure, which cannot handle complex optimization problems. We proposed an improved grey wolf optimizer (SGWO) to explore a better network structure. GWO was improved by using circle population initialization, information interaction mechanism and adaptive position update to enhance the search performance of the algorithm. SGWO was applied to optimize Elman network structure, and a new prediction method (SGWO-Elman) was proposed. The convergence of SGWO was analyzed by mathematical theory, and the optimization ability of SGWO and the prediction performance of SGWO-Elman were examined using comparative experiments. The results show: (1) the global convergence probability of SGWO was 1, and its process was a finite homogeneous Markov chain with an absorption state; (2) SGWO not only has better optimization performance when solving complex functions of different dimensions, but also when applied to Elman for parameter optimization, SGWO can significantly optimize the network structure and SGWO-Elman has accurate prediction performance.
Collapse
Affiliation(s)
- Wei Liu
- Institute of Mathematics and Systems Science, Liaoning Technical University, Fuxin, China
- Institute of Intelligent Engineering and Mathematics, Liaoning Technical University, Fuxin, China
| | - Jiayang Sun
- College of Science, Liaoning Technical University, Fuxin, China
- Institute of Mathematics and Systems Science, Liaoning Technical University, Fuxin, China
- Institute of Intelligent Engineering and Mathematics, Liaoning Technical University, Fuxin, China
| | - Guangwei Liu
- College of Mines, Liaoning Technical University, Fuxin, China
| | - Saiou Fu
- College of Civil Engineering, Liaoning Technical University, Fuxin, China
| | - Mengyuan Liu
- College of Science, Liaoning Technical University, Fuxin, China
- Institute of Mathematics and Systems Science, Liaoning Technical University, Fuxin, China
- Institute of Intelligent Engineering and Mathematics, Liaoning Technical University, Fuxin, China
| | - Yixin Zhu
- College of Science, Liaoning Technical University, Fuxin, China
- Institute of Mathematics and Systems Science, Liaoning Technical University, Fuxin, China
- Institute of Intelligent Engineering and Mathematics, Liaoning Technical University, Fuxin, China
| | - Qi Gao
- College of Science, Liaoning Technical University, Fuxin, China
- Institute of Mathematics and Systems Science, Liaoning Technical University, Fuxin, China
- Institute of Intelligent Engineering and Mathematics, Liaoning Technical University, Fuxin, China
| |
Collapse
|
2
|
Tang H, Wu H, Zhao Y, Li R. Joint Computation Offloading and Resource Allocation Under Task-Overflowed Situations in Mobile-Edge Computing. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT 2022. [DOI: 10.1109/tnsm.2021.3135389] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Affiliation(s)
- Huijun Tang
- Center for Applied Mathematics, Tianjin University, Tianjin, China
| | - Huaming Wu
- Center for Applied Mathematics, Tianjin University, Tianjin, China
| | - Yubin Zhao
- School of Microelectronics Science and Technology, Sun Yat-sen University, Zhuhai, China
| | - Ruidong Li
- Institute of Science and Engineering, Kanazawa University, Kanazawa, Japan
| |
Collapse
|
3
|
Multiobjective Optimization for Planning the Service Areas of Smart Parcel Locker Facilities in Logistics Last Mile Delivery. MATHEMATICS 2022. [DOI: 10.3390/math10030422] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
Abstract
The planning of the location service areas of smart parcel locker facilities became a critical aspect of logistics last mile delivery. In e-commerce, the efficiency of delivering merchandise from retailer warehouses to customers determines the competitiveness of retailers and delivery operators. The considerable increases in e-commerce transactions and safety concerns under the COVID-19 (Coronavirus disease 2019) pandemic made home delivery services even more inefficient than before, which resulted in the considerable increase in social costs. In numerous countries, smart parcel lockers were adopted to increase delivery efficiency, decrease the risk of COVID-19 infection, and reduce the burden on society. This study proposed a multiobjective optimization mathematical model for investigating the planning of the location service areas of smart parcel locker facilities, and then the optimization mathematical model was solved using a combination of the Taguchi method (TA) and nondominant sorting genetic algorithm II (NSGA-II). Finally, this composite approach was applied to a case study in producing favorable solutions for facility location service area planning.
Collapse
|
4
|
Pandey HM, Trovati M, Bessis N. Statistical exploratory analysis of mask-fill reproduction operators of Genetic Algorithms. Appl Soft Comput 2021. [DOI: 10.1016/j.asoc.2021.107087] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
5
|
|
6
|
Analyzing evolutionary optimization and community detection algorithms using regression line dominance. Inf Sci (N Y) 2017. [DOI: 10.1016/j.ins.2017.02.050] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
7
|
|
8
|
Derrac J, García S, Hui S, Suganthan PN, Herrera F. Analyzing convergence performance of evolutionary algorithms: A statistical approach. Inf Sci (N Y) 2014. [DOI: 10.1016/j.ins.2014.06.009] [Citation(s) in RCA: 74] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
9
|
Mills KL, Filliben JJ, Haines AL. Determining Relative Importance and Effective Settings for Genetic Algorithm Control Parameters. EVOLUTIONARY COMPUTATION 2014; 23:309-342. [PMID: 25254350 DOI: 10.1162/evco_a_00137] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
Setting the control parameters of a genetic algorithm to obtain good results is a long-standing problem. We define an experiment design and analysis method to determine relative importance and effective settings for control parameters of any evolutionary algorithm, and we apply this method to a classic binary-encoded genetic algorithm (GA). Subsequently, as reported elsewhere, we applied the GA, with the control parameter settings determined here, to steer a population of cloud-computing simulators toward behaviors that reveal degraded performance and system collapse. GA-steered simulators could serve as a design tool, empowering system engineers to identify and mitigate low-probability, costly failure scenarios. In the existing GA literature, we uncovered conflicting opinions and evidence regarding key GA control parameters and effective settings to adopt. Consequently, we designed and executed an experiment to determine relative importance and effective settings for seven GA control parameters, when applied across a set of numerical optimization problems drawn from the literature. This paper describes our experiment design, analysis, and results. We found that crossover most significantly influenced GA success, followed by mutation rate and population size and then by rerandomization point and elite selection. Selection method and the precision used within the chromosome to represent numerical values had least influence. Our findings are robust over 60 numerical optimization problems.
Collapse
Affiliation(s)
- K L Mills
- Information Technology Laboratory, National Institute of Standards and Technology, Gaithersburg, MD 20899, USA
| | - J J Filliben
- Information Technology Laboratory, National Institute of Standards and Technology, Gaithersburg, MD 20899, USA
| | - A L Haines
- Warren Rogers Associates, Middletown, RI 20842, USA
| |
Collapse
|
10
|
Cheng SP, Lu XM, Zhou XZ. Globally optimal selection of web composite services based on univariate marginal distribution algorithm. Neural Comput Appl 2013. [DOI: 10.1007/s00521-013-1440-9] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
11
|
Castillo PA, Arenas MG, Rico N, Mora AM, García-Sánchez P, Laredo JLJ, Merelo JJ. Determining the significance and relative importance of parameters of a simulated quenching algorithm using statistical tools. APPL INTELL 2011. [DOI: 10.1007/s10489-011-0324-x] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/15/2022]
|
12
|
de Oca MAM, Stutzle T, Van den Enden K, Dorigo M. Incremental Social Learning in Particle Swarms. ACTA ACUST UNITED AC 2011; 41:368-84. [DOI: 10.1109/tsmcb.2010.2055848] [Citation(s) in RCA: 86] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
13
|
Shilane D, Martikainen J, Dudoit S, Ovaska SJ. A general framework for statistical performance comparison of evolutionary computation algorithms. Inf Sci (N Y) 2008. [DOI: 10.1016/j.ins.2008.03.007] [Citation(s) in RCA: 72] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
14
|
Zhang W, Yano K, Karube I. Improving the efficiency of evolutionary de novo peptide design: strategies for probing configuration and parameter settings. Biosystems 2006; 88:35-55. [PMID: 16870325 DOI: 10.1016/j.biosystems.2006.04.007] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2004] [Revised: 11/30/2005] [Accepted: 04/11/2006] [Indexed: 11/28/2022]
Abstract
Evolutionary molecular design based on genetic algorithms (GAs) has been demonstrated to be a flexible and efficient optimization approach with potential for locating global optima. Its efficacy and efficiency are largely dependent on the operations and control parameters of the GAs. Accordingly, we have explored new operations and probed good parameter setting through simulations. The findings have been evaluated in a helical peptide design according to "Parameter setting by analogy" strategy; highly helical peptides have been successfully obtained with a population of only 16 peptides and 5 iterative cycles. The results indicate that new operations such as multi-step crossover-mutation are able to improve the explorative efficiency and to reduce the sensitivity to crossover and mutation rates (CR-MR). The efficiency of the peptide design has been furthermore improved by setting the GAs at the good CR-MR setting determined through simulation. These results suggest that probing the operations and parameter settings through simulation in combination with "Parameter setting by analogy" strategy provides an effective framework for improving the efficiency of the approach. Consequently, we conclude that this framework will be useful for contributing to practical peptide design, and gaining a better understanding of evolutionary molecular design.
Collapse
Affiliation(s)
- Wuming Zhang
- Research Center for Advanced Science and Technology, The University of Tokyo, 4-6-1 Komaba, Tokyo 153-8904, Japan
| | | | | |
Collapse
|
15
|
|
16
|
Zhang C, Su S, Chen J. A Novel Genetic Algorithm for QoS-Aware Web Services Selection. DATA ENGINEERING ISSUES IN E-COMMERCE AND SERVICES 2006. [DOI: 10.1007/11780397_18] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
|
17
|
MAGAD-BFS: A learning method for Beta fuzzy systems based on a multi-agent genetic algorithm. Soft comput 2005. [DOI: 10.1007/s00500-005-0012-z] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
18
|
Self-Adapting Evolutionary Parameters: Encoding Aspects for Combinatorial Optimization Problems. EVOLUTIONARY COMPUTATION IN COMBINATORIAL OPTIMIZATION 2005. [DOI: 10.1007/978-3-540-31996-2_15] [Citation(s) in RCA: 24] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
|