Shen Y, Zhu S, Liu X, Wen S. Multistability and associative memory of neural networks with Morita-like activation functions.
Neural Netw 2021;
142:162-170. [PMID:
34000563 DOI:
10.1016/j.neunet.2021.04.035]
[Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2020] [Revised: 04/11/2021] [Accepted: 04/26/2021] [Indexed: 11/25/2022]
Abstract
This paper presents the multistability analysis and associative memory of neural networks (NNs) with Morita-like activation functions. In order to seek larger memory capacity, this paper proposes Morita-like activation functions. In a weakened condition, this paper shows that the NNs with n-neurons have (2m+1)n equilibrium points (Eps) and (m+1)n of them are locally exponentially stable, where the parameter m depends on the Morita-like activation functions, called Morita parameter. Also the attraction basins are estimated based on the state space partition. Moreover, this paper applies these NNs into associative memories (AMs). Compared with the previous related works, the number of Eps and AM's memory capacity are extensively increased. The simulation results are illustrated and some reliable associative memories examples are shown at the end of this paper.
Collapse