Neural networks and chaos: construction, evaluation of chaotic networks, and prediction of chaos with multilayer feedforward networks

Neural Networks as Geometric Chaotic Maps

The use of artificial neural networks (NNs) as models of chaotic dynamics has been rapidly expanding. Still, a theoretical understanding of how NNs learn chaos is lacking. Here, we employ a geometric perspective to show that NNs can efficiently model chaotic dynamics by becoming structurally chaotic themselves. We first confirm NN's efficiency in emulating chaos by showing that a parsimonious NN trained only on few data points can reconstruct strange attractors, extrapolate outside training data boundaries, and accurately predict local divergence rates. We then posit that the trained network's map comprises sequential geometric stretching, rotation, and compression operations. These geometric operations indicate topological mixing and chaos, explaining why NNs are naturally suitable to emulate chaotic dynamics.

Emergent Bioanalogous Properties of Blockchain-based Distributed Systems

We apply a novel definition of biological systems to a series of reproducible observations on a blockchain-based distributed virtual machine (dVM). We find that such blockchain-based systems display a number of bioanalogous properties, such as response to the environment, growth and change, replication, and homeostasis, that fit some definitions of life. We further present a conceptual model for a simple self-sustaining, self-organizing, self-regulating distributed 'organism' as an operationally closed system that would fulfill all basic definitions and criteria for life, and describe developing technologies, particularly artificial neural network (ANN) based artificial intelligence (AI), that would enable it in the near future. Notably, such systems would have a number of specific advantages over biological life, such as the ability to pass acquired traits to offspring, significantly improved speed, accuracy, and redundancy of their genetic carrier, and potentially unlimited lifespans. Public blockchain-based dVMs provide an uncontained environment for the development of artificial general intelligence (AGI) with the capability to evolve by self-direction.

Convergence versus Divergence Behaviors of Asynchronous Iterations, and Their Applications in Concrete Situations

Asynchronous iterations have long been used in distributed computing algorithms to produce calculation methods that are potentially faster than a serial or parallel approach, but whose convergence is more difficult to demonstrate. Conversely, over the past decade, the study of the complex dynamics of asynchronous iterations has been initiated and deepened, as well as their use in computer security and bioinformatics. The first work of these studies focused on chaotic discrete dynamical systems, and links were established between these dynamics on the one hand, and between random or complex behaviours in the sense of the theory of the same name. Computer security applications have focused on pseudo-random number generation, hash functions, hidden information, and various security aspects of wireless sensor networks. At the bioinformatics level, this study of complex systems has allowed an original approach to understanding the evolution of genomes and protein folding. These various contributions are detailed in this review article, which is an extension of the paper “An update on the topological properties of asynchronous iterations” presented during the Sixth International Conference on Parallel, Distributed, GPU and Cloud Computing (Pareng 2019).

Forecasting of extreme flood events using different satellite precipitation products and wavelet-based machine learning methods

An accurate and timely forecast of extreme events can mitigate negative impacts and enhance preparedness. Real-time forecasting of extreme flood events with longer lead times is difficult for regions with sparse rain gauges, and in such situations, satellite precipitation could be a better alternative. Machine learning methods have shown promising results for flood forecasting with minimum variables indicating the underlying nonlinear complex hydrologic system. Integration of machine learning methods in extreme event forecasting motivates us to develop reliable flood forecasting models that are simple, accurate, and applicable in data scare regions. In this study, we develop a forecasting method using the satellite precipitation product and wavelet-based machine learning models. We test the proposed approach in the flood-prone Vamsadhara river basin, India. The validation results show that the proposed method is promising and has the potential to forecast extreme flood events with longer lead times in comparison with the other benchmark models.