Detection of coupling delay: A problem not yet solved

Lead/Lag directionality is not generally equivalent to causality in nonlinear systems: Comparison of phase slope index and conditional mutual information

Applications of causal techniques to neural time series have increased extensively over last decades, including a wide and diverse family of methods focusing on electroencephalogram (EEG) analysis. Besides connectivity inferred in defined frequency bands, there is a growing interest in the analysis of cross-frequency interactions, in particular phase and amplitude coupling and directionality. Some studies show contradicting results of coupling directionality from high frequency to low frequency signal components, in spite of generally considered modulation of a high-frequency amplitude by a low-frequency phase. We have compared two widely used methods to estimate the directionality in cross frequency coupling: conditional mutual information (CMI) and phase slope index (PSI). The latter, applied to infer cross-frequency phase-amplitude directionality from animal intracranial recordings, gives opposite results when comparing to CMI. Both metrics were tested in a numerically simulated example of unidirectionally coupled Rössler systems, which helped to find the explanation of the contradictory results: PSI correctly estimates the lead/lag relationship which, however, is not generally equivalent to causality in the sense of directionality of coupling in nonlinear systems, correctly inferred by using CMI with surrogate data testing.

Optimal time lags from causal prediction model help stratify and forecast nervous system pathology

Traditional clinical approaches diagnose disorders of the nervous system using standardized observational criteria. Although aiming for homogeneity of symptoms, this method often results in highly heterogeneous disorders. A standing question thus is how to automatically stratify a given random cohort of the population, such that treatment can be better tailored to each cluster's symptoms, and severity of any given group forecasted to provide neuroprotective therapies. In this work we introduce new methods to automatically stratify a random cohort of the population composed of healthy controls of different ages and patients with different disorders of the nervous systems. Using a simple walking task and measuring micro-fluctuations in their biorhythmic motions, we combine non-linear causal network connectivity analyses in the temporal and frequency domains with stochastic mapping. The methods define a new type of internal motor timings. These are amenable to create personalized clinical interventions tailored to self-emerging clusters signaling fundamentally different types of gait pathologies. We frame our results using the principle of reafference and operationalize them using causal prediction, thus renovating the theory of internal models for the study of neuromotor control.

Spectral Ranking of Causal Influence in Complex Systems

Similar to natural complex systems, such as the Earth’s climate or a living cell, semiconductor lithography systems are characterized by nonlinear dynamics across more than a dozen orders of magnitude in space and time. Thousands of sensors measure relevant process variables at appropriate sampling rates, to provide time series as primary sources for system diagnostics. However, high-dimensionality, non-linearity and non-stationarity of the data are major challenges to efficiently, yet accurately, diagnose rare or new system issues by merely using model-based approaches. To reliably narrow down the causal search space, we validate a ranking algorithm that applies transfer entropy for bivariate interaction analysis of a system’s multivariate time series to obtain a weighted directed graph, and graph eigenvector centrality to identify the system’s most important sources of original information or causal influence. The results suggest that this approach robustly identifies the true drivers or causes of a complex system’s deviant behavior, even when its reconstructed information transfer network includes redundant edges.

The Human Organism as an Integrated Interaction Network: Recent Conceptual and Methodological Challenges

The field of Network Physiology aims to advance our understanding of how physiological systems and sub-systems interact to generate a variety of behaviors and distinct physiological states, to optimize the organism's functioning, and to maintain health. Within this framework, which considers the human organism as an integrated network, vertices are associated with organs while edges represent time-varying interactions between vertices. Likewise, vertices may represent networks on smaller spatial scales leading to a complex mixture of interacting homogeneous and inhomogeneous networks of networks. Lacking adequate analytic tools and a theoretical framework to probe interactions within and among diverse physiological systems, current approaches focus on inferring properties of time-varying interactions-namely strength, direction, and functional form-from time-locked recordings of physiological observables. To this end, a variety of bivariate or, in general, multivariate time-series-analysis techniques, which are derived from diverse mathematical and physical concepts, are employed and the resulting time-dependent networks can then be further characterized with methods from network theory. Despite the many promising new developments, there are still problems that evade from a satisfactory solution. Here we address several important challenges that could aid in finding new perspectives and inspire the development of theoretic and analytical concepts to deal with these challenges and in studying the complex interactions between physiological systems.

A Refinement of Recurrence Analysis to Determine the Time Delay of Causality in Presence of External Perturbations

This article describes a refinement of recurrence analysis to determine the delay in the causal influence between a driver and a target, in the presence of additional perturbations affecting the time series of the response observable. The methodology is based on the definition of a new type of recurrence plots, the Conditional Joint Recurrence plot. The potential of the proposed approach resides in the great flexibility of recurrence plots themselves, which allows extending the technique to more than three quantities. Autoregressive time series, both linear and nonlinear, with different couplings and percentage of additive Gaussian noise have been investigated in detail, with and without outliers. The approach has also been applied to the case of synthetic periodic signals, representing realistic situations of synchronization experiments in thermonuclear fusion. The results obtained have been very positive; the proposed Conditional Joint Recurrence plots have always managed to identify the right interval of the causal influences and are very competitive with alternative techniques such as the Conditional Transfer Entropy.

Image-Based Methods to Investigate Synchronization between Time Series Relevant for Plasma Fusion Diagnostics

Advanced time series analysis and causality detection techniques have been successfully applied to the assessment of synchronization experiments in tokamaks, such as Edge Localized Modes (ELMs) and sawtooth pacing. Lag synchronization is a typical strategy for fusion plasma instability control by pace-making techniques. The major difficulty, in evaluating the efficiency of the pacing methods, is the coexistence of the causal effects with the periodic or quasi-periodic nature of the plasma instabilities. In the present work, a set of methods based on the image representation of time series, are investigated as tools for evaluating the efficiency of the pace-making techniques. The main options rely on the Gramian Angular Field (GAF), the Markov Transition Field (MTF), previously used for time series classification, and the Chaos Game Representation (CGR), employed for the visualization of large collections of long time series. The paper proposes an original variation of the Markov Transition Matrix, defined for a couple of time series. Additionally, a recently proposed method, based on the mapping of time series as cross-visibility networks and their representation as images, is included in this study. The performances of the method are evaluated on synthetic data and applied to JET measurements.

Detecting causality from time series in a machine learning framework

Detecting causality from observational data is a challenging problem. Here, we propose a machine learning based causality approach, Reservoir Computing Causality (RCC), in order to systematically identify causal relationships between variables. We demonstrate that RCC is able to identify the causal direction, coupling delay, and causal chain relations from time series. Compared to a well-known phase space reconstruction based causality method, Extended Convergent Cross Mapping, RCC does not require the estimation of the embedding dimension and delay time. Moreover, RCC has three additional advantages: (i) robustness to noisy time series; (ii) computational efficiency; and (iii) seamless causal inference from high-dimensional data. We also illustrate the power of RCC in identifying remote causal interactions of high-dimensional systems and demonstrate its usability on a real-world example using atmospheric circulation data. Our results suggest that RCC can accurately detect causal relationships in complex systems.

Causality Detection Methods Applied to the Investigation of Malaria Epidemics

Malaria, a disease with major health and socio-economic impacts, is driven by multiple factors, including a complex interaction with various climatic variables. In this paper, five methods developed for inferring causal relations between dynamic processes based on the information encapsulated in time series are applied on cases previously studied in literature by means of statistical methods. The causality detection techniques investigated in the paper are: a version of the kernel Granger causality, transfer entropy, recurrence plot, causal decomposition and complex networks. The methods provide coherent results giving a quite good confidence in the conclusions.

Ordinal partition transition network based complexity measures for inferring coupling direction and delay from time series

It has been demonstrated that the construction of ordinal partition transition networks (OPTNs) from time series provides a prospective approach to improve our understanding of the underlying dynamical system. In this work, we introduce a suite of OPTN based complexity measures to infer the coupling direction between two dynamical systems from pairs of time series. For several examples of coupled stochastic processes, we demonstrate that our approach is able to successfully identify interaction delays of both unidirectional and bidirectional coupling configurations. Moreover, we show that the causal interaction between two coupled chaotic Hénon maps can be captured by the OPTN based complexity measures for a broad range of coupling strengths before the onset of synchronization. Finally, we apply our method to two real-world observational climate time series, disclosing the interaction delays underlying the temperature records from two distinct stations in Oxford and Vienna. Our results suggest that ordinal partition transition networks can be used as complementary tools for causal inference tasks and provide insights into the potentials and theoretical foundations of time series networks.

Forcing of late Pleistocene ice volume by spatially variable summer energy

Changes in Earth’s orbit set the pace of glacial cycles, but the role of spatial variability in the insolation forcing of global ice volume remains unknown. Here, we leverage the intrinsic dynamical information in empirical records to show that ice volume responded to summer energy at high northern latitudes, as predicted by Milankovitch theory. However, the external forcing of ice volume encompasses insolation signals with a wide range of orbital frequency content, and cannot be fully accounted for by a unique time series. Southern mid-latitude insolation forcing coincides with the position of the subtropical front and the westerlies, which have been implicated in Quaternary climate changes. Dominant forcing modes at northern mid-latitudes are anti-phased with the canonical Milankovitch forcing, consistent with ice volume sensitivity to latitudinal insolation gradients.

Detecting directional couplings from multivariate flows by the joint distance distribution

The identification of directional couplings (or drive-response relationships) in the analysis of interacting nonlinear systems is an important piece of information to understand their dynamics. This task is especially challenging when the analyst's knowledge of the systems reduces virtually to time series of observations. Spurred by the success of Granger causality in econometrics, the study of cause-effect relationships (not to be confounded with statistical correlations) was extended to other fields, thus favoring the introduction of further tools such as transfer entropy. Currently, the research on old and new causality tools along with their pitfalls and applications in ever more general situations is going through a time of much activity. In this paper, we re-examine the method of the joint distance distribution to detect directional couplings between two multivariate flows. This method is based on the forced Takens theorem, and, more specifically, it exploits the existence of a continuous mapping from the reconstructed attractor of the response system to the reconstructed attractor of the driving system, an approach that is increasingly drawing the attention of the data analysts. The numerical results with Lorenz and Rössler oscillators in three different interaction networks (including hidden common drivers) are quite satisfactory, except when phase synchronization sets in. They also show that the method of the joint distance distribution outperforms the lowest dimensional transfer entropy in the cases considered. The robustness of the results to the sampling interval, time series length, observational noise, and metric is analyzed too.

Detecting causality using symmetry transformations

Detecting causality between variables in a time series is a challenge, particularly when the relationship is nonlinear and the dataset is noisy. Here, we present a novel tool for detecting causality that leverages the properties of symmetry transformations. The aim is to develop an algorithm with the potential to detect both unidirectional and bidirectional coupling for nonlinear systems in the presence of significant sampling noise. Most of the existing tools for detecting causality can make determinations of directionality, but those determinations are relatively fragile in the presence of noise. The novel algorithm developed in the present study is robust and very conservative in that it reliably detects causal structure with a very low rate of error even in the presence of high sampling noise. We demonstrate the performance of our algorithm and compare it with two popular model-free methods, namely transfer entropy and convergent cross map. This first implementation of the method of symmetry transformations is limited in that it applies only to first-order autonomous systems.

Causality, dynamical systems and the arrow of time

Using several methods for detection of causality in time series, we show in a numerical study that coupled chaotic dynamical systems violate the first principle of Granger causality that the cause precedes the effect. While such a violation can be observed in formal applications of time series analysis methods, it cannot occur in nature, due to the relation between entropy production and temporal irreversibility. The obtained knowledge, however, can help to understand the type of causal relations observed in experimental data, namely, it can help to distinguish linear transfer of time-delayed signals from nonlinear interactions. We illustrate these findings in causality detected in experimental time series from the climate system and mammalian cardio-respiratory interactions.