Entropy measures, entropy estimators, and their performance in quantifying complex dynamics: Effects of artifacts, nonstationarity, and long-range correlations

Respiratory modulation of the heart rate: A potential biomarker of cardiorespiratory function in human

In recent decade, wearable digital devices have shown potentials for the discovery of novel biomarkers of humans' physiology and behavior. Heart rate (HR) and respiration rate (RR) are most crucial bio-signals in humans' digital phenotyping research. HR is a continuous and non-invasive proxy to autonomic nervous system and ample evidence pinpoints the critical role of respiratory modulation of cardiac function. In the present study, we recorded longitudinal (7 days, 4.63 ± 1.52) HR and RR of 89 freely behaving human subjects (Female: 39, age 57.28 ± 5.67, Male: 50, age 58.48 ± 6.32) and analyzed their dynamics using linear models and information theoretic measures. While HR's linear and nonlinear characteristics were expressed within the plane of the HR-RR directed flow of information (HR→RR - RR→HR), their dynamics were determined by its RR→HR axis. More importantly, RR→HR quantified the effect of alcohol consumption on individuals' cardiorespiratory function independent of their consumed amount of alcohol, thereby signifying the presence of this habit in their daily life activities. The present findings provided evidence for the critical role of the respiratory modulation of HR, which was previously only studied in non-human animals. These results can contribute to humans' phenotyping research by presenting RR→HR as a digital diagnosis/prognosis marker of humans' cardiorespiratory pathology.

Integrated information decomposition unveils major structural traits of in silico and in vitro neuronal networks

The properties of complex networked systems arise from the interplay between the dynamics of their elements and the underlying topology. Thus, to understand their behavior, it is crucial to convene as much information as possible about their topological organization. However, in large systems, such as neuronal networks, the reconstruction of such topology is usually carried out from the information encoded in the dynamics on the network, such as spike train time series, and by measuring the transfer entropy between system elements. The topological information recovered by these methods does not necessarily capture the connectivity layout, but rather the causal flow of information between elements. New theoretical frameworks, such as Integrated Information Decomposition (Φ-ID), allow one to explore the modes in which information can flow between parts of a system, opening a rich landscape of interactions between network topology, dynamics, and information. Here, we apply Φ-ID on in silico and in vitro data to decompose the usual transfer entropy measure into different modes of information transfer, namely, synergistic, redundant, or unique. We demonstrate that the unique information transfer is the most relevant measure to uncover structural topological details from network activity data, while redundant information only introduces residual information for this application. Although the retrieved network connectivity is still functional, it captures more details of the underlying structural topology by avoiding to take into account emergent high-order interactions and information redundancy between elements, which are important for the functional behavior, but mask the detection of direct simple interactions between elements constituted by the structural network topology.

Wearable Ring-Shaped Biomedical Device for Physiological Monitoring through Finger-Based Acquisition of Electrocardiographic, Photoplethysmographic, and Galvanic Skin Response Signals: Design and Preliminary Measurements

Wearable health devices (WHDs) are rapidly gaining ground in the biomedical field due to their ability to monitor the individual physiological state in everyday life scenarios, while providing a comfortable wear experience. This study introduces a novel wearable biomedical device capable of synchronously acquiring electrocardiographic (ECG), photoplethysmographic (PPG), galvanic skin response (GSR) and motion signals. The device has been specifically designed to be worn on a finger, enabling the acquisition of all biosignals directly on the fingertips, offering the significant advantage of being very comfortable and easy to be employed by the users. The simultaneous acquisition of different biosignals allows the extraction of important physiological indices, such as heart rate (HR) and its variability (HRV), pulse arrival time (PAT), GSR level, blood oxygenation level (SpO2), and respiratory rate, as well as motion detection, enabling the assessment of physiological states, together with the detection of potential physical and mental stress conditions. Preliminary measurements have been conducted on healthy subjects using a measurement protocol consisting of resting states (i.e., SUPINE and SIT) alternated with physiological stress conditions (i.e., STAND and WALK). Statistical analyses have been carried out among the distributions of the physiological indices extracted in time, frequency, and information domains, evaluated under different physiological conditions. The results of our analyses demonstrate the capability of the device to detect changes between rest and stress conditions, thereby encouraging its use for assessing individuals' physiological state. Furthermore, the possibility of performing synchronous acquisitions of PPG and ECG signals has allowed us to compare HRV and pulse rate variability (PRV) indices, so as to corroborate the reliability of PRV analysis under stationary physical conditions. Finally, the study confirms the already known limitations of wearable devices during physical activities, suggesting the use of algorithms for motion artifact correction.

From physiological complexity to data interactions-A case study of recordings from exercise monitoring

The popularity of nonlinear analysis has been growing simultaneously with the technology of effort monitoring. Therefore, considering the simple methods of physiological data collection and the approaches from the information domain, we proposed integrating univariate and bivariate analysis for the rest and effort comparison. Two sessions separated by an intensive training program were studied. Nine subjects participated in the first session (S1) and seven in the second session (S2). The protocol included baseline (BAS), exercise, and recovery phase. During all phases, electrocardiogram (ECG) was recorded. For the analysis, we selected corresponding data lengths of BAS and exercise usually lasting less than 5 min. We found the utility of the differences between original data and their surrogates for sample entropy Sdiff and Kullback-Leibler divergence KLDdiff. Sdiff of heart rate variability was negative in BAS and exercise but its sensitivity for phases discrimination was not satisfactory. We studied the bivariate analysis of RR intervals and corresponding QT peaks by Interlayer Mutual Information (IMI) and average edge overlap (AVO) markers. While the IMI parameter decreases in exercise conditions, AVO increased in effort compared to BAS. These findings conclude that researchers should consider a bivariate analysis of extracted RR intervals and corresponding QT datasets, when only ECG is recorded during tests.

NLDyn - An open source MATLAB toolbox for the univariate and multivariate nonlinear dynamical analysis of physiological data

BACKGROUND AND OBJECTIVE

We present NLDyn, an open-source MATLAB toolbox tailored for in-depth analysis of nonlinear dynamics in biomedical signals. Our objective is to offer a user-friendly yet comprehensive platform for researchers to explore the intricacies of time series data.

METHODS

NLDyn integrates approximately 80 distinct methods, encompassing both univariate and multivariate nonlinear dynamics, setting it apart from existing solutions. This toolbox combines state-of-the-art nonlinear dynamical techniques with advanced multivariate entropy methods, providing users with powerful analytical capabilities. NLDyn enables analyses with or without a sliding window, and users can easily access and customize default parameters.

RESULTS

NLDyn generates results that are both exportable and visually informative, facilitating seamless integration into research and presentations. Its ongoing development ensures it remains at the forefront of nonlinear dynamics analysis.

CONCLUSIONS

NLDyn is a valuable resource for researchers in the biomedical field, offering an intuitive interface and a wide array of nonlinear analysis tools. Its integration of advanced techniques empowers users to gain deeper insights from their data. As we continually refine and expand NLDyn's capabilities, we envision it becoming an indispensable tool for the exploration of complex dynamics in biomedical signals.

Inferring connectivity of an oscillatory network via the phase dynamics reconstruction

We review an approach for reconstructing oscillatory networks' undirected and directed connectivity from data. The technique relies on inferring the phase dynamics model. The central assumption is that we observe the outputs of all network nodes. We distinguish between two cases. In the first one, the observed signals represent smooth oscillations, while in the second one, the data are pulse-like and can be viewed as point processes. For the first case, we discuss estimating the true phase from a scalar signal, exploiting the protophase-to-phase transformation. With the phases at hand, pairwise and triplet synchronization indices can characterize the undirected connectivity. Next, we demonstrate how to infer the general form of the coupling functions for two or three oscillators and how to use these functions to quantify the directional links. We proceed with a different treatment of networks with more than three nodes. We discuss the difference between the structural and effective phase connectivity that emerges due to high-order terms in the coupling functions. For the second case of point-process data, we use the instants of spikes to infer the phase dynamics model in the Winfree form directly. This way, we obtain the network's coupling matrix in the first approximation in the coupling strength.

Nonextensive realizations in interacting ion channels: Implications for mechano-electrical transducer mechanisms

We propose a theoretical model to investigate the thermodynamics of single and coupled two-state ion channels, associated with mechanoelectrical transduction (MET) and hair cell biophysics. The modeling was based on the Tsallis nonextensive statistical mechanics. The choice for a nonextensive framework in modeling ion channels is encouraged on the fact that we take into account the presence of interactions or long-range correlations in the dynamics of single and coupled ion channels. However, the basic assumptions that support Boltzmann-Gibbs statistics, traditionally used to model ion channel dynamics, state that the system is formed by independent or weakly interacting elements. Despite being well studied in many biological systems, the literature has not yet addressed the study of both entropy and mutual information related to isolated or physically interacting pairs of MET channels. Inspired by hair cell biophysics, we show how the presence of nonextensivity, or subadditivity and superadditivity modulates the nonextensive entropy and mutual information as functions of stereocilia displacements. We also observe that the magnitude of the interaction between the two channels, given by a nonextensive parameter, influences the amplitude of the nonextensive joint entropy and mutual information as functions of the hair cell displacements. Finally, we show how nonextensivity regulates the current versus displacement curve for a single and a pair of interacting two-state channels. The present findings shed light on the thermodynamic process involved in the molecular mechanisms of the auditory system.

Nonadditive Entropy Application to Detrended Force Sensor Data to Indicate Balance Disorder of Patients with Vestibular System Dysfunction

The healthy function of the vestibular system (VS) is of vital importance for individuals to carry out their daily activities independently and safely. This study carries out Tsallis entropy (TE)-based analysis on insole force sensor data in order to extract features to differentiate between healthy and VS-diseased individuals. Using a specifically developed algorithm, we detrend the acquired data to examine the fluctuation around the trend curve in order to consider the individual's walking habit and thus increase the accuracy in diagnosis. It is observed that the TE value increases for diseased people as an indicator of the problem of maintaining balance. As one of the main contributions of this study, in contrast to studies in the literature that focus on gait dynamics requiring extensive walking time, we directly process the instantaneous pressure values, enabling a significant reduction in the data acquisition period. The extracted feature set is then inputted into fundamental classification algorithms, with support vector machine (SVM) demonstrating the highest performance, achieving an average accuracy of 95%. This study constitutes a significant step in a larger project aiming to identify the specific VS disease together with its stage. The performance achieved in this study provides a strong motivation to further explore this topic.

Threshold distribution of equal states for quantitative amplitude fluctuations

Objective. The distribution of equal states (DES) quantifies amplitude fluctuations in biomedical signals. However, under certain conditions, such as a high resolution of data collection or special signal processing techniques, equal states may be very rare, whereupon the DES fails to measure the amplitude fluctuations.Approach. To address this problem, we develop a novel threshold DES (tDES) that measures the distribution of differential states within a threshold. To evaluate the proposed tDES, we first analyze five sets of synthetic signals generated in different frequency bands. We then analyze sleep electroencephalography (EEG) datasets taken from the public PhysioNet.Main results. Synthetic signals and detrend-filtered sleep EEGs have no neighboring equal values; however, tDES can effectively measure the amplitude fluctuations within these data. The tDES of EEG data increases significantly as the sleep stage increases, even with datasets covering very short periods, indicating decreased amplitude fluctuations in sleep EEGs. Generally speaking, the presence of more low-frequency components in a physiological series reflects smaller amplitude fluctuations and larger DES.Significance. The tDES provides a reliable computing method for quantifying amplitude fluctuations, exhibiting the characteristics of conceptual simplicity and computational robustness. Our findings broaden the application of quantitative amplitude fluctuations and contribute to the classification of sleep stages based on EEG data.

Information-Theoretic Analysis of Cardio-Respiratory Interactions in Heart Failure Patients: Effects of Arrhythmias and Cardiac Resynchronization Therapy

The properties of cardio-respiratory coupling (CRC) are affected by various pathological conditions related to the cardiovascular and/or respiratory systems. In heart failure, one of the most common cardiac pathological conditions, the degree of CRC changes primarily depend on the type of heart-rhythm alterations. In this work, we investigated CRC in heart-failure patients, applying measures from information theory, i.e., Granger Causality (GC), Transfer Entropy (TE) and Cross Entropy (CE), to quantify the directed coupling and causality between cardiac (RR interval) and respiratory (Resp) time series. Patients were divided into three groups depending on their heart rhythm (sinus rhythm and presence of low/high number of ventricular extrasystoles) and were studied also after cardiac resynchronization therapy (CRT), distinguishing responders and non-responders to the therapy. The information-theoretic analysis of bidirectional cardio-respiratory interactions in HF patients revealed the strong effect of nonlinear components in the RR (high number of ventricular extrasystoles) and in the Resp time series (respiratory sinus arrhythmia) as well as in their causal interactions. We showed that GC as a linear model measure is not sensitive to both nonlinear components and only model free measures as TE and CE may quantify them. CRT responders mainly exhibit unchanged asymmetry in the TE values, with statistically significant dominance of the information flow from Resp to RR over the opposite flow from RR to Resp, before and after CRT. In non-responders this asymmetry was statistically significant only after CRT. Our results indicate that the success of CRT is related to corresponding information transfer between the cardiac and respiratory signal quantified at baseline measurements, which could contribute to a better selection of patients for this type of therapy.

Exploring the Short-Term Memory of Heart Rate Variability through Model-Free Information Measures

In this work, we perform a comparative analysis of discrete- and continuous-time estimators of information-theoretic measures quantifying the concept of memory utilization in short-term heart rate variability (HRV). Specifically, considering heartbeat intervals in discrete time we compute the measure of information storage (IS) and decompose it into immediate memory utilization (IMU) and longer memory utilization (MU) terms; considering the timings of heartbeats in continuous time we compute the measure of MU rate (MUR). All measures are computed through model-free approaches based on nearest neighbor entropy estimators applied to the HRV series of a group of 15 healthy subjects measured at rest and during postural stress. We find, moving from rest to stress, statistically significant increases of the IS and the IMU, as well as of the MUR. Our results suggest that both discrete-time and continuous-time approaches can detect the higher predictive capacity of HRV occurring with postural stress, and that such increased memory utilization is due to fast mechanisms likely related to sympathetic activation.

Schizophrenia MEG Network Analysis Based on Kernel Granger Causality

Network analysis is an important approach to explore complex brain structures under different pathological and physiological conditions. In this paper, we employ the multivariate inhomogeneous polynomial kernel Granger causality (MKGC) to construct directed weighted networks to characterize schizophrenia magnetoencephalography (MEG). We first generate data based on coupled autoregressive processes to test the effectiveness of MKGC in comparison with the bivariate linear Granger causality and bivariate inhomogeneous polynomial kernel Granger causality. The test results suggest that MKGC outperforms the other two methods. Based on these results, we apply MKGC to construct effective connectivity networks of MEG for patients with schizophrenia (SCZs). We measure three network features, i.e., strength, nonequilibrium, and complexity, to characterize schizophrenia MEG. Our results suggest that MEG of the healthy controls (HCs) has a denser effective connectivity network than that of SCZs. The most significant difference in the in-connectivity strength is observed in the right frontal network (p=0.001). The strongest out-connectivity strength for all subjects occurs in the temporal area, with the most significant between-group difference in the left occipital area (p=0.0018). The total connectivity strength of the frontal, temporal, and occipital areas of HCs exhibits higher values compared with SCZs. The nonequilibrium feature over the whole brain of SCZs is significantly higher than that of the HCs (p=0.012); however, the results of Shannon entropy suggest that healthy MEG networks have higher complexity than schizophrenia networks. Overall, MKGC provides a reliable approach to construct MEG brain networks and characterize the network characteristics.

Activity-State Entropy: A Novel Brain Entropy Measure Based on Spatial Patterns of Activity

BACKGROUND

Brain entropy is a measure of the complexity of brain activity that has been linked to various cognitive abilities. The measure is based on Shannon Entropy, a measure from Information Theory that quantifies the information capacity of a system from the probability distribution of its states. Most fMRI studies measure brain entropy at the voxel level as time-series entropy and assume that entropic time-series indicate complex large-scale spatiotemporal patterns of activity. New Method We developed a novel measure of brain entropy called Activity-State Entropy. The method quantifies entropy based on underlying patterns of coactivation identified using Principal Components Analysis. These patterns, termed eigenactivity states, combine in time-varying proportions.

RESULTS

We showed that Activity-State Entropy is sensitive to the complexity of the spatiotemporal patterns of activity in simulated fMRI data. We then applied this measure to real resting-state fMRI data and found that the eigenactivity states that explained the most variance in the data were comprised of large clusters of coactivating voxels, including clusters within Default Mode Network regions. More entropic brains were increasingly influenced by eigenactivity states comprised of smaller and more sparsely distributed clusters. Comparison to Existing Methods We compared Activity-State Entropy to Sample Entropy and Dispersion Entropy, two time-series entropy measures commonly used in neuroimaging research, and found all three measures were positively correlated.

CONCLUSIONS

Activity-State Entropy provides a measure of the spatiotemporal complexity of brain activity that complements time-series based measures of brain entropy.

Comparison of discretization strategies for the model-free information-theoretic assessment of short-term physiological interactions

This work presents a comparison between different approaches for the model-free estimation of information-theoretic measures of the dynamic coupling between short realizations of random processes. The measures considered are the mutual information rate (MIR) between two random processes X and Y and the terms of its decomposition evidencing either the individual entropy rates of X and Y and their joint entropy rate, or the transfer entropies from X to Y and from Y to X and the instantaneous information shared by X and Y. All measures are estimated through discretization of the random variables forming the processes, performed either via uniform quantization (binning approach) or rank ordering (permutation approach). The binning and permutation approaches are compared on simulations of two coupled non-identical Hènon systems and on three datasets, including short realizations of cardiorespiratory (CR, heart period and respiration flow), cardiovascular (CV, heart period and systolic arterial pressure), and cerebrovascular (CB, mean arterial pressure and cerebral blood flow velocity) measured in different physiological conditions, i.e., spontaneous vs paced breathing or supine vs upright positions. Our results show that, with careful selection of the estimation parameters (i.e., the embedding dimension and the number of quantization levels for the binning approach), meaningful patterns of the MIR and of its components can be achieved in the analyzed systems. On physiological time series, we found that paced breathing at slow breathing rates induces less complex and more coupled CR dynamics, while postural stress leads to unbalancing of CV interactions with prevalent baroreflex coupling and to less complex pressure dynamics with preserved CB interactions. These results are better highlighted by the permutation approach, thanks to its more parsimonious representation of the discretized dynamic patterns, which allows one to explore interactions with longer memory while limiting the curse of dimensionality.

Feasibility of Ultra-Short-Term Analysis of Heart Rate and Systolic Arterial Pressure Variability at Rest and during Stress via Time-Domain and Entropy-Based Measures

Heart Rate Variability (HRV) and Blood Pressure Variability (BPV) are widely employed tools for characterizing the complex behavior of cardiovascular dynamics. Usually, HRV and BPV analyses are carried out through short-term (ST) measurements, which exploit ~five-minute-long recordings. Recent research efforts are focused on reducing the time series length, assessing whether and to what extent Ultra-Short-Term (UST) analysis is capable of extracting information about cardiovascular variability from very short recordings. In this work, we compare ST and UST measures computed on electrocardiographic R-R intervals and systolic arterial pressure time series obtained at rest and during both postural and mental stress. Standard time-domain indices are computed, together with entropy-based measures able to assess the regularity and complexity of cardiovascular dynamics, on time series lasting down to 60 samples, employing either a faster linear parametric estimator or a more reliable but time-consuming model-free method based on nearest neighbor estimates. Our results are evidence that shorter time series down to 120 samples still exhibit an acceptable agreement with the ST reference and can also be exploited to discriminate between stress and rest. Moreover, despite neglecting nonlinearities inherent to short-term cardiovascular dynamics, the faster linear estimator is still capable of detecting differences among the conditions, thus resulting in its suitability to be implemented on wearable devices.

Measuring habitat complexity and spatial heterogeneity in ecology

Habitat complexity has been considered a key driver of biodiversity and other ecological phenomena for nearly a century. However, there is still no consensus over the definition of complexity or how to measure it. Up-to-date and clear guidance on measuring complexity is urgently needed, particularly given the rise of remote sensing and advent of technologies that allow environments to be scanned at unprecedented spatial extents and resolutions. Here we review how complexity is measured in ecology. We provide a framework for metrics of habitat complexity, and for the related concept of spatial heterogeneity. We focus on the two most commonly used complexity metrics in ecology: fractal dimension and rugosity. We discuss the pros and cons of these metrics using practical examples from our own empirical data and from simulations. Fractal dimension is particularly widely used, and we provide a critical examination of it drawing on research from other scientific fields. We also discuss informational metrics of complexity and their potential benefits. We chart a path forward for research on measuring habitat complexity by presenting, as a guide, sets of essential and desirable criteria that a metric of complexity should possess. Lastly, we discuss the applied significance of our review.

Synchronization between music dynamics and heart rhythm is modulated by the musician’s emotional involvement: A single case study

In this study we evaluated heart rate variability (HRV) changes in a pianist, playing in a laboratory, to investigate whether HRV changes are guided by music temporal features or by technical difficulty and/or subjective factors (e.g., experienced effort). The pianist was equipped with a wearable telemetry device for ECG recording during the execution of 4 classical and 5 jazz pieces. From ECG we derived the RR intervals series (tachogram), and, for each piece, analyzed HRV in the time (RR, RMSSD, Stress Index) and frequency domains (Total spectral power) and performed non-linear analysis (Multiscale Entropy). We also studied the correlation (Pearson) between the time course of music volume envelope and tachogram. Results showed a general reduction of parasympathetic and an increase of sympathetic activity, with the greatest changes during the classical pieces execution, the pianist appraised as more demanding than the jazz ones. The most marked changes occurred during the most technically/emotionally demanding piece, and correlation analysis revealed a negative association between music volume envelope time course and tachogram only for this piece, suggesting a modulation of the limbic system on the synchronization between heart rhythm and music temporal features. Classical music was also associated with the increase of entropy (1st scale) with respect to rest, indicating its effectiveness in driving flexible, healthy, heart dynamics. In conclusion, HRV seems modulated not only by the music temporal features, but also by the pianist’s emotional involvement, which is greatly influenced, in a non-trivial manner, by the technical demands and musician expertise.

The Structure of Chaos: An Empirical Comparison of Fractal Physiology Complexity Indices Using NeuroKit2

Complexity quantification, through entropy, information theory and fractal dimension indices, is gaining a renewed traction in psychophsyiology, as new measures with promising qualities emerge from the computational and mathematical advances. Unfortunately, few studies compare the relationship and objective performance of the plethora of existing metrics, in turn hindering reproducibility, replicability, consistency, and clarity in the field. Using the NeuroKit2 Python software, we computed a list of 112 (predominantly used) complexity indices on signals varying in their characteristics (noise, length and frequency spectrum). We then systematically compared the indices by their computational weight, their representativeness of a multidimensional space of latent dimensions, and empirical proximity with other indices. Based on these considerations, we propose that a selection of 12 indices, together representing 85.97% of the total variance of all indices, might offer a parsimonious and complimentary choice in regards to the quantification of the complexity of time series. Our selection includes CWPEn, Line Length (LL), BubbEn, MSWPEn, MFDFA (Max), Hjorth Complexity, SVDEn, MFDFA (Width), MFDFA (Mean), MFDFA (Peak), MFDFA (Fluctuation), AttEn. Elements of consideration for alternative subsets are discussed, and data, analysis scripts and code for the figures are open-source.

Multiscale partial information decomposition of dynamic processes with short and long-range correlations: theory and application to cardiovascular control

OBJECTIVE

In this work, an analytical framework for the multiscale analysis of multivariate Gaussian processes is presented, whereby the computation of Partial Information Decomposition measures is achieved accounting for the simultaneous presence of short-term dynamics and long-range correlations.

APPROACH

We consider physiological time series mapping the activity of the cardiac, vascular and respiratory systems in the field of Network Physiology. In this context, the multiscale representation of transfer entropy within the network of interactions among Systolic arterial pressure (S), respiration (R) and heart period (H), as well as the decomposition into unique, redundant and synergistic contributions, is obtained using a Vector AutoRegressive Fractionally Integrated (VARFI) framework for Gaussian processes. This novel approach allows to quantify the directed information flow accounting for the simultaneous presence of short-term dynamics and long-range correlations among the analyzed processes. Additionally, it provides analytical expressions for the computation of the information measures, by exploiting the theory of state space models. The approach is first illustrated in simulated VARFI processes and then applied to H, S and R time series measured in healthy subjects monitored at rest and during mental and postural stress.

MAIN RESULTS

We demonstrate the ability of the VARFI modeling approach to account for the coexistence of short-term and long-range correlations in the study of multivariate processes. Physiologically, we show that postural stress induces larger redundant and synergistic effects from S and R to H at short time scales, while mental stress induces larger information transfer from S to H at longer time scales, thus evidencing the different nature of the two stressors.

SIGNIFICANCE

The proposed methodology allows to extract useful information about the dependence of the information transfer on the balance between short-term and long-range correlations in coupled dynamical systems, which cannot be observed using standard methods that do not consider long-range correlations.

Multiscale Information Decomposition of Long Memory Processes: Application to Plateau Waves of Intracranial Pressure

Traumatic Brain Injury (TBI) patients present high levels of physical stress, which in some situations can manifest as Plateau Wave (PW) episodes. This intense stress phenomenon can be evidenced by Heart Rate Variability (HRV). Thus, the multivariate and simultaneous analysis of cardio-cerebrovascular oscillations, involving the RR intervals, mean arterial pressure (MAP) and the amplitude of intracranial pressure (AMP), will be useful to understand the interconnections between body signals, allowing the interpretation of the combined activity of pathophysiological mechanisms. In this work, the multiscale representation of the Transfer Entropy (TE) and of its decomposition in the network of these three interacting processes is obtained, based on a Vector AutoRegressive Fractionally Integrated (VARFI) framework for Gaussian processes. This method allows to assess directed interactions and to quantify the information flow accounting for the simultaneous presence of short-term dynamics and long-range correlations. The results show that the baseline RR, but not MAP can provide information about the possibility of a PW arising. During PW, the long-term correlations highlight synergistic interactions between MAP and AMP processes on RR. The multiscale decomposition of the information along with the incorporation of the long term correlations allowed a better description of HRV during PW, highlighting the fact that the HRV mirrors this cerebrovascular phenomena.

Information Dynamics of Electric Field Intensity before and during the COVID-19 Pandemic

This work investigates the temporal statistical structure of time series of electric field (EF) intensity recorded with the aim of exploring the dynamical patterns associated with periods with different human activity in urban areas. The analyzed time series were obtained from a sensor of the EMF RATEL monitoring system installed in the campus area of the University of Novi Sad, Serbia. The sensor performs wideband cumulative EF intensity monitoring of all active commercial EF sources, thus including those linked to human utilization of wireless communication systems. Monitoring was performed continuously during the years 2019 and 2020, allowing us to investigate the effects on the patterns of EF intensity of varying conditions of human mobility, including regular teaching and exam activity within the campus, as well as limitations to mobility related to the COVID-19 pandemic. Time series analysis was performed using both simple statistics (mean and variance) and combining the information-theoretic measure of information storage (IS) with the method of surrogate data to quantify the regularity of EF dynamic patterns and detect the presence of nonlinear dynamics. Moreover, to assess the possible coexistence of dynamic behaviors across multiple temporal scales, IS analysis was performed over consecutive observation windows lasting one day, week, month, and year, respectively coarse grained at time scales of 6 min, 30 min, 2 h, and 1 day. Our results document that the EF intensity patterns of variability are modulated by the movement of people at daily, weekly, and monthly scales, and are blunted during periods of restricted mobility related to the COVID-19 pandemic. Mobility restrictions also affected significantly the regularity of the EF intensity time series, resulting in lower values of IS observed simultaneously with a loss of nonlinear dynamics. Thus, our analysis can be useful to investigate changes in the global patterns of human mobility both during pandemics or other types of events, and from this perspective may serve to implement strategies for safety assessment and for optimizing the design of networks of EF sensors.

Beyond randomness: Evaluating measures of information entropy in binary series

The enormous amount of currently available data demands efforts to extract meaningful information. For this purpose, different measurements are applied, including Shannon's entropy, permutation entropy, and the Lempel-Ziv complexity. These methods have been used in many applications, such as pattern recognition, series classification, and several other areas (e.g., physical, financial, and biomedical). Data in these applications are often presented in binary series with temporal correlations. Herein, we compare the measures of information entropy in binary series conveying short- and long-range temporal correlations characterized by the Hurst exponent H. Combining numerical and analytical approaches, we scrutinize different methods that were not efficient in detecting temporal correlations. To surpass this limitation, we propose a measure called the binary permutation index (BPI). We will demonstrate that BPI efficiently discriminates patterns embedded in the series, offering advantages over previous methods. Subsequently, we collect stock market time series and rain precipitation data as well as perform in vivo electrophysiological recordings in the hippocampus of an experimental animal model of temporal lobe epilepsy, in which the BPI application in both public open source and experimental data is demonstrated. An index is proposed to evaluate information entropy, allowing the ability to discriminate randomness and extract meaningful information in binary time series.

The mechanistic and prognostic implications of heart rate variability analysis in patients with cirrhosis

Chronic liver damage leads to scarring of the liver tissue and ultimately a systemic illness known as cirrhosis. Patients with cirrhosis exhibit multi-organ dysfunction and high mortality. Reduced heart rate variability (HRV) is a hallmark of cirrhosis, reflecting a state of defective cardiovascular control and physiological network disruption. Several lines of evidence have revealed that decreased HRV holds prognostic information and can predict survival of patients independent of the severity of liver disease. Thus, the aim of this review is to shed light on the mechanistic and prognostic implications of HRV analysis in patients with cirrhosis. Notably, several studies have extensively highlighted the critical role systemic inflammation elicits in conferring the reduction in patients' HRV. It appears that IL-6 is likely to play a central mechanistic role, whereby its levels also correlate with manifestations, such as autonomic neuropathy and hence the partial uncoupling of the cardiac pacemaker from autonomic control. Reduced HRV has also been reported to be highly correlated with the severity of hepatic encephalopathy, potentially through systemic inflammation affecting specific brain regions, involved in both cognitive function and autonomic regulation. In general, the prognostic ability of HRV analysis holds immense potential in improving survival rates for patients with cirrhosis, as it may indeed be added to current prognostic indicators, to ultimately increase the accuracy of selecting the recipient most in need of liver transplantation. However, a network physiology approach in the future is critical to delineate the exact mechanistic basis by which decreased HRV confers poor prognosis.

Premature Beats Rejection Strategy on Paroxysmal Atrial Fibrillation Detection

Paroxysmal atrial fibrillation (PAF) may related to the risk of thromboembolism and is the most common cardiac risk factor of cryptogenic stroke (CS). Due to its paroxysmal characteristics, it is usually diagnosed by continuous long-term ECG. Patients with paroxysmal atrial fibrillation usually have premature beats at the same time which is easy to be confused with the rhythm of atrial fibrillation. Therefore, in this article, we designed a screening algorithm for single premature beat, multi premature beats, bigeminy and trigeminy premature beats, according to their rhythm characteristics to reduce false detection caused by premature beats during the PAF detection process. The proposed elimination method was verified on ECG segments with different types of premature beats, and tested on long-term ECG data of PAF patients. ECG segments of different kinds of premature beats were selected from MIT Atrial Fibrillation database (MIT-AFDB), MIT-BIH Arrhythmia database (MIT-AR) and wearable ECG data from the China Physiological Signal Challenge 2021 (CPSC 2021). The proposed method can effectively eliminate single premature beat segments with 99.5% accuracy, and it also can eliminate more than 95% of ECG segments with other types of premature beats. We designed PAF-score as a new index to evaluate the accuracy of detection, and we also calculate the misjudged and missed segments to comprehensively evaluate the PAF detection algorithm. The proposed method get a PAF-score of 0.912 on MIT-AFDB. The proposed method also has the potential to implant low computing power wearable devices for real-time analysis.

Chaotic and stochastic dynamics of epileptiform-like activities in sclerotic hippocampus resected from patients with pharmacoresistant epilepsy

The types of epileptiform activity occurring in the sclerotic hippocampus with highest incidence are interictal-like events (II) and periodic ictal spiking (PIS). These activities are classified according to their event rates, but it is still unclear if these rate differences are consequences of underlying physiological mechanisms. Identifying new and more specific information related to these two activities may bring insights to a better understanding about the epileptogenic process and new diagnosis. We applied Poincaré map analysis and Recurrence Quantification Analysis (RQA) onto 35 in vitro electrophysiological signals recorded from slices of 12 hippocampal tissues surgically resected from patients with pharmacoresistant temporal lobe epilepsy. These analyzes showed that the II activity is related to chaotic dynamics, whereas the PIS activity is related to deterministic periodic dynamics. Additionally, it indicates that their different rates are consequence of different endogenous dynamics. Finally, by using two computational models we were able to simulate the transition between II and PIS activities. The RQA was applied to different periods of these simulations to compare the recurrences between artificial and real signals, showing that different ranges of regularity-chaoticity can be directly associated with the generation of PIS and II activities.

Temporal lobe epilepsy (TLE) is the most prevalent type of epilepsy in adults and hippocampal sclerosis is the major pathophysiological substrate of pharmaco-refractory TLE. Different patterns of epileptiform-like activity have been described in human hippocampal sclerosis, but the standard analysis applied to characterize the activities usually do not consider the nonlinear features that epileptiform patterns exhibit. Here, using Poincaré map and Recurrence Quantitative Analysis we characterized the most prevalent type of epileptiform-like activities—interictal-like events (II) and periodic ictal spiking (PIS), recorded in vitro from resected hippocampi of pharmacoresistant patients with TLE—according to their levels of stochasticity, chaoticity and determinism. The II activities showed to be more chaotic with complex rhythmicity than PIS activities. The nonlinear dynamic differences between II and PIS leads us to conjecture that they are expressions of different seizure susceptibility. We also identified that each hippocampal subfield expresses II and PIS activities in a specific and different way. Finally, from the modulation of internal parameters of two computational models, we show the conversion of one type of activity into the other, showing how specific neuron networks synchronize over time, leading to II and PIS activities and then into a generalized seizure.

Fifty years of Shannon information theory in assessing the accuracy and agreement of diagnostic tests

Since 1948, Shannon theoretic methods for modeling information have found a wide range of applications in several areas where information plays a key role, which goes well beyond the original scopes for which they have been conceived, namely data compression and error correction over a noisy channel. Among other uses, these methods have been applied in the broad field of medical diagnostics since the 1970s, to quantify diagnostic information, to evaluate diagnostic test performance, but also to be used as technical tools in image processing and registration. This review illustrates the main contributions in assessing the accuracy of diagnostic tests and the agreement between raters, focusing on diagnostic test performance measurements and paired agreement evaluation. This work also presents a recent unified, coherent, and hopefully, final information-theoretical approach to deal with the flows of information involved among the patient, the diagnostic test performed to appraise the state of disease, and the raters who are checking the test results. The approach is assessed by considering two case studies: the first one is related to evaluating extra-prostatic cancers; the second concerns the quality of rapid tests for COVID-19 detection.

Forecasting COVID-19 infections in the Arabian Gulf region

In this paper, an empirical analysis of linear state space models and long short-term memory neural networks is performed to compare the statistical performance of these models in predicting the spread of COVID-19 infections. Data on the pandemic daily infections from the Arabian Gulf countries from 2020/03/24 to 2021/05/20 are fitted to each model and a statistical analysis is conducted to assess their short-term prediction accuracy. The results show that state space model predictions are more accurate with notably smaller root mean square errors than the deep learning forecasting method. The results also indicate that the poorer forecast performance of long short-term memory neural networks occurs in particular when health surveillance data are characterized by high fluctuations of the daily infection records and frequent occurrences of abrupt changes. One important result of this study is the possible relationship between data complexity and forecast accuracy with different models as suggested in the entropy analysis. It is concluded that state space models perform better than long short-term memory networks with highly irregular and more complex surveillance data.

EntropyHub: An open-source toolkit for entropic time series analysis

An increasing number of studies across many research fields from biomedical engineering to finance are employing measures of entropy to quantify the regularity, variability or randomness of time series and image data. Entropy, as it relates to information theory and dynamical systems theory, can be estimated in many ways, with newly developed methods being continuously introduced in the scientific literature. Despite the growing interest in entropic time series and image analysis, there is a shortage of validated, open-source software tools that enable researchers to apply these methods. To date, packages for performing entropy analysis are often run using graphical user interfaces, lack the necessary supporting documentation, or do not include functions for more advanced entropy methods, such as cross-entropy, multiscale cross-entropy or bidimensional entropy. In light of this, this paper introduces EntropyHub, an open-source toolkit for performing entropic time series analysis in MATLAB, Python and Julia. EntropyHub (version 0.1) provides an extensive range of more than forty functions for estimating cross-, multiscale, multiscale cross-, and bidimensional entropy, each including a number of keyword arguments that allows the user to specify multiple parameters in the entropy calculation. Instructions for installation, descriptions of function syntax, and examples of use are fully detailed in the supporting documentation, available on the EntropyHub website- www.EntropyHub.xyz. Compatible with Windows, Mac and Linux operating systems, EntropyHub is hosted on GitHub, as well as the native package repository for MATLAB, Python and Julia, respectively. The goal of EntropyHub is to integrate the many established entropy methods into one complete resource, providing tools that make advanced entropic time series analysis straightforward and reproducible.

Feasibility of Linear Parametric Estimation of Dynamic Information Measures to assess Physiological Stress from Short-Term Cardiovascular Variability. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021;2021:290-293. [PMID: 34891293 DOI: 10.1109/embc46164.2021.9630697] [Citation(s) in RCA: 0] [Impact Index Per Article: 0]

Extensive efforts have been recently devoted to implement fast and reliable algorithms capable of assessing the physiological response of the organism to physiological stress. In this study, we propose the comparison between model-free and linear parametric methods as regards their ability to detect alterations in the dynamics and in the complexity of cardiovascular and respiratory variability evoked by postural and mental stress. Dynamic entropy (DE) and information storage (IS) measures were calculated on three physiological time-series, i.e. heart period, respiratory volume and systolic arterial pressure, on 61 healthy subjects monitored in resting conditions as well as during head-up tilt and while performing a mental arithmetic task. The results of the comparison suggest the feasibility of DE and IS measures computed from different physiological signals to discriminate among resting and stress states. If compared to the model-free algorithm, the faster linear method appears to be capable of detecting the same (or even more) statistically significant variations of DE or IS between resting and stress conditions, being thus in perspective more suitable for the integration within wearable devices. The computation of entropy indices extracted from multiple physiological signals acquired through wearables will allow a real-time stress assessment on people in daily-life situations.

Gait Analyses of Parkinson’s Disease Patients Using Multiscale Entropy

Parkinson’s disease (PD) is a type of neurodegenerative diseases. PD influences gait in many aspects: reduced gait speed and step length, increased axial rigidity, and impaired rhythmicity. Gait-related data used in this study are from PhysioNet. Twenty-one PD patients and five healthy controls (CO) were sorted into four groups: PD without task (PDw), PD with dual task (PDd), control without task (COw), and control with dual task (COd). Since dual task actions are attention demanding, either gait or cognitive function may be affected. To quantify the used walking data, eight pressure sensors installed in each insole are used to measure the vertical ground reaction force. Thus, quantitative measurement analysis is performed utilizing multiscale entropy (MSE) and complexity index (CI) to analyze and differentiate between the ground reaction force of the four different groups. Results show that the CI of patients with PD is higher than that of CO and 11 of the sensor signals are statistically significant (p < 0.05). The COd group has larger CI values at the beginning (p = 0.021) but they get lower at the end of the test (p = 0.000) compared to that in the COw group. The end-of-test CI for the PDw group is lower in one of the feet sensor signals, and in the right total ground reaction force compared to the PDd group counterparts. In conclusion, when people start to adjust their gait due to pathology or stress, CI may increase first and reach a peak, but it decreases afterward when stress or pathology is further increased.

Skin temperature variability is an independent predictor of survival in patients with cirrhosis

Background

Cirrhosis is a disease with multisystem involvement. It has been documented that patients with cirrhosis exhibit abnormal patterns of fluctuation in their body temperature. However, the clinical significance of this phenomenon is not well understood. The aim of this study was to determine if temperature variability analysis can predict survival in patients with cirrhosis.

Methods

Thirty eight inpatients with cirrhosis were enrolled in the study. Wireless temperature sensors were used to record patients’ proximal skin temperature for 24 hr. The pattern of proximal temperature fluctuation was assessed using the extended Poincaré plot to measure short‐term and long‐term proximal temperature variability (PTV). Patients were followed up for 12 months, and information was collected on the occurrence of death/liver transplantation.

Results

During the follow‐up period, 15 patients (39%) died or underwent transplantation for hepatic decompensation. Basal proximal skin temperature absolute values were comparable in survivors and nonsurvivors. However, nonsurvivors showed a significant reduction in both short‐term and long‐term HRV indices. Cox regression analysis showed that both short‐term and long‐term PTV indices could predict survival in these patients. However, only measures of short‐term PTV were shown to be independent of the severity of hepatic failure in predicting survival. Finally, the prognostic value of short‐term PTV was also independent of heart rate variability, that is, a measure of autonomic dysfunction.

Conclusion

Changes in the pattern of patients’ temperature fluctuations, rather than their absolute values, hold key prognostic information, suggesting that impaired thermoregulation may play an important role in the pathophysiology of cirrhosis.

Relationship between mutual information and cross-correlation time scale of observability as measures of connectivity strength

The task of identifying and characterizing network structures out of experimentally observed time series is tackled by implementing different solutions, ranging from entropy-based techniques to the evaluation of the significance of observed correlation estimators. Among the metrics that belong to the first class, mutual information is of major importance due to the relative simplicity of implementation and its relying on the crucial concept of entropy. With regard to the second class, a method that allows us to assess the connectivity strength of a link in terms of a time scale of its observability via the significance estimate of measured cross correlation was recently shown to provide a reliable tool to study network structures. In this paper, we investigate the relationship between this last metric and mutual information by simultaneously assessing both metrics on large sets of data extracted from three experimental contexts, human brain magnetoencephalography, human brain electroencephalography, and surface wind measurements carried out on a small regional scale, as well as on simulated coupled, auto-regressive processes. We show that the relationship is well described by a power law and provide a theoretical explanation based on a simple noise and signal model. Besides further upholding the reliability of cross-correlation time scale of observability, the results show that the combined use of this metric and mutual information can be used as a valuable tool to identify and characterize connectivity links in a wide range of experimental contexts.

Optimizing Reservoir Computers for Signal Classification

Reservoir computers are a type of recurrent neural network for which the network connections are not changed. To train the reservoir computer, a set of output signals from the network are fit to a training signal by a linear fit. As a result, training of a reservoir computer is fast, and reservoir computers may be built from analog hardware, resulting in high speed and low power consumption. To get the best performance from a reservoir computer, the hyperparameters of the reservoir computer must be optimized. In signal classification problems, parameter optimization may be computationally difficult; it is necessary to compare many realizations of the test signals to get good statistics on the classification probability. In this work, it is shown in both a spiking reservoir computer and a reservoir computer using continuous variables that the optimum classification performance occurs for the hyperparameters that maximize the entropy of the reservoir computer. Optimizing for entropy only requires a single realization of each signal to be classified, making the process much faster to compute.

Information Flow Between Heart Rhythm, Repolarization, and the Diastolic Interval Series for Healthy Individuals and LQTS1 Patients

Using information theoretic measures, relations between heart rhythm, repolarization in the tissue of the heart, and the diastolic interval time series are analyzed. These processes are a fragment of the cardiovascular physiological network. A comparison is made between the results for 84 (42 women) healthy individuals and 65 (45 women) long QT syndrome type 1 (LQTS1) patients. Self-entropy, transfer entropy, and joint transfer entropy are calculated for the three time series and their combinations. The results for self-entropy indicate the well-known result that regularity of heart rhythm for healthy individuals is larger than that of QT interval series. The flow of information depends on the direction with the flow from the heart rhythm to QT dominating. In LQTS1 patients, however, our results indicate that information flow in the opposite direction may occur—a new result. The information flow from the heart rhythm to QT dominates, which verifies the asymmetry seen by Porta et al. in the variable tilt angle experiment. The amount of new information and self-entropy for LQTS1 patients is smaller than that for healthy individuals. However, information transfers from RR to QT and from DI to QT are larger in the case of LQTS1 patients.

Assessment of Cardiorespiratory Interactions during Apneic Events in Sleep via Fuzzy Kernel Measures of Information Dynamics

Apnea and other breathing-related disorders have been linked to the development of hypertension or impairments of the cardiovascular, cognitive or metabolic systems. The combined assessment of multiple physiological signals acquired during sleep is of fundamental importance for providing additional insights about breathing disorder events and the associated impairments. In this work, we apply information-theoretic measures to describe the joint dynamics of cardiorespiratory physiological processes in a large group of patients reporting repeated episodes of hypopneas, apneas (central, obstructive, mixed) and respiratory effort related arousals (RERAs). We analyze the heart period as the target process and the airflow amplitude as the driver, computing the predictive information, the information storage, the information transfer, the internal information and the cross information, using a fuzzy kernel entropy estimator. The analyses were performed comparing the information measures among segments during, immediately before and after the respiratory event and with control segments. Results highlight a general tendency to decrease of predictive information and information storage of heart period, as well as of cross information and information transfer from respiration to heart period, during the breathing disordered events. The information-theoretic measures also vary according to the breathing disorder, and significant changes of information transfer can be detected during RERAs, suggesting that the latter could represent a risk factor for developing cardiovascular diseases. These findings reflect the impact of different sleep breathing disorders on respiratory sinus arrhythmia, suggesting overall higher complexity of the cardiac dynamics and weaker cardiorespiratory interactions which may have physiological and clinical relevance.

Entropy and Multifractal-Multiscale Indices of Heart Rate Time Series to Evaluate Intricate Cognitive-Autonomic Interactions

Recent research has clarified the existence of a networked system involving a cortical and subcortical circuitry regulating both cognition and cardiac autonomic control, which is dynamically organized as a function of cognitive demand. The main interactions span multiple temporal and spatial scales and are extensively governed by nonlinear processes. Hence, entropy and (multi)fractality in heart period time series are suitable to capture emergent behavior of the cognitive-autonomic network coordination. This study investigated how entropy and multifractal-multiscale analyses could depict specific cognitive-autonomic architectures reflected in the heart rate dynamics when students performed selective inhibition tasks. The participants (N=37) completed cognitive interference (Stroop color and word task), action cancellation (stop-signal) and action restraint (go/no-go) tasks, compared to watching a neutral movie as baseline. Entropy and fractal markers (respectively, the refined composite multiscale entropy and multifractal-multiscale detrended fluctuation analysis) outperformed other time-domain and frequency-domain markers of the heart rate variability in distinguishing cognitive tasks. Crucially, the entropy increased selectively during cognitive interference and the multifractality increased during action cancellation. An interpretative hypothesis is that cognitive interference elicited a greater richness in interactive processes that form the central autonomic network while action cancellation, which is achieved via biasing a sensorimotor network, could lead to a scale-specific heightening of multifractal behavior.

Conditional Entropy: A Potential Digital Marker for Stress

Recent decades have witnessed a substantial progress in the utilization of brain activity for the identification of stress digital markers. In particular, the success of entropic measures for this purpose is very appealing, considering (1) their suitability for capturing both linear and non-linear characteristics of brain activity recordings and (2) their direct association with the brain signal variability. These findings rely on external stimuli to induce the brain stress response. On the other hand, research suggests that the use of different types of experimentally induced psychological and physical stressors could potentially yield differential impacts on the brain response to stress and therefore should be dissociated from more general patterns. The present study takes a step toward addressing this issue by introducing conditional entropy (CE) as a potential electroencephalography (EEG)-based resting-state digital marker of stress. For this purpose, we use the resting-state multi-channel EEG recordings of 20 individuals whose responses to stress-related questionnaires show significantly higher and lower level of stress. Through the application of representational similarity analysis (RSA) and K-nearest-neighbor (KNN) classification, we verify the potential that the use of CE can offer to the solution concept of finding an effective digital marker for stress.

The Entropy Universe

About 160 years ago, the concept of entropy was introduced in thermodynamics by Rudolf Clausius. Since then, it has been continually extended, interpreted, and applied by researchers in many scientific fields, such as general physics, information theory, chaos theory, data mining, and mathematical linguistics. This paper presents The Entropy Universe, which aims to review the many variants of entropies applied to time-series. The purpose is to answer research questions such as: How did each entropy emerge? What is the mathematical definition of each variant of entropy? How are entropies related to each other? What are the most applied scientific fields for each entropy? We describe in-depth the relationship between the most applied entropies in time-series for different scientific fields, establishing bases for researchers to properly choose the variant of entropy most suitable for their data. The number of citations over the past sixteen years of each paper proposing a new entropy was also accessed. The Shannon/differential, the Tsallis, the sample, the permutation, and the approximate entropies were the most cited ones. Based on the ten research areas with the most significant number of records obtained in the Web of Science and Scopus, the areas in which the entropies are more applied are computer science, physics, mathematics, and engineering. The universe of entropies is growing each day, either due to the introducing new variants either due to novel applications. Knowing each entropy's strengths and of limitations is essential to ensure the proper improvement of this research field.

Over-fitting suppression training strategies for deep learning-based atrial fibrillation detection

Nowadays, deep learning-based models have been widely developed for atrial fibrillation (AF) detection in electrocardiogram (ECG) signals. However, owing to the inevitable over-fitting problem, classification accuracy of the developed models severely differed when applying on the independent test datasets. This situation is more significant for AF detection from dynamic ECGs. In this study, we explored two potential training strategies to address the over-fitting problem in AF detection. The first one is to use the Fast Fourier transform (FFT) and Hanning-window-based filter to suppress the influence from individual difference. Another is to train the model on the wearable ECG data to improve the robustness of model. Wearable ECG data from 29 patients with arrhythmia were collected for at least 24 h. To verify the effectiveness of the training strategies, a Long Short-Term Memory (LSTM) and Convolution Neural Network (CNN)-based model was proposed and tested. We tested the model on the independent wearable ECG data set, as well as the MIT-BIH Atrial Fibrillation database and PhysioNet/Computing in Cardiology Challenge 2017 database. The model achieved 96.23%, 95.44%, and 95.28% accuracy rates on the three databases, respectively. Pertaining to the comparison of the accuracy rates on each training set, the accuracy of the model trained in conjunction with the proposed training strategies only reduced by 2%, while the accuracy of the model trained without the training strategies decreased by approximately 15%. Therefore, the proposed training strategies serve as effective mechanisms for devising a robust AF detector and significantly enhanced the detection accuracy rates of the resulting deep networks.

The Human Organism as an Integrated Interaction Network: Recent Conceptual and Methodological Challenges

The field of Network Physiology aims to advance our understanding of how physiological systems and sub-systems interact to generate a variety of behaviors and distinct physiological states, to optimize the organism's functioning, and to maintain health. Within this framework, which considers the human organism as an integrated network, vertices are associated with organs while edges represent time-varying interactions between vertices. Likewise, vertices may represent networks on smaller spatial scales leading to a complex mixture of interacting homogeneous and inhomogeneous networks of networks. Lacking adequate analytic tools and a theoretical framework to probe interactions within and among diverse physiological systems, current approaches focus on inferring properties of time-varying interactions-namely strength, direction, and functional form-from time-locked recordings of physiological observables. To this end, a variety of bivariate or, in general, multivariate time-series-analysis techniques, which are derived from diverse mathematical and physical concepts, are employed and the resulting time-dependent networks can then be further characterized with methods from network theory. Despite the many promising new developments, there are still problems that evade from a satisfactory solution. Here we address several important challenges that could aid in finding new perspectives and inspire the development of theoretic and analytical concepts to deal with these challenges and in studying the complex interactions between physiological systems.

Estimating Conditional Transfer Entropy in Time Series Using Mutual Information and Nonlinear Prediction

We propose a new estimator to measure directed dependencies in time series. The dimensionality of data is first reduced using a new non-uniform embedding technique, where the variables are ranked according to a weighted sum of the amount of new information and improvement of the prediction accuracy provided by the variables. Then, using a greedy approach, the most informative subsets are selected in an iterative way. The algorithm terminates, when the highest ranked variable is not able to significantly improve the accuracy of the prediction as compared to that obtained using the existing selected subsets. In a simulation study, we compare our estimator to existing state-of-the-art methods at different data lengths and directed dependencies strengths. It is demonstrated that the proposed estimator has a significantly higher accuracy than that of existing methods, especially for the difficult case, where the data are highly correlated and coupled. Moreover, we show its false detection of directed dependencies due to instantaneous couplings effect is lower than that of existing measures. We also show applicability of the proposed estimator on real intracranial electroencephalography data.

Cellular coupling determines scale-invariant behavior of neurons in suprachiasmatic nucleus

The main clock in mammals, located in the suprachiasmatic nucleus (SCN) of hypothalamus, not only regulates the daily rhythms in physiological and behavioral activities, but also plays a key role as one of the control nodes in the brain regulating behavioral activity. As such, it induces scale-invariance in the temporal patterns of behavioral activity and of multi-unit neural activity of the SCN network. In particular, the scale-invariant patterns maintain across multiple time scales from 3 minutes to 10 hours, characterized by a scaling exponent around 1. Thus far, no study found the origin of the scale-invariance of the SCN network. Using the method of correlation-dependent balance estimation of diffusion entropy (cBEDE), we found that scale-invariance also exists in the individual neurons of the SCN, and the scale invariance properties are significantly increased when the neurons are coupled in a network of neurons. Improved scale invariance in the single neurons is, therefore, imposed by the emergent network properties of the SCN network. Our findings show that the scale-invariance of the SCN can already be found at the level of the individual neurons and that the application of a scale invariance measure, such as cBEDE, can help in determining the network status of the SCN.

Transfer Entropy Modeling of Newborn Cardiorespiratory Regulation

This study investigates the complex interplay between the cardiac and respiratory systems in 268 healthy neonates born between 35 and 40 weeks of gestation. The aim is to provide a comprehensive description of the developing cardiorespiratory information transfer mechanisms as a function of gestational age (GA). This report proposes an extension of the traditional Transfer Entropy measure (TE), which employs multiple lagged versions of the time series of the intervals between two successive R waves of the QRS signal on the electrocardiogram (RR series) and respiration time series (RESP). The method aims to quantify the instantaneous and delayed effects between the two processes within a fine-grained time scale. Firstly, lagged TE was validated on a simulated dataset. Subsequently, lagged TE was employed on newborn cardiorespiratory data. Results indicate a progressive increase in information transfer as a function of gestational age, as well as significant differences in terms of instantaneous and delayed interactions between the cardiac and the respiratory system when comparing the two TE directionalities (RR→RESP vs. RESP→RR). The proposed investigation addresses the role of the different autonomic nervous system (ANS) branches involved in the cardiorespiratory system, since the sympathetic and parasympathetic branches operate at different time scales. Our results allow to infer that the two TE directionalities are uniquely and differently modulated by both branches of the ANS. TE adds an original quantitative tool to understanding cardiorespiratory imbalance in early infancy.

Entropy and the Brain: An Overview

Entropy is a powerful tool for quantification of the brain function and its information processing capacity. This is evident in its broad domain of applications that range from functional interactivity between the brain regions to quantification of the state of consciousness. A number of previous reviews summarized the use of entropic measures in neuroscience. However, these studies either focused on the overall use of nonlinear analytical methodologies for quantification of the brain activity or their contents pertained to a particular area of neuroscientific research. The present study aims at complementing these previous reviews in two ways. First, by covering the literature that specifically makes use of entropy for studying the brain function. Second, by highlighting the three fields of research in which the use of entropy has yielded highly promising results: the (altered) state of consciousness, the ageing brain, and the quantification of the brain networks' information processing. In so doing, the present overview identifies that the use of entropic measures for the study of consciousness and its (altered) states led the field to substantially advance the previous findings. Moreover, it realizes that the use of these measures for the study of the ageing brain resulted in significant insights on various ways that the process of ageing may affect the dynamics and information processing capacity of the brain. It further reveals that their utilization for analysis of the brain regional interactivity formed a bridge between the previous two research areas, thereby providing further evidence in support of their results. It concludes by highlighting some potential considerations that may help future research to refine the use of entropic measures for the study of brain complexity and its function. The present study helps realize that (despite their seemingly differing lines of inquiry) the study of consciousness, the ageing brain, and the brain networks' information processing are highly interrelated. Specifically, it identifies that the complexity, as quantified by entropy, is a fundamental property of conscious experience, which also plays a vital role in the brain's capacity for adaptation and therefore whose loss by ageing constitutes a basis for diseases and disorders. Interestingly, these two perspectives neatly come together through the association of entropy and the brain capacity for information processing.

Entropy Analysis of RR-Time Series From Stress Tests

The RR-interval time series or tachograms obtained from electrocardiograms have been widely studied since they reflect the cardiac variability, and this is an indicative of the health status of a person. The tachogram can be seen as a highly non-linear and complex time series, and therefore, should be analyzed with non-linear techniques. In this work, several entropy measures, Sample Entropy (SampEn), Approximate Entropy (ApEn), and Fuzzy Entropy (FuzzyEn) are used as a measure of heart rate variability (HRV). Tachograms belonging to thirty-nine subjects were obtained from a cardiac stress test consisting of a rest period followed by a period of moderate physical activity. Subjects are grouped according to their physical activity using the IPAQ sedentary and active questionnaire, we work with youth and middle-aged adults. The entropy measures for each group show that for the sedentary subjects the values are high at rest and decrease appreciably with moderate physical activity, This happens for both young and middle-aged adults. These results are highly reproducible. In the case of the subjects that exercise regularly, an increase in entropy is observed or they tend to retain the entropy value that they had at rest. It seems that there is a possible correlation between the physical condition of a person with the increase or decrease in entropy during moderate physical activity with respect to the entropy at rest. It was also observed that entropy during longer physical activity tests tends to decrease as fatigue accumulates, but this decrease is small compared to the change that occurs when going from rest to physical activity.