Specific Differential Entropy Rate Estimation for Continuous-Valued Time Series (2016-05-19T00:00:00.000000Z)

TL;DR

A method for quantifying the inherent unpredictability of a continuous-valued time series via an extension of the differential Shannon entropy rate, and provides a data-driven approach for estimating the specific entropy rate of an observed time series.

Abstract

We introduce a method for quantifying the inherent unpredictability of a continuous-valued time series via an extension of the differential Shannon entropy rate. Our extension, the specific entropy rate, quantifies the amount of predictive uncertainty associated with a specific state, rather than averaged over all states. We provide a data-driven approach for estimating the specific entropy rate of an observed time series. Finally, we consider three case studies of estimating the specific entropy rate from synthetic and physiological data relevant to the analysis of heart rate variability.

Authors

David M. Darmon

1 papers

TL;DR

Abstract

Authors

References85 items

Analysis of k-Nearest Neighbor Distances with Application to Entropy Estimation

Nonparametric von Mises Estimators for Entropies, Divergences and Mutual Informations

Nonlinear Time Series Analysis

Estimating Mutual Information by Local Gaussian Approximation

Influence Functions for Machine Learning: Nonparametric Estimators for Entropies, Divergences and Mutual Informations

Inhomogeneous point-process entropy: an instantaneous measure of complexity in discrete systems.

Causation entropy identifies indirect influences, dominance of neighbors and anticipatory couplings

Handbook of Differential Entropy

Exploring neural directed interactions with transfer entropy based on an adaptive kernel density estimator

Point-Process Nonlinear Models With Laguerre and Volterra Expansions: Instantaneous Assessment of Heartbeat Dynamics

The Appropriate Use of Approximate Entropy and Sample Entropy with Short Data Sets

Conditional Rényi Entropies

Ensemble Estimators for Multivariate Entropy Estimation

Improved entropy rate estimation in physiological data

Heart Rate Variability – A Historical Perspective

Anatomy of a Bit: Information in a Time Series Observation

Dimension Reduction and Adaptation in Conditional Density Estimation

Methods derived from nonlinear dynamics for analysing heart rate variability

Characterizing Nonlinear Heartbeat Dynamics Within a Point Process Framework

Investigation of heart rate and blood pressure variability, baroreflex sensitivity, and approximate entropy in acute brain injury patients.

Nonparametric Econometrics: The np Package

Local information transfer as a spatiotemporal filter for complex systems.

Heart rate variability: a review

Independent Component Analysis

Elements of Information Theory

On the Non-parametric Prediction of Conditionally Stationary Sequences

Sympathetic and parasympathetic activities evaluated by heart-rate variability in head injury of various severities

Resampling Methods for Dependent Data

Nonlinear Time Series: Nonparametric and Parametric Methods

Cross-Validation and the Estimation of Conditional Probability Densities

Chaos: A Statistical Perspective

Variable kernel density estimation

Methods and Techniques of Complex Systems Science: An Overview

Estimating mutual information.

Sample entropy analysis of neonatal heart rate variability.

Multiscale entropy analysis of complex physiologic time series.

Information transfer in continuous processes

Probability and random processes (3rd edn)

Regularities unseen, randomness observed: levels of entropy convergence.

Nonparametric Statistics for Stochastic Processes: Estimation and Prediction

Physiological time-series analysis using approximate entropy and sample entropy.

Measuring information transfer

How to measure the information gained from one symbol.

Computational Mechanics: Pattern and Prediction, Structure and Simplicity

Dynamical entropy for systems with stochastic perturbation

Heart rate variability: origins, methods, and interpretive caveats.

Complexity: Probability, ergodic theory, and information

Heart rate variability. Standards of measurement, physiological interpretation, and clinical use

Quantifying the influence of initial values on nonlinear prediction

On prediction and chaos in stochastic systems

A cross-validatory method for dependent data

Independent component analysis, A new concept?

Information theory - for continuous systems

Approximate entropy as a measure of system complexity.

Gaussian‐based kernels

Stochastic Complexity in Statistical Inquiry

Inferring statistical complexity.

Information and entropy in strange attractors

Canonical kernels for density estimation

Toward a quantitative theory of self-generated complexity

Comparing Spectra of a Series of Point Events Particularly for Heart Rate Variability Data

Nonlinear Filters Estimation And Applications

Available online: http://github.com/ddarmon/spenra

spenra GitHub Repository. Available online: http://github.com/ddarmon/spenra (accessed on 17 May 2016)

Measuring the Dynamics of Information Processing on a Local Scale in Time and Space

Kubios HRV - Heart rate variability analysis software

Chao Yang

Nonparametric entropy estimation using kernel densities.

J. Crit. Care

Renyi entropy measures of heart rate Gaussianity

A Mathematical Theory of Communication

A point-process model of human heartbeat intervals: new definitions of heart rate and heart rate variability.

MEASURES OF -COMPLEXITY

126: Probability and Random Processes

THE CO-INFORMATION LATTICE

Reconstruction of Integrate-and-Fire Dynamics