TimeGraph: Synthetic Benchmark Datasets for Robust Time-Series Causal Discovery (2025-06-02T00:00:00.000000Z)

TL;DR

The introduction of TimeGraph, a comprehensive suite of synthetic time-series benchmark datasets that systematically incorporates both linear and nonlinear dependencies while modeling key temporal characteristics such as trends, seasonal effects, and heterogeneous noise patterns, is introduced.

Abstract

Robust causal discovery in time series datasets depends on reliable benchmark datasets with known ground-truth causal relationships. However, such datasets remain scarce, and existing synthetic alternatives often overlook critical temporal properties inherent in real-world data, including nonstationarity driven by trends and seasonality, irregular sampling intervals, and the presence of unobserved confounders. To address these challenges, we introduce TimeGraph, a comprehensive suite of synthetic time-series benchmark datasets that systematically incorporates both linear and nonlinear dependencies while modeling key temporal characteristics such as trends, seasonal effects, and heterogeneous noise patterns. Each dataset is accompanied by a fully specified causal graph featuring varying densities and diverse noise distributions and is provided in two versions: one including unobserved confounders and one without, thereby offering extensive coverage of real-world complexity while preserving methodological neutrality. We further demonstrate the utility of TimeGraph through systematic evaluations of state-of-the-art causal discovery algorithms including PCMCI+, LPCMCI, and FGES across a diverse array of configurations and metrics. Our experiments reveal significant variations in algorithmic performance under realistic temporal conditions, underscoring the need for robust synthetic benchmarks in the fair and transparent assessment of causal discovery methods. The complete TimeGraph suite, including dataset generation scripts, evaluation metrics, and recommended experimental protocols, is freely available to facilitate reproducible research and foster community-driven advancements in time-series causal discovery.

Authors

Muhammad Hasan Ferdous

1 papers

Emam Hossain

1 papers

Md. Osman Gani

1 papers

TL;DR

Abstract

Authors

References57 items

Correlation to Causation: A Causal Deep Learning Framework for Arctic Sea Ice Prediction

CausalTime: Realistically Generated Time-series for Benchmarking of Causal Discovery

Causal Discovery from Temporal Data: An Overview and New Perspectives

Estimating Treatment Effects from Irregular Time Series Observations with Hidden Confounders

Structural Causal Model with Expert Augmented Knowledge to Estimate the Effect of Oxygen Therapy on Mortality in the ICU

CausalWorld: A Robotic Manipulation Benchmark for Causal Structure and Transfer Learning

High-recall causal discovery for autocorrelated time series with latent confounders

Discovering contemporaneous and lagged causal relations in autocorrelated nonlinear time series datasets

Causality

Causal Discovery from Heterogeneous/Nonstationary Data

Structure Learning Under Missing Data

Causal discovery in the presence of missing data

Elements of Causal Inference: Foundations and Learning Algorithms

A Review of Self-Exciting Spatio-Temporal Point Processes and Their Applications

Reliable Decision Support using Counterfactual Models

Detecting and quantifying causal associations in large nonlinear time series datasets

Temporal Regularized Matrix Factorization for High-dimensional Time Series Prediction

A million variables and more: the Fast Greedy Equivalence Search algorithm for learning high-dimensional graphical causal models, with an application to functional magnetic resonance images

Causal inference and the data-fusion problem

A Multivariate Timeseries Modeling Approach to Severity of Illness Assessment and Forecasting in ICU with Sparse, Heterogeneous Clinical Data

Distinguishing Cause from Effect Using Observational Data: Methods and Benchmarks

Causal Mediation Analysis with Multiple Mediators

A survey on concept drift adaptation

Kernel-based Conditional Independence Test and Application in Causal Discovery

Climate change 2007: the physical science basis

On the Identifiability of the Post-Nonlinear Causal Model

Mostly Harmless Econometrics: An Empiricist's Companion

Causal Protein-Signaling Networks Derived from Multiparameter Single-Cell Data

Analyzing multiple nonlinear time series with extended Granger causality

Time series analysis.

Macroeconomic Forecasting Using Diffusion Indexes

The Laplace Distribution and Generalizations: A Revisit with Applications to Communications, Economics, Engineering, and Finance

The Distribution of Realized Exchange Rate Volatility

Northern hemisphere temperatures during the past millennium: Inferences, uncertainties, and limitations

Misinterpreting the dynamic effects of aggregate demand and supply disturbances

Analysis of semiparametric regression models for repeated outcomes in the presence of missing data

Analysis of repeated categorical data using generalized estimating equations.

How Many Iterations in the Gibbs Sampler

Statistical Analysis With Missing Data

INFERENCE AND MISSING DATA

Investigating causal relations by econometric models and cross-spectral methods

CausalBench: A Comprehensive Benchmark for Evaluating Causal Reasoning Capabilities of Large Language Models

Inferring Cause and Effect in the Presence of Heteroscedastic Noise

Learning the Structure of a Nonstation-ary Vector Autoregression

The Analysis of Time Series: An Intro-duction with R

Causal Discovery with Linear Non-Gaussian Models under Measurement Error: Structural Identifiability Results

The Prevention and Treatment of Missing Data in Clinical Trials . Technical Report

Discovery Methods for I.I.D. and Time Series Data

ALinearNon-GaussianAcyclicModelforCausalDiscovery

The global saving glut and the US current account deficit . Technical Report

Optimal Structure Identification With Greedy Search

Causation, Prediction, and Search (2 ed.)

Efficient Capital Markets : A Review of Theory and Empirical Work

STL : A Seasonal-Trend Decomposition Procedure Based on Loess

with Deep Learning in Predicting Short-Term and Seasonal Sea Ice

2023. A Survey on Causal

2023. Cdans: Temporal Causal Discovery from Autocorrelated and Non-Stationary Time Series Data

Field of Study

Journal Information

Name

Venue Information

Name

Type

URL

Alternate Names