Non-Stationary Gaussian Process Regression with Hamiltonian Monte Carlo
Published in
International Conference on Artificial Intellig...(2015)External Links:
TL
TL;DR
This work proposes to infer full parameter posterior with Hamiltonian Monte Carlo (HMC), which conveniently extends the analytical gradient-based GPR learning by guiding the sampling with model gradients, and learns the MAP solution from the posterior by gradient ascent.
Abstract
We present a novel approach for fully non-stationary Gaussian process regression (GPR), where all three key parameters -- noise variance, signal variance and lengthscale -- can be simultaneously input-dependent. We develop gradient-based inference methods to learn the unknown function and the non-stationary model parameters, without requiring any model approximations. We propose to infer full parameter posterior with Hamiltonian Monte Carlo (HMC), which conveniently extends the analytical gradient-based GPR learning by guiding the sampling with model gradients. We also learn the MAP solution from the posterior by gradient ascent. In experiments on several synthetic datasets and in modelling of temporal gene expression, the nonstationary GPR is shown to be necessary for modeling realistic input-dependent dynamics, while it performs comparably to conventional stationary or previous non-stationary GPR models otherwise.
References24 items
1
Detecting time periods of differential gene expression using Gaussian processes: an application to endothelial cells exposed to radiotherapy dose fraction
2
Expectation propagation for nonstationary heteroscedastic Gaussian process regression
3
Input Warping for Bayesian Optimization of Non-Stationary Functions
4
Gaussian Process Regression with Heteroscedastic or Non-Gaussian Residuals
5