Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Inverse Ising problem in continuous time: A latent variable approach
(Submitted on 4 Sep 2017 (v1), last revised 21 Dec 2017 (this version, v3))
Abstract: We consider the inverse Ising problem, i.e. the inference of network couplings from observed spin trajectories for a model with continuous time Glauber dynamics. By introducing two sets of auxiliary latent random variables we render the likelihood into a form, which allows for simple iterative inference algorithms with analytical updates. The variables are: (1) Poisson variables to linearise an exponential term which is typical for point process likelihoods and (2) P\'olya-Gamma variables, which make the likelihood quadratic in the coupling parameters. Using the augmented likelihood, we derive an expectation-maximization (EM) algorithm to obtain the maximum likelihood estimate of network parameters. Using a third set of latent variables we extend the EM algorithm to sparse couplings via L1 regularization. Finally, we develop an efficient approximate Bayesian inference algorithm using a variational approach. We demonstrate the performance of our algorithms on data simulated from an Ising model. For data which are simulated from a more biologically plausible network with spiking neurons, we show that the Ising model captures well the low order statistics of the data and how the Ising couplings are related to the underlying synaptic structure of the simulated network.
Submission history
From: Christian Donner [view email][v1] Mon, 4 Sep 2017 13:34:18 GMT (653kb)
[v2] Fri, 1 Dec 2017 11:25:26 GMT (730kb)
[v3] Thu, 21 Dec 2017 09:02:32 GMT (730kb)
Link back to: arXiv, form interface, contact.