References & Citations
Mathematics > Probability
Title: Steady State Sensitivity Analysis of Continuous Time Markov Chains
(Submitted on 2 Apr 2018 (v1), revised 10 May 2018 (this version, v2), latest version 21 Jan 2019 (v4))
Abstract: In this paper, we study Monte Carlo estimators based on the likelihood ratio approach for steady-state sensitivity. We first extend the result of Glynn and Olvera-Cravioto [arXiv:1707.02659] to the setting of continuous time Markov chains (CTMC) with a countable state space which include models such as stochastic reaction kinetics and kinetic Monte Carlo lattice system. Then we show that the variance of the centered LR estimators do not grow in time. This result suggests that the centered estimators should be favored when the mixing time of the CTMC is large. We demonstrate a practical implication of this analysis on a numerical benchmark of two examples for the biochemical reaction networks.
Submission history
From: Ting Wang [view email][v1] Mon, 2 Apr 2018 15:15:34 GMT (61kb,D)
[v2] Thu, 10 May 2018 18:40:18 GMT (42kb)
[v3] Wed, 20 Jun 2018 04:39:25 GMT (43kb)
[v4] Mon, 21 Jan 2019 00:53:19 GMT (44kb)
Link back to: arXiv, form interface, contact.