Current browse context:
q-fin.EC
Change to browse by:
References & Citations
Quantitative Finance > Economics
Title: Equilibrium in Misspecified Markov Decision Processes
(Submitted on 24 Feb 2015 (v1), last revised 14 May 2016 (this version, v2))
Abstract: We study Markov decision problems where the agent does not know the transition probability function mapping current states and actions to future states. The agent has a prior belief over a set of possible transition functions and updates beliefs using Bayes' rule. We allow her to be misspecified in the sense that the true transition probability function is not in the support of her prior. This problem is relevant in many economic settings but is usually not amenable to analysis by the researcher. We make the problem tractable by studying asymptotic behavior. We propose an equilibrium notion and provide conditions under which it characterizes steady state behavior. In the special case where the problem is static, equilibrium coincides with the single-agent version of Berk-Nash equilibrium (Esponda and Pouzo (2016)). We also discuss subtle issues that arise exclusively in dynamic settings due to the possibility of a negative value of experimentation.
Submission history
From: Demian Pouzo [view email][v1] Tue, 24 Feb 2015 18:30:05 GMT (91kb,D)
[v2] Sat, 14 May 2016 04:42:07 GMT (162kb,D)
Link back to: arXiv, form interface, contact.