We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Methodology

Title: Model Assessment Tools for a Model False World

Abstract: A standard goal of model evaluation and selection is to find a model that approximates the truth well while at the same time is as parsimonious as possible. In this paper we emphasize the point of view that the models under consideration are almost always false, if viewed realistically, and so we should analyze model adequacy from that point of view. We investigate this issue in large samples by looking at a model credibility index, which is designed to serve as a one-number summary measure of model adequacy. We define the index to be the maximum sample size at which samples from the model and those from the true data generating mechanism are nearly indistinguishable. We use standard notions from hypothesis testing to make this definition precise. We use data subsampling to estimate the index. We show that the definition leads us to some new ways of viewing models as flawed but useful. The concept is an extension of the work of Davies [Statist. Neerlandica 49 (1995) 185--245].
Comments: Published in at this http URL the Statistical Science (this http URL) by the Institute of Mathematical Statistics (this http URL)
Subjects: Methodology (stat.ME)
Journal reference: Statistical Science 2009, Vol. 24, No. 3, 303-318
DOI: 10.1214/09-STS302
Report number: IMS-STS-STS302
Cite as: arXiv:1010.0304 [stat.ME]
  (or arXiv:1010.0304v1 [stat.ME] for this version)

Submission history

From: Jiawei Liu [view email]
[v1] Sat, 2 Oct 2010 08:11:53 GMT (212kb)

Link back to: arXiv, form interface, contact.