We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Methodology

Title: Consilience: A Holistic Measure of Goodness-of-Fit

Abstract: We describe an apparently new measure of multivariate goodness-of-fit between sets of quantitative results from a model (simulation, analytical, or multiple regression), paired with those observed under corresponding conditions from the system being modeled. Our approach returns a single, integrative measure, even though it can accommodate complex systems that produce responses of M types. For each response-type, the goodness-of-fit measure, which we label "Consilience" (C), is maximally 1, for perfect fit; near 0 for the large-sample case (number of pairs, N, more than about 25) in which the modeled series is a random sample from a quasi-normal distribution with the same mean and variance as that of the observed series (null model); and, less than 0, toward minus-infinity, for progressively worse fit. In addition, lack-of-fit for each response-type can be apportioned between systematic and non-systematic (unexplained) components of error. Finally, for statistical assessment of models relative to the equivalent null model, we offer provisional estimates of critical C vs. N, and of critical joint-C vs. N and M, at various levels of Pr(type-I error). Application of our proposed methodology requires only MS Excel (2003 or later); we provide Excel XLS and XLSX templates that afford semi-automatic computation for systems involving up to M = 5 response types, each represented by up to N = 1000 observed-and-modeled result pairs. N need not be equal, nor response pairs in complete overlap, over M.
Comments: This 3rd update of the ms. (permanent arXiv identifier 1710.08054, 23OCT2017) differs from the 2nd only in that the 3rd provides an additional, alternative pathway for retrieving files cited via people.tamu.edu-hyperlinks in the ms. <end>
Subjects: Methodology (stat.ME)
Cite as: arXiv:1710.08054 [stat.ME]
  (or arXiv:1710.08054v4 [stat.ME] for this version)

Submission history

From: William Neill [view email]
[v1] Mon, 23 Oct 2017 01:21:40 GMT (513kb)
[v2] Thu, 2 Nov 2017 15:56:59 GMT (579kb)
[v3] Wed, 11 Apr 2018 02:36:28 GMT (581kb)
[v4] Sat, 20 Oct 2018 21:42:52 GMT (578kb)

Link back to: arXiv, form interface, contact.