We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Methodology

Title: Can Two Forecasts Have the Same Conditional Expected Accuracy?

Abstract: The method for testing equal predictive accuracy for pairs of forecasting models proposed by Giacomini and White (2006) has found widespread use in empirical work. The procedure assumes that the parameters of the underlying forecasting models are estimated using a rolling window of fixed width and incorporates the effect of parameter estimation in the null hypothesis that two forecasts have identical conditionally expected loss. We show that this null hypothesis cannot be valid under a rolling window estimation scheme and even fails in the absence of parameter estimation for many types of stochastic processes in common use. This means that the approach does not guarantee appropriate comparisons of predictive accuracy of forecasting models. We also show that the Giacomini-White approach can lead to substantial size distortions in tests of equal unconditional predictive accuracy and propose an alternative procedure with better properties.
Subjects: Methodology (stat.ME)
Cite as: arXiv:2006.03238 [stat.ME]
  (or arXiv:2006.03238v1 [stat.ME] for this version)

Submission history

From: Yinchu Zhu [view email]
[v1] Fri, 5 Jun 2020 05:24:05 GMT (15kb)

Link back to: arXiv, form interface, contact.