On bootstrapping tests of equal forecast accuracy for nested models

dc.contributor.authorDoko Tchatoka, F.
dc.contributor.authorHaque, Q.
dc.date.issued2020
dc.description.abstractThe asymptotic distributions of the recursive out-of-sample forecast accuracy test statistics depend on stochastic integrals of Brownian motion when the models under comparison are nested. This often complicates their implementation in practice because the computation of their asymptotic critical values is costly. Hansen and Timmermann (2015, Econometrica) propose a Wald approximation of the commonly used recursive Fstatistic and provide a simple characterization of the exact density of its asymptotic distribution. However, this characterization holds only when the larger model has one extra predictor or the forecast errors are homoscedastic. No such closed-form characterization is readily available when the nesting involves more than one predictor and heteroskedasticity is present. We first show both the recursive F-test and its Wald approximation have poor finite-sample properties, especially when the forecast horizon is greater than one. We then propose a hybrid bootstrap method consisting of a block moving bootstrap (which is nonparametric) and a residual based bootstrap for both statistics, and establish its validity. Simulations show that our hybrid bootstrap has good finite-sample performance, even in multi-step ahead forecasts with heteroscedastic or autocorrelated errors, and more than one predictor. The bootstrap method is illustrated on forecasting core inflation and GDP growth.
dc.description.statementofresponsibilityFirmin Doko Tchatoka, Qazi Haque
dc.identifier.issn2206-0332
dc.identifier.orcidDoko Tchatoka, F. [0000-0003-1876-0633]
dc.identifier.orcidHaque, Q. [0000-0003-0694-4443]
dc.identifier.urihttps://hdl.handle.net/2440/138498
dc.language.isoen
dc.publisherCentre for Applied Macroeconomic Analysis, Australian National University
dc.relation.granthttp://purl.org/au-research/grants/arc/DP200101498
dc.relation.granthttp://purl.org/au-research/grants/arc/DP170100697
dc.relation.ispartofseriesCAMA Working Paper; 27/2020
dc.rightsCopyright status unknown
dc.source.urihttps://cama.crawford.anu.edu.au/publication/cama-working-paper-series/16340/bootstrapping-tests-equal-forecast-accuracy-nested
dc.subjectOut-of-sample forecasts
dc.subjectHAC estimator
dc.subjectMoving block bootstrap
dc.subjectBootstrap consistency
dc.titleOn bootstrapping tests of equal forecast accuracy for nested models
dc.typeWorking paper
pubs.publication-statusPublished

Files