Please use this identifier to cite or link to this item:
http://hdl.handle.net/1942/30418
Title: | Lag length selection and p-hacking in Granger causality testing: prevalence and performance of meta-regression models | Authors: | BRUNS, Stephan Stern, David |
Issue Date: | 2019 | Publisher: | PHYSICA-VERLAG GMBH & CO | Source: | Empirical Economics, 56 (3) , p. 797 -830 | Abstract: | The academic system incentivizes p-hacking, where researchers select estimates and statistics with statistically significant p-values for publication. We analyze the complete process of Granger causality testing including p-hacking using Monte Carlo simulations. If the degrees of freedom of the underlying vector autoregressive model are small to moderate, information criteria tend to overfit the lag length and overfitted vector autoregressive models tend to result in false-positive findings of Granger causality. Researchers may p-hack Granger causality tests by estimating multiple vector autoregressive models with different lag lengths and then selecting only those models that reject the null of Granger non-causality for presentation in the final publication. We show that overfitted lag lengths and the corresponding false-positive findings of Granger causality can frequently occur in research designs that are prevalent in empirical macroeconomics. We demonstrate that meta-regression models can control for spuriously significant Granger causality tests due to overfitted lag lengths. Finally, we find evidence that false-positive findings of Granger causality may be prevalent in the large literature that tests for Granger causality between energy use and economic output, while we do not find evidence for a genuine relation between these variables as tested in the literature. | Keywords: | Granger causality;p-hacking;Publication bias;Information criteria;Meta-analysis;Vector autoregression | Document URI: | http://hdl.handle.net/1942/30418 | ISSN: | 0377-7332 | e-ISSN: | 1435-8921 | DOI: | 10.1007/s00181-018-1446-3 | ISI #: | WOS:000459282200002 | Rights: | Springer-Verlag GmbH Germany, part of Springer Nature 2018 | Category: | A1 | Type: | Journal Contribution |
Appears in Collections: | Research publications |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Bruns-Stern2019_Article_LagLengthSelectionAndP-hacking.pdf Restricted Access | Published version | 1.06 MB | Adobe PDF | View/Open Request a copy |
SCOPUSTM
Citations
5
checked on Sep 7, 2020
WEB OF SCIENCETM
Citations
20
checked on Jun 21, 2024
Page view(s)
94
checked on Sep 7, 2022
Download(s)
12
checked on Sep 7, 2022
Google ScholarTM
Check
Altmetric
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.