Please use this identifier to cite or link to this item:
http://hdl.handle.net/1942/29856
Title: | Reporting errors and biases in published empirical findings: Evidence from innovation research | Authors: | BRUNS, Stephan Asanov, Igor Bode, Rasmus Dunger, Melanie Funk, Christoph Hassan, Sherif M. Hauschildt, Julia Heinisch, Dominik Kempa, Karol Koenig, Johannes Lips, Johannes Verbeck, Matthias Wolfschuetz, Eva Buenstorf, Guido |
Issue Date: | 2019 | Publisher: | ELSEVIER | Source: | RESEARCH POLICY, 48(9) (Art N° 103796) | Abstract: | Errors and biases in published results compromise the reliability of empirical research, posing threats to the cumulative research process and to evidence-based decision making. We provide evidence on reporting errors and biases in innovation research. We find that 45% of the articles in our sample contain at least one result for which the provided statistical information is not consistent with reported significance levels. In 25% of the articles, at least one strong reporting error is diagnosed where a statistically non-significant finding becomes significant or vice versa using the common significance threshold of 0.1. The error rate at the test level is very small with 4.0% exhibiting any error and 1.4% showing strong errors. We also find systematically more marginally significant findings compared to marginally non-significant findings at the 0.05 and 0.1 thresholds of statistical significance. These discontinuities indicate the presence of reporting biases. Explorative analysis suggests that discontinuities are related to authors' affiliations and to a lesser extent the article's rank in the issue and the style of reporting. | Notes: | [Bruns, Stephan B.] Hasselt Univ, Ctr Environm Sci, Hasselt, Belgium. [Bruns, Stephan B.; Dunger, Melanie] Univ Gottingen, Dept Econ, Gottingen, Germany. [Asanov, Igor; Bode, Rasmus; Hauschildt, Julia; Heinisch, Dominik; Koenig, Johannes; Wolfschuetz, Eva; Buenstorf, Guido] Univ Kassel, Dept Econ, Kassel, Germany. [Asanov, Igor; Bode, Rasmus; Heinisch, Dominik; Koenig, Johannes; Buenstorf, Guido] Univ Kassel, Int Ctr Higher Educ Res, Kassel, Germany. [Verbeck, Matthias] Univ Marburg, Dept Econ, Marburg, Germany. [Hassan, Sherif M.] Univ Marburg, Ctr Near & Middle Eastern Studies, Marburg, Germany. [Hassan, Sherif M.] M&S Res Hub, Kassel, Germany. [Hassan, Sherif M.] Suez Canal Univ, Dept Econ, Ismailia, Egypt. [Funk, Christoph; Lips, Johannes] Univ Giessen, Dept Econ, Giessen, Germany. [Kempa, Karol] Frankfurt Sch Finance & Management, Dept Econ, Frankfurt, Germany. [Buenstorf, Guido] Univ Gothenburg, Inst Innovat & Entrepreneurship, Gothenburg, Sweden. | Keywords: | Reporting bias; Reporting error; Innovation; p-hacking; Publication bias; Caliper test;Reporting bias; Reporting error; Innovation; p-hacking; Publication bias; Caliper test | Document URI: | http://hdl.handle.net/1942/29856 | ISSN: | 0048-7333 | e-ISSN: | 1873-7625 | DOI: | 10.1016/j.respol.2019.05.005 | ISI #: | 000485851300006 | Rights: | 2019 Elsevier B.V. All rights reserved | Category: | A1 | Type: | Journal Contribution | Validations: | ecoom 2020 |
Appears in Collections: | Research publications |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
bruns 1.pdf Restricted Access | Published version | 2.1 MB | Adobe PDF | View/Open Request a copy |
SCOPUSTM
Citations
3
checked on Sep 3, 2020
WEB OF SCIENCETM
Citations
23
checked on Jul 18, 2024
Page view(s)
158
checked on Sep 6, 2022
Download(s)
110
checked on Sep 6, 2022
Google ScholarTM
Check
Altmetric
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.