Please use this identifier to cite or link to this item:
http://hdl.handle.net/1942/43200
Title: | Footprint of publication selection bias on meta-analyses in medicine, environmental sciences, psychology, and economics | Authors: | Bartos, F Maier , M Wagenmakers, EJ Nippold, F Doucouliagos, H Ioannidis, JPA Otte, WM Sladekova, M DERESSA, Teshome BRUNS, Stephan Fanelli, D Stanley, TD |
Issue Date: | 2024 | Source: | Research synthesis methods (Print), 15 (3) , p. 500 -511 | Abstract: | Publication selection bias undermines the systematic accumulation of evidence. To assess the extent of this problem, we survey over 68,000 meta-analyses containing over 700,000 effect size estimates from medicine (67,386/597,699), environmental sciences (199/12,707), psychology (605/23,563), and economics (327/91,421). Our results indicate that meta-analyses in economics are the most severely contaminated by publication selection bias, closely followed by meta-analyses in environmental sciences and psychology, whereas meta-analyses in medicine are contaminated the least. After adjusting for publication selection bias, the median probability of the presence of an effect decreased from 99.9% to 29.7% in economics, from 98.9% to 55.7% in psychology, from 99.8% to 70.7% in environmental sciences, and from 38.0% to 29.7% in medicine. The median absolute effect sizes (in terms of standardized mean differences) decreased from d = 0.20 to d = 0.07 in economics, from d = 0.37 to d = 0.26 in psychology, from d = 0.62 to d = 0.43 in environmental sciences, and from d = 0.24 to d = 0.13 in medicine. | Keywords: | Bayesian;effect sizes;evidence;meta-analysis;model-averaging;publication bias;RoBMA | Document URI: | http://hdl.handle.net/1942/43200 | ISSN: | 1759-2879 | e-ISSN: | 1759-2887 | DOI: | 10.1002/jrsm.1703 | ISI #: | WOS:001157617000001 | Rights: | This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, providedthe original work is properly cited. 2024 The Authors. Research Synthesis Methods published by John Wiley & Sons Ltd | Category: | A1 | Type: | Journal Contribution |
Appears in Collections: | Research publications |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Research Synthesis Methods - 2024 - Bartoš - Footprint of publication selection bias on meta‐analyses in medicine .pdf | Published version | 1.53 MB | Adobe PDF | View/Open |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.