Neglect of publication bias compromises meta-analyses of educational research.
Because negative findings have less chance of getting published, available studies tend to be a biased sample. This leads to an inflation of effect size estimates to an unknown degree. To see how meta-analyses in education account for publication bias, we surveyed all meta-analyses published in the...
Guardado en:
Autores principales: | , , |
---|---|
Formato: | article |
Lenguaje: | EN |
Publicado: |
Public Library of Science (PLoS)
2021
|
Materias: | |
Acceso en línea: | https://doaj.org/article/dd44a95b262245719d9e5570992d1e61 |
Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
id |
oai:doaj.org-article:dd44a95b262245719d9e5570992d1e61 |
---|---|
record_format |
dspace |
spelling |
oai:doaj.org-article:dd44a95b262245719d9e5570992d1e612021-12-02T20:03:57ZNeglect of publication bias compromises meta-analyses of educational research.1932-620310.1371/journal.pone.0252415https://doaj.org/article/dd44a95b262245719d9e5570992d1e612021-01-01T00:00:00Zhttps://doi.org/10.1371/journal.pone.0252415https://doaj.org/toc/1932-6203Because negative findings have less chance of getting published, available studies tend to be a biased sample. This leads to an inflation of effect size estimates to an unknown degree. To see how meta-analyses in education account for publication bias, we surveyed all meta-analyses published in the last five years in the Review of Educational Research and Educational Research Review. The results show that meta-analyses usually neglect publication bias adjustment. In the minority of meta-analyses adjusting for bias, mostly non-principled adjustment methods were used, and only rarely were the conclusions based on corrected estimates, rendering the adjustment inconsequential. It is argued that appropriate state-of-the-art adjustment (e.g., selection models) should be attempted by default, yet one needs to take into account the uncertainty inherent in any meta-analytic inference under bias. We conclude by providing practical recommendations on dealing with publication bias.Ivan RopovikMatus AdamkovicDavid GregerPublic Library of Science (PLoS)articleMedicineRScienceQENPLoS ONE, Vol 16, Iss 6, p e0252415 (2021) |
institution |
DOAJ |
collection |
DOAJ |
language |
EN |
topic |
Medicine R Science Q |
spellingShingle |
Medicine R Science Q Ivan Ropovik Matus Adamkovic David Greger Neglect of publication bias compromises meta-analyses of educational research. |
description |
Because negative findings have less chance of getting published, available studies tend to be a biased sample. This leads to an inflation of effect size estimates to an unknown degree. To see how meta-analyses in education account for publication bias, we surveyed all meta-analyses published in the last five years in the Review of Educational Research and Educational Research Review. The results show that meta-analyses usually neglect publication bias adjustment. In the minority of meta-analyses adjusting for bias, mostly non-principled adjustment methods were used, and only rarely were the conclusions based on corrected estimates, rendering the adjustment inconsequential. It is argued that appropriate state-of-the-art adjustment (e.g., selection models) should be attempted by default, yet one needs to take into account the uncertainty inherent in any meta-analytic inference under bias. We conclude by providing practical recommendations on dealing with publication bias. |
format |
article |
author |
Ivan Ropovik Matus Adamkovic David Greger |
author_facet |
Ivan Ropovik Matus Adamkovic David Greger |
author_sort |
Ivan Ropovik |
title |
Neglect of publication bias compromises meta-analyses of educational research. |
title_short |
Neglect of publication bias compromises meta-analyses of educational research. |
title_full |
Neglect of publication bias compromises meta-analyses of educational research. |
title_fullStr |
Neglect of publication bias compromises meta-analyses of educational research. |
title_full_unstemmed |
Neglect of publication bias compromises meta-analyses of educational research. |
title_sort |
neglect of publication bias compromises meta-analyses of educational research. |
publisher |
Public Library of Science (PLoS) |
publishDate |
2021 |
url |
https://doaj.org/article/dd44a95b262245719d9e5570992d1e61 |
work_keys_str_mv |
AT ivanropovik neglectofpublicationbiascompromisesmetaanalysesofeducationalresearch AT matusadamkovic neglectofpublicationbiascompromisesmetaanalysesofeducationalresearch AT davidgreger neglectofpublicationbiascompromisesmetaanalysesofeducationalresearch |
_version_ |
1718375632611573760 |