Neglect of publication bias compromises meta-analyses of educational research.

Because negative findings have less chance of getting published, available studies tend to be a biased sample. This leads to an inflation of effect size estimates to an unknown degree. To see how meta-analyses in education account for publication bias, we surveyed all meta-analyses published in the...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Ivan Ropovik, Matus Adamkovic, David Greger
Formato: article
Lenguaje:EN
Publicado: Public Library of Science (PLoS) 2021
Materias:
R
Q
Acceso en línea:https://doaj.org/article/dd44a95b262245719d9e5570992d1e61
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:dd44a95b262245719d9e5570992d1e61
record_format dspace
spelling oai:doaj.org-article:dd44a95b262245719d9e5570992d1e612021-12-02T20:03:57ZNeglect of publication bias compromises meta-analyses of educational research.1932-620310.1371/journal.pone.0252415https://doaj.org/article/dd44a95b262245719d9e5570992d1e612021-01-01T00:00:00Zhttps://doi.org/10.1371/journal.pone.0252415https://doaj.org/toc/1932-6203Because negative findings have less chance of getting published, available studies tend to be a biased sample. This leads to an inflation of effect size estimates to an unknown degree. To see how meta-analyses in education account for publication bias, we surveyed all meta-analyses published in the last five years in the Review of Educational Research and Educational Research Review. The results show that meta-analyses usually neglect publication bias adjustment. In the minority of meta-analyses adjusting for bias, mostly non-principled adjustment methods were used, and only rarely were the conclusions based on corrected estimates, rendering the adjustment inconsequential. It is argued that appropriate state-of-the-art adjustment (e.g., selection models) should be attempted by default, yet one needs to take into account the uncertainty inherent in any meta-analytic inference under bias. We conclude by providing practical recommendations on dealing with publication bias.Ivan RopovikMatus AdamkovicDavid GregerPublic Library of Science (PLoS)articleMedicineRScienceQENPLoS ONE, Vol 16, Iss 6, p e0252415 (2021)
institution DOAJ
collection DOAJ
language EN
topic Medicine
R
Science
Q
spellingShingle Medicine
R
Science
Q
Ivan Ropovik
Matus Adamkovic
David Greger
Neglect of publication bias compromises meta-analyses of educational research.
description Because negative findings have less chance of getting published, available studies tend to be a biased sample. This leads to an inflation of effect size estimates to an unknown degree. To see how meta-analyses in education account for publication bias, we surveyed all meta-analyses published in the last five years in the Review of Educational Research and Educational Research Review. The results show that meta-analyses usually neglect publication bias adjustment. In the minority of meta-analyses adjusting for bias, mostly non-principled adjustment methods were used, and only rarely were the conclusions based on corrected estimates, rendering the adjustment inconsequential. It is argued that appropriate state-of-the-art adjustment (e.g., selection models) should be attempted by default, yet one needs to take into account the uncertainty inherent in any meta-analytic inference under bias. We conclude by providing practical recommendations on dealing with publication bias.
format article
author Ivan Ropovik
Matus Adamkovic
David Greger
author_facet Ivan Ropovik
Matus Adamkovic
David Greger
author_sort Ivan Ropovik
title Neglect of publication bias compromises meta-analyses of educational research.
title_short Neglect of publication bias compromises meta-analyses of educational research.
title_full Neglect of publication bias compromises meta-analyses of educational research.
title_fullStr Neglect of publication bias compromises meta-analyses of educational research.
title_full_unstemmed Neglect of publication bias compromises meta-analyses of educational research.
title_sort neglect of publication bias compromises meta-analyses of educational research.
publisher Public Library of Science (PLoS)
publishDate 2021
url https://doaj.org/article/dd44a95b262245719d9e5570992d1e61
work_keys_str_mv AT ivanropovik neglectofpublicationbiascompromisesmetaanalysesofeducationalresearch
AT matusadamkovic neglectofpublicationbiascompromisesmetaanalysesofeducationalresearch
AT davidgreger neglectofpublicationbiascompromisesmetaanalysesofeducationalresearch
_version_ 1718375632611573760