Meta-analyses of adverse effects data derived from randomised controlled trials as compared to observational studies: methodological overview.

<h4>Background</h4>There is considerable debate as to the relative merits of using randomised controlled trial (RCT) data as opposed to observational data in systematic reviews of adverse effects. This meta-analysis of meta-analyses aimed to assess the level of agreement or disagreement...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Su Golder, Yoon K Loke, Martin Bland
Formato: article
Lenguaje:EN
Publicado: Public Library of Science (PLoS) 2011
Materias:
R
Acceso en línea:https://doaj.org/article/f5162d59cd6f4b9da41912304cf2f135
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:f5162d59cd6f4b9da41912304cf2f135
record_format dspace
spelling oai:doaj.org-article:f5162d59cd6f4b9da41912304cf2f1352021-11-18T05:41:50ZMeta-analyses of adverse effects data derived from randomised controlled trials as compared to observational studies: methodological overview.1549-12771549-167610.1371/journal.pmed.1001026https://doaj.org/article/f5162d59cd6f4b9da41912304cf2f1352011-05-01T00:00:00Zhttps://www.ncbi.nlm.nih.gov/pmc/articles/pmid/21559325/pdf/?tool=EBIhttps://doaj.org/toc/1549-1277https://doaj.org/toc/1549-1676<h4>Background</h4>There is considerable debate as to the relative merits of using randomised controlled trial (RCT) data as opposed to observational data in systematic reviews of adverse effects. This meta-analysis of meta-analyses aimed to assess the level of agreement or disagreement in the estimates of harm derived from meta-analysis of RCTs as compared to meta-analysis of observational studies.<h4>Methods and findings</h4>Searches were carried out in ten databases in addition to reference checking, contacting experts, citation searches, and hand-searching key journals, conference proceedings, and Web sites. Studies were included where a pooled relative measure of an adverse effect (odds ratio or risk ratio) from RCTs could be directly compared, using the ratio of odds ratios, with the pooled estimate for the same adverse effect arising from observational studies. Nineteen studies, yielding 58 meta-analyses, were identified for inclusion. The pooled ratio of odds ratios of RCTs compared to observational studies was estimated to be 1.03 (95% confidence interval 0.93-1.15). There was less discrepancy with larger studies. The symmetric funnel plot suggests that there is no consistent difference between risk estimates from meta-analysis of RCT data and those from meta-analysis of observational studies. In almost all instances, the estimates of harm from meta-analyses of the different study designs had 95% confidence intervals that overlapped (54/58, 93%). In terms of statistical significance, in nearly two-thirds (37/58, 64%), the results agreed (both studies showing a significant increase or significant decrease or both showing no significant difference). In only one meta-analysis about one adverse effect was there opposing statistical significance.<h4>Conclusions</h4>Empirical evidence from this overview indicates that there is no difference on average in the risk estimate of adverse effects of an intervention derived from meta-analyses of RCTs and meta-analyses of observational studies. This suggests that systematic reviews of adverse effects should not be restricted to specific study types. Please see later in the article for the Editors' Summary.Su GolderYoon K LokeMartin BlandPublic Library of Science (PLoS)articleMedicineRENPLoS Medicine, Vol 8, Iss 5, p e1001026 (2011)
institution DOAJ
collection DOAJ
language EN
topic Medicine
R
spellingShingle Medicine
R
Su Golder
Yoon K Loke
Martin Bland
Meta-analyses of adverse effects data derived from randomised controlled trials as compared to observational studies: methodological overview.
description <h4>Background</h4>There is considerable debate as to the relative merits of using randomised controlled trial (RCT) data as opposed to observational data in systematic reviews of adverse effects. This meta-analysis of meta-analyses aimed to assess the level of agreement or disagreement in the estimates of harm derived from meta-analysis of RCTs as compared to meta-analysis of observational studies.<h4>Methods and findings</h4>Searches were carried out in ten databases in addition to reference checking, contacting experts, citation searches, and hand-searching key journals, conference proceedings, and Web sites. Studies were included where a pooled relative measure of an adverse effect (odds ratio or risk ratio) from RCTs could be directly compared, using the ratio of odds ratios, with the pooled estimate for the same adverse effect arising from observational studies. Nineteen studies, yielding 58 meta-analyses, were identified for inclusion. The pooled ratio of odds ratios of RCTs compared to observational studies was estimated to be 1.03 (95% confidence interval 0.93-1.15). There was less discrepancy with larger studies. The symmetric funnel plot suggests that there is no consistent difference between risk estimates from meta-analysis of RCT data and those from meta-analysis of observational studies. In almost all instances, the estimates of harm from meta-analyses of the different study designs had 95% confidence intervals that overlapped (54/58, 93%). In terms of statistical significance, in nearly two-thirds (37/58, 64%), the results agreed (both studies showing a significant increase or significant decrease or both showing no significant difference). In only one meta-analysis about one adverse effect was there opposing statistical significance.<h4>Conclusions</h4>Empirical evidence from this overview indicates that there is no difference on average in the risk estimate of adverse effects of an intervention derived from meta-analyses of RCTs and meta-analyses of observational studies. This suggests that systematic reviews of adverse effects should not be restricted to specific study types. Please see later in the article for the Editors' Summary.
format article
author Su Golder
Yoon K Loke
Martin Bland
author_facet Su Golder
Yoon K Loke
Martin Bland
author_sort Su Golder
title Meta-analyses of adverse effects data derived from randomised controlled trials as compared to observational studies: methodological overview.
title_short Meta-analyses of adverse effects data derived from randomised controlled trials as compared to observational studies: methodological overview.
title_full Meta-analyses of adverse effects data derived from randomised controlled trials as compared to observational studies: methodological overview.
title_fullStr Meta-analyses of adverse effects data derived from randomised controlled trials as compared to observational studies: methodological overview.
title_full_unstemmed Meta-analyses of adverse effects data derived from randomised controlled trials as compared to observational studies: methodological overview.
title_sort meta-analyses of adverse effects data derived from randomised controlled trials as compared to observational studies: methodological overview.
publisher Public Library of Science (PLoS)
publishDate 2011
url https://doaj.org/article/f5162d59cd6f4b9da41912304cf2f135
work_keys_str_mv AT sugolder metaanalysesofadverseeffectsdataderivedfromrandomisedcontrolledtrialsascomparedtoobservationalstudiesmethodologicaloverview
AT yoonkloke metaanalysesofadverseeffectsdataderivedfromrandomisedcontrolledtrialsascomparedtoobservationalstudiesmethodologicaloverview
AT martinbland metaanalysesofadverseeffectsdataderivedfromrandomisedcontrolledtrialsascomparedtoobservationalstudiesmethodologicaloverview
_version_ 1718424888740413440