Evolution of heterogeneity (I2) estimates and their 95% confidence intervals in large meta-analyses.
<h4>Background</h4>Assessment of heterogeneity is essential in systematic reviews and meta-analyses of clinical trials. The most commonly used heterogeneity measure, I(2), provides an estimate of the proportion of variability in a meta-analysis that is explained by differences between th...
Guardado en:
| Autores principales: | , , , , , , , , |
|---|---|
| Formato: | article |
| Lenguaje: | EN |
| Publicado: |
Public Library of Science (PLoS)
2012
|
| Materias: | |
| Acceso en línea: | https://doaj.org/article/2ba7b850c09a4314b90e67308aea09d3 |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| id |
oai:doaj.org-article:2ba7b850c09a4314b90e67308aea09d3 |
|---|---|
| record_format |
dspace |
| spelling |
oai:doaj.org-article:2ba7b850c09a4314b90e67308aea09d32021-11-18T07:11:14ZEvolution of heterogeneity (I2) estimates and their 95% confidence intervals in large meta-analyses.1932-620310.1371/journal.pone.0039471https://doaj.org/article/2ba7b850c09a4314b90e67308aea09d32012-01-01T00:00:00Zhttps://www.ncbi.nlm.nih.gov/pmc/articles/pmid/22848355/?tool=EBIhttps://doaj.org/toc/1932-6203<h4>Background</h4>Assessment of heterogeneity is essential in systematic reviews and meta-analyses of clinical trials. The most commonly used heterogeneity measure, I(2), provides an estimate of the proportion of variability in a meta-analysis that is explained by differences between the included trials rather than by sampling error. Recent studies have raised concerns about the reliability of I(2) estimates, due to their dependence on the precision of included trials and time-dependent biases. Authors have also advocated use of 95% confidence intervals (CIs) to express the uncertainty associated with I(2) estimates. However, no previous studies have explored how many trials and events are required to ensure stable and reliable I(2) estimates, or how 95% CIs perform as evidence accumulates.<h4>Methodology/principal findings</h4>To assess the stability and reliability of I(2) estimates and their 95% CIs, in relation to the cumulative number of trials and events in meta-analysis, we looked at 16 large Cochrane meta-analyses--each including a sufficient number of trials and events to reliably estimate I(2)--and monitored the I(2) estimates and their 95% CIs for each year of publication. In 10 of the 16 meta-analyses, the I(2) estimates fluctuated more than 40% over time. The median number of events and trials required before the cumulative I(2) estimates stayed within +/-20% of the final I(2) estimate was 467 and 11. No major fluctuations were observed after 500 events and 14 trials. The 95% confidence intervals provided good coverage over time.<h4>Conclusions/significance</h4>I(2) estimates need to be interpreted with caution when the meta-analysis only includes a limited number of events or trials. Confidence intervals for I(2) estimates provide good coverage as evidence accumulates, and are thus valuable for reflecting the uncertainty associated with estimating I(2).Kristian ThorlundGeorgina ImbergerBradley C JohnstonMichael WalshTahany AwadLehana ThabaneChristian GluudP J DevereauxJørn WetterslevPublic Library of Science (PLoS)articleMedicineRScienceQENPLoS ONE, Vol 7, Iss 7, p e39471 (2012) |
| institution |
DOAJ |
| collection |
DOAJ |
| language |
EN |
| topic |
Medicine R Science Q |
| spellingShingle |
Medicine R Science Q Kristian Thorlund Georgina Imberger Bradley C Johnston Michael Walsh Tahany Awad Lehana Thabane Christian Gluud P J Devereaux Jørn Wetterslev Evolution of heterogeneity (I2) estimates and their 95% confidence intervals in large meta-analyses. |
| description |
<h4>Background</h4>Assessment of heterogeneity is essential in systematic reviews and meta-analyses of clinical trials. The most commonly used heterogeneity measure, I(2), provides an estimate of the proportion of variability in a meta-analysis that is explained by differences between the included trials rather than by sampling error. Recent studies have raised concerns about the reliability of I(2) estimates, due to their dependence on the precision of included trials and time-dependent biases. Authors have also advocated use of 95% confidence intervals (CIs) to express the uncertainty associated with I(2) estimates. However, no previous studies have explored how many trials and events are required to ensure stable and reliable I(2) estimates, or how 95% CIs perform as evidence accumulates.<h4>Methodology/principal findings</h4>To assess the stability and reliability of I(2) estimates and their 95% CIs, in relation to the cumulative number of trials and events in meta-analysis, we looked at 16 large Cochrane meta-analyses--each including a sufficient number of trials and events to reliably estimate I(2)--and monitored the I(2) estimates and their 95% CIs for each year of publication. In 10 of the 16 meta-analyses, the I(2) estimates fluctuated more than 40% over time. The median number of events and trials required before the cumulative I(2) estimates stayed within +/-20% of the final I(2) estimate was 467 and 11. No major fluctuations were observed after 500 events and 14 trials. The 95% confidence intervals provided good coverage over time.<h4>Conclusions/significance</h4>I(2) estimates need to be interpreted with caution when the meta-analysis only includes a limited number of events or trials. Confidence intervals for I(2) estimates provide good coverage as evidence accumulates, and are thus valuable for reflecting the uncertainty associated with estimating I(2). |
| format |
article |
| author |
Kristian Thorlund Georgina Imberger Bradley C Johnston Michael Walsh Tahany Awad Lehana Thabane Christian Gluud P J Devereaux Jørn Wetterslev |
| author_facet |
Kristian Thorlund Georgina Imberger Bradley C Johnston Michael Walsh Tahany Awad Lehana Thabane Christian Gluud P J Devereaux Jørn Wetterslev |
| author_sort |
Kristian Thorlund |
| title |
Evolution of heterogeneity (I2) estimates and their 95% confidence intervals in large meta-analyses. |
| title_short |
Evolution of heterogeneity (I2) estimates and their 95% confidence intervals in large meta-analyses. |
| title_full |
Evolution of heterogeneity (I2) estimates and their 95% confidence intervals in large meta-analyses. |
| title_fullStr |
Evolution of heterogeneity (I2) estimates and their 95% confidence intervals in large meta-analyses. |
| title_full_unstemmed |
Evolution of heterogeneity (I2) estimates and their 95% confidence intervals in large meta-analyses. |
| title_sort |
evolution of heterogeneity (i2) estimates and their 95% confidence intervals in large meta-analyses. |
| publisher |
Public Library of Science (PLoS) |
| publishDate |
2012 |
| url |
https://doaj.org/article/2ba7b850c09a4314b90e67308aea09d3 |
| work_keys_str_mv |
AT kristianthorlund evolutionofheterogeneityi2estimatesandtheir95confidenceintervalsinlargemetaanalyses AT georginaimberger evolutionofheterogeneityi2estimatesandtheir95confidenceintervalsinlargemetaanalyses AT bradleycjohnston evolutionofheterogeneityi2estimatesandtheir95confidenceintervalsinlargemetaanalyses AT michaelwalsh evolutionofheterogeneityi2estimatesandtheir95confidenceintervalsinlargemetaanalyses AT tahanyawad evolutionofheterogeneityi2estimatesandtheir95confidenceintervalsinlargemetaanalyses AT lehanathabane evolutionofheterogeneityi2estimatesandtheir95confidenceintervalsinlargemetaanalyses AT christiangluud evolutionofheterogeneityi2estimatesandtheir95confidenceintervalsinlargemetaanalyses AT pjdevereaux evolutionofheterogeneityi2estimatesandtheir95confidenceintervalsinlargemetaanalyses AT jørnwetterslev evolutionofheterogeneityi2estimatesandtheir95confidenceintervalsinlargemetaanalyses |
| _version_ |
1718423778213494784 |