Evaluation of jackknife and bootstrap for defining confidence intervals for pairwise agreement measures.
Several research fields frequently deal with the analysis of diverse classification results of the same entities. This should imply an objective detection of overlaps and divergences between the formed clusters. The congruence between classifications can be quantified by clustering agreement measure...
Guardado en:
Autores principales: | , , , , |
---|---|
Formato: | article |
Lenguaje: | EN |
Publicado: |
Public Library of Science (PLoS)
2011
|
Materias: | |
Acceso en línea: | https://doaj.org/article/5c93b05bf72d47a583b594db0b626a43 |
Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
id |
oai:doaj.org-article:5c93b05bf72d47a583b594db0b626a43 |
---|---|
record_format |
dspace |
spelling |
oai:doaj.org-article:5c93b05bf72d47a583b594db0b626a432021-11-18T06:53:47ZEvaluation of jackknife and bootstrap for defining confidence intervals for pairwise agreement measures.1932-620310.1371/journal.pone.0019539https://doaj.org/article/5c93b05bf72d47a583b594db0b626a432011-01-01T00:00:00Zhttps://www.ncbi.nlm.nih.gov/pmc/articles/pmid/21611165/pdf/?tool=EBIhttps://doaj.org/toc/1932-6203Several research fields frequently deal with the analysis of diverse classification results of the same entities. This should imply an objective detection of overlaps and divergences between the formed clusters. The congruence between classifications can be quantified by clustering agreement measures, including pairwise agreement measures. Several measures have been proposed and the importance of obtaining confidence intervals for the point estimate in the comparison of these measures has been highlighted. A broad range of methods can be used for the estimation of confidence intervals. However, evidence is lacking about what are the appropriate methods for the calculation of confidence intervals for most clustering agreement measures. Here we evaluate the resampling techniques of bootstrap and jackknife for the calculation of the confidence intervals for clustering agreement measures. Contrary to what has been shown for some statistics, simulations showed that the jackknife performs better than the bootstrap at accurately estimating confidence intervals for pairwise agreement measures, especially when the agreement between partitions is low. The coverage of the jackknife confidence interval is robust to changes in cluster number and cluster size distribution.Ana SeverianoJoão A CarriçoD Ashley RobinsonMário RamirezFrancisco R PintoPublic Library of Science (PLoS)articleMedicineRScienceQENPLoS ONE, Vol 6, Iss 5, p e19539 (2011) |
institution |
DOAJ |
collection |
DOAJ |
language |
EN |
topic |
Medicine R Science Q |
spellingShingle |
Medicine R Science Q Ana Severiano João A Carriço D Ashley Robinson Mário Ramirez Francisco R Pinto Evaluation of jackknife and bootstrap for defining confidence intervals for pairwise agreement measures. |
description |
Several research fields frequently deal with the analysis of diverse classification results of the same entities. This should imply an objective detection of overlaps and divergences between the formed clusters. The congruence between classifications can be quantified by clustering agreement measures, including pairwise agreement measures. Several measures have been proposed and the importance of obtaining confidence intervals for the point estimate in the comparison of these measures has been highlighted. A broad range of methods can be used for the estimation of confidence intervals. However, evidence is lacking about what are the appropriate methods for the calculation of confidence intervals for most clustering agreement measures. Here we evaluate the resampling techniques of bootstrap and jackknife for the calculation of the confidence intervals for clustering agreement measures. Contrary to what has been shown for some statistics, simulations showed that the jackknife performs better than the bootstrap at accurately estimating confidence intervals for pairwise agreement measures, especially when the agreement between partitions is low. The coverage of the jackknife confidence interval is robust to changes in cluster number and cluster size distribution. |
format |
article |
author |
Ana Severiano João A Carriço D Ashley Robinson Mário Ramirez Francisco R Pinto |
author_facet |
Ana Severiano João A Carriço D Ashley Robinson Mário Ramirez Francisco R Pinto |
author_sort |
Ana Severiano |
title |
Evaluation of jackknife and bootstrap for defining confidence intervals for pairwise agreement measures. |
title_short |
Evaluation of jackknife and bootstrap for defining confidence intervals for pairwise agreement measures. |
title_full |
Evaluation of jackknife and bootstrap for defining confidence intervals for pairwise agreement measures. |
title_fullStr |
Evaluation of jackknife and bootstrap for defining confidence intervals for pairwise agreement measures. |
title_full_unstemmed |
Evaluation of jackknife and bootstrap for defining confidence intervals for pairwise agreement measures. |
title_sort |
evaluation of jackknife and bootstrap for defining confidence intervals for pairwise agreement measures. |
publisher |
Public Library of Science (PLoS) |
publishDate |
2011 |
url |
https://doaj.org/article/5c93b05bf72d47a583b594db0b626a43 |
work_keys_str_mv |
AT anaseveriano evaluationofjackknifeandbootstrapfordefiningconfidenceintervalsforpairwiseagreementmeasures AT joaoacarrico evaluationofjackknifeandbootstrapfordefiningconfidenceintervalsforpairwiseagreementmeasures AT dashleyrobinson evaluationofjackknifeandbootstrapfordefiningconfidenceintervalsforpairwiseagreementmeasures AT marioramirez evaluationofjackknifeandbootstrapfordefiningconfidenceintervalsforpairwiseagreementmeasures AT franciscorpinto evaluationofjackknifeandbootstrapfordefiningconfidenceintervalsforpairwiseagreementmeasures |
_version_ |
1718424231329398784 |