Why rankings of biomedical image analysis competitions should be interpreted with care

Biomedical image analysis challenges have increased in the last ten years, but common practices have not been established yet. Here the authors analyze 150 recent challenges and demonstrate that outcome varies based on the metrics used and that limited information reporting hampers reproducibility.

Guardado en:

Detalles Bibliográficos
Autores principales:	Lena Maier-Hein, Matthias Eisenmann, Annika Reinke, Sinan Onogur, Marko Stankovic, Patrick Scholz, Tal Arbel, Hrvoje Bogunovic, Andrew P. Bradley, Aaron Carass, Carolin Feldmann, Alejandro F. Frangi, Peter M. Full, Bram van Ginneken, Allan Hanbury, Katrin Honauer, Michal Kozubek, Bennett A. Landman, Keno März, Oskar Maier, Klaus Maier-Hein, Bjoern H. Menze, Henning Müller, Peter F. Neher, Wiro Niessen, Nasir Rajpoot, Gregory C. Sharp, Korsuk Sirinukunwattana, Stefanie Speidel, Christian Stock, Danail Stoyanov, Abdel Aziz Taha, Fons van der Sommen, Ching-Wei Wang, Marc-André Weber, Guoyan Zheng, Pierre Jannin, Annette Kopp-Schneider
Formato:	article
Lenguaje:	EN
Publicado:	Nature Portfolio 2018
Materias:	Science Q
Acceso en línea:	https://doaj.org/article/38c338af34d545ae996e15b163f6024c
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:38c338af34d545ae996e15b163f6024c
record_format	dspace
spelling	oai:doaj.org-article:38c338af34d545ae996e15b163f6024c2021-12-02T17:33:17ZWhy rankings of biomedical image analysis competitions should be interpreted with care10.1038/s41467-018-07619-72041-1723https://doaj.org/article/38c338af34d545ae996e15b163f6024c2018-12-01T00:00:00Zhttps://doi.org/10.1038/s41467-018-07619-7https://doaj.org/toc/2041-1723Biomedical image analysis challenges have increased in the last ten years, but common practices have not been established yet. Here the authors analyze 150 recent challenges and demonstrate that outcome varies based on the metrics used and that limited information reporting hampers reproducibility.Lena Maier-HeinMatthias EisenmannAnnika ReinkeSinan OnogurMarko StankovicPatrick ScholzTal ArbelHrvoje BogunovicAndrew P. BradleyAaron CarassCarolin FeldmannAlejandro F. FrangiPeter M. FullBram van GinnekenAllan HanburyKatrin HonauerMichal KozubekBennett A. LandmanKeno MärzOskar MaierKlaus Maier-HeinBjoern H. MenzeHenning MüllerPeter F. NeherWiro NiessenNasir RajpootGregory C. SharpKorsuk SirinukunwattanaStefanie SpeidelChristian StockDanail StoyanovAbdel Aziz TahaFons van der SommenChing-Wei WangMarc-André WeberGuoyan ZhengPierre JanninAnnette Kopp-SchneiderNature PortfolioarticleScienceQENNature Communications, Vol 9, Iss 1, Pp 1-13 (2018)
institution	DOAJ
collection	DOAJ
language	EN
topic	Science Q
spellingShingle	Science Q Lena Maier-Hein Matthias Eisenmann Annika Reinke Sinan Onogur Marko Stankovic Patrick Scholz Tal Arbel Hrvoje Bogunovic Andrew P. Bradley Aaron Carass Carolin Feldmann Alejandro F. Frangi Peter M. Full Bram van Ginneken Allan Hanbury Katrin Honauer Michal Kozubek Bennett A. Landman Keno März Oskar Maier Klaus Maier-Hein Bjoern H. Menze Henning Müller Peter F. Neher Wiro Niessen Nasir Rajpoot Gregory C. Sharp Korsuk Sirinukunwattana Stefanie Speidel Christian Stock Danail Stoyanov Abdel Aziz Taha Fons van der Sommen Ching-Wei Wang Marc-André Weber Guoyan Zheng Pierre Jannin Annette Kopp-Schneider Why rankings of biomedical image analysis competitions should be interpreted with care
description	Biomedical image analysis challenges have increased in the last ten years, but common practices have not been established yet. Here the authors analyze 150 recent challenges and demonstrate that outcome varies based on the metrics used and that limited information reporting hampers reproducibility.
format	article
author	Lena Maier-Hein Matthias Eisenmann Annika Reinke Sinan Onogur Marko Stankovic Patrick Scholz Tal Arbel Hrvoje Bogunovic Andrew P. Bradley Aaron Carass Carolin Feldmann Alejandro F. Frangi Peter M. Full Bram van Ginneken Allan Hanbury Katrin Honauer Michal Kozubek Bennett A. Landman Keno März Oskar Maier Klaus Maier-Hein Bjoern H. Menze Henning Müller Peter F. Neher Wiro Niessen Nasir Rajpoot Gregory C. Sharp Korsuk Sirinukunwattana Stefanie Speidel Christian Stock Danail Stoyanov Abdel Aziz Taha Fons van der Sommen Ching-Wei Wang Marc-André Weber Guoyan Zheng Pierre Jannin Annette Kopp-Schneider
author_facet	Lena Maier-Hein Matthias Eisenmann Annika Reinke Sinan Onogur Marko Stankovic Patrick Scholz Tal Arbel Hrvoje Bogunovic Andrew P. Bradley Aaron Carass Carolin Feldmann Alejandro F. Frangi Peter M. Full Bram van Ginneken Allan Hanbury Katrin Honauer Michal Kozubek Bennett A. Landman Keno März Oskar Maier Klaus Maier-Hein Bjoern H. Menze Henning Müller Peter F. Neher Wiro Niessen Nasir Rajpoot Gregory C. Sharp Korsuk Sirinukunwattana Stefanie Speidel Christian Stock Danail Stoyanov Abdel Aziz Taha Fons van der Sommen Ching-Wei Wang Marc-André Weber Guoyan Zheng Pierre Jannin Annette Kopp-Schneider
author_sort	Lena Maier-Hein
title	Why rankings of biomedical image analysis competitions should be interpreted with care
title_short	Why rankings of biomedical image analysis competitions should be interpreted with care
title_full	Why rankings of biomedical image analysis competitions should be interpreted with care
title_fullStr	Why rankings of biomedical image analysis competitions should be interpreted with care
title_full_unstemmed	Why rankings of biomedical image analysis competitions should be interpreted with care
title_sort	why rankings of biomedical image analysis competitions should be interpreted with care
publisher	Nature Portfolio
publishDate	2018
url	https://doaj.org/article/38c338af34d545ae996e15b163f6024c
work_keys_str_mv	AT lenamaierhein whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT matthiaseisenmann whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT annikareinke whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT sinanonogur whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT markostankovic whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT patrickscholz whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT talarbel whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT hrvojebogunovic whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT andrewpbradley whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT aaroncarass whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT carolinfeldmann whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT alejandroffrangi whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT petermfull whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT bramvanginneken whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT allanhanbury whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT katrinhonauer whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT michalkozubek whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT bennettalandman whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT kenomarz whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT oskarmaier whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT klausmaierhein whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT bjoernhmenze whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT henningmuller whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT peterfneher whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT wironiessen whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT nasirrajpoot whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT gregorycsharp whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT korsuksirinukunwattana whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT stefaniespeidel whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT christianstock whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT danailstoyanov whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT abdelaziztaha whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT fonsvandersommen whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT chingweiwang whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT marcandreweber whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT guoyanzheng whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT pierrejannin whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare AT annettekoppschneider whyrankingsofbiomedicalimageanalysiscompetitionsshouldbeinterpretedwithcare
_version_	1718379993412665344

Why rankings of biomedical image analysis competitions should be interpreted with care

Ejemplares similares