Consensus-based guidance for conducting and reporting multi-analyst studies
Any large dataset can be analyzed in a number of ways, and it is possible that the use of different analysis strategies will lead to different results and conclusions. One way to assess whether the results obtained depend on the analysis strategy chosen is to employ multiple analysts and leave each...
Guardado en:
| Autores principales: | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Formato: | article |
| Lenguaje: | EN |
| Publicado: |
eLife Sciences Publications Ltd
2021
|
| Materias: | |
| Acceso en línea: | https://doaj.org/article/2f33a9be099441798c65209457b94d1c |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| id |
oai:doaj.org-article:2f33a9be099441798c65209457b94d1c |
|---|---|
| record_format |
dspace |
| spelling |
oai:doaj.org-article:2f33a9be099441798c65209457b94d1c2021-11-26T11:03:35ZConsensus-based guidance for conducting and reporting multi-analyst studies10.7554/eLife.721852050-084Xe72185https://doaj.org/article/2f33a9be099441798c65209457b94d1c2021-11-01T00:00:00Zhttps://elifesciences.org/articles/72185https://doaj.org/toc/2050-084XAny large dataset can be analyzed in a number of ways, and it is possible that the use of different analysis strategies will lead to different results and conclusions. One way to assess whether the results obtained depend on the analysis strategy chosen is to employ multiple analysts and leave each of them free to follow their own approach. Here, we present consensus-based guidance for conducting and reporting such multi-analyst studies, and we discuss how broader adoption of the multi-analyst approach has the potential to strengthen the robustness of results and conclusions obtained from analyses of datasets in basic and applied research.Balazs AczelBarnabas SzasziGustav NilsonneOlmo R van den AkkerCasper J AlbersMarcel ALM van AssenJojanneke A BastiaansenDaniel BenjaminUdo BoehmRotem Botvinik-NezerLaura F BringmannNiko A BuschEmmanuel CaruyerAndrea M CataldoNelson CowanAndrew DeliosNoah NN van DongenChris DonkinJohnny B van DoornAnna DreberGilles DutilhGary F EganMorton Ann GernsbacherRink HoekstraSabine HoffmannFelix HolzmeisterJuergen HuberMagnus JohannessonKai J JonasAlexander T KindelMichael KirchlerYoram K KunkelsD Stephen LindsayJean-Francois ManginDora MatzkeMarcus R MunafòBen R NewellBrian A NosekRussell A PoldrackDon van RavenzwaaijJörg RieskampMatthew J SalganikAlexandra SarafoglouTom SchonbergMartin SchweinsbergDavid ShanksRaphael SilberzahnDaniel J SimonsBarbara A SpellmanSamuel St-JeanJeffrey J StarnsEric Luis UhlmannJelte WichertsEric-Jan WagenmakerseLife Sciences Publications Ltdarticlemulti-analystmetasciencestatistical practicescience forumexpert consensusanalytical variabilityMedicineRScienceQBiology (General)QH301-705.5ENeLife, Vol 10 (2021) |
| institution |
DOAJ |
| collection |
DOAJ |
| language |
EN |
| topic |
multi-analyst metascience statistical practice science forum expert consensus analytical variability Medicine R Science Q Biology (General) QH301-705.5 |
| spellingShingle |
multi-analyst metascience statistical practice science forum expert consensus analytical variability Medicine R Science Q Biology (General) QH301-705.5 Balazs Aczel Barnabas Szaszi Gustav Nilsonne Olmo R van den Akker Casper J Albers Marcel ALM van Assen Jojanneke A Bastiaansen Daniel Benjamin Udo Boehm Rotem Botvinik-Nezer Laura F Bringmann Niko A Busch Emmanuel Caruyer Andrea M Cataldo Nelson Cowan Andrew Delios Noah NN van Dongen Chris Donkin Johnny B van Doorn Anna Dreber Gilles Dutilh Gary F Egan Morton Ann Gernsbacher Rink Hoekstra Sabine Hoffmann Felix Holzmeister Juergen Huber Magnus Johannesson Kai J Jonas Alexander T Kindel Michael Kirchler Yoram K Kunkels D Stephen Lindsay Jean-Francois Mangin Dora Matzke Marcus R Munafò Ben R Newell Brian A Nosek Russell A Poldrack Don van Ravenzwaaij Jörg Rieskamp Matthew J Salganik Alexandra Sarafoglou Tom Schonberg Martin Schweinsberg David Shanks Raphael Silberzahn Daniel J Simons Barbara A Spellman Samuel St-Jean Jeffrey J Starns Eric Luis Uhlmann Jelte Wicherts Eric-Jan Wagenmakers Consensus-based guidance for conducting and reporting multi-analyst studies |
| description |
Any large dataset can be analyzed in a number of ways, and it is possible that the use of different analysis strategies will lead to different results and conclusions. One way to assess whether the results obtained depend on the analysis strategy chosen is to employ multiple analysts and leave each of them free to follow their own approach. Here, we present consensus-based guidance for conducting and reporting such multi-analyst studies, and we discuss how broader adoption of the multi-analyst approach has the potential to strengthen the robustness of results and conclusions obtained from analyses of datasets in basic and applied research. |
| format |
article |
| author |
Balazs Aczel Barnabas Szaszi Gustav Nilsonne Olmo R van den Akker Casper J Albers Marcel ALM van Assen Jojanneke A Bastiaansen Daniel Benjamin Udo Boehm Rotem Botvinik-Nezer Laura F Bringmann Niko A Busch Emmanuel Caruyer Andrea M Cataldo Nelson Cowan Andrew Delios Noah NN van Dongen Chris Donkin Johnny B van Doorn Anna Dreber Gilles Dutilh Gary F Egan Morton Ann Gernsbacher Rink Hoekstra Sabine Hoffmann Felix Holzmeister Juergen Huber Magnus Johannesson Kai J Jonas Alexander T Kindel Michael Kirchler Yoram K Kunkels D Stephen Lindsay Jean-Francois Mangin Dora Matzke Marcus R Munafò Ben R Newell Brian A Nosek Russell A Poldrack Don van Ravenzwaaij Jörg Rieskamp Matthew J Salganik Alexandra Sarafoglou Tom Schonberg Martin Schweinsberg David Shanks Raphael Silberzahn Daniel J Simons Barbara A Spellman Samuel St-Jean Jeffrey J Starns Eric Luis Uhlmann Jelte Wicherts Eric-Jan Wagenmakers |
| author_facet |
Balazs Aczel Barnabas Szaszi Gustav Nilsonne Olmo R van den Akker Casper J Albers Marcel ALM van Assen Jojanneke A Bastiaansen Daniel Benjamin Udo Boehm Rotem Botvinik-Nezer Laura F Bringmann Niko A Busch Emmanuel Caruyer Andrea M Cataldo Nelson Cowan Andrew Delios Noah NN van Dongen Chris Donkin Johnny B van Doorn Anna Dreber Gilles Dutilh Gary F Egan Morton Ann Gernsbacher Rink Hoekstra Sabine Hoffmann Felix Holzmeister Juergen Huber Magnus Johannesson Kai J Jonas Alexander T Kindel Michael Kirchler Yoram K Kunkels D Stephen Lindsay Jean-Francois Mangin Dora Matzke Marcus R Munafò Ben R Newell Brian A Nosek Russell A Poldrack Don van Ravenzwaaij Jörg Rieskamp Matthew J Salganik Alexandra Sarafoglou Tom Schonberg Martin Schweinsberg David Shanks Raphael Silberzahn Daniel J Simons Barbara A Spellman Samuel St-Jean Jeffrey J Starns Eric Luis Uhlmann Jelte Wicherts Eric-Jan Wagenmakers |
| author_sort |
Balazs Aczel |
| title |
Consensus-based guidance for conducting and reporting multi-analyst studies |
| title_short |
Consensus-based guidance for conducting and reporting multi-analyst studies |
| title_full |
Consensus-based guidance for conducting and reporting multi-analyst studies |
| title_fullStr |
Consensus-based guidance for conducting and reporting multi-analyst studies |
| title_full_unstemmed |
Consensus-based guidance for conducting and reporting multi-analyst studies |
| title_sort |
consensus-based guidance for conducting and reporting multi-analyst studies |
| publisher |
eLife Sciences Publications Ltd |
| publishDate |
2021 |
| url |
https://doaj.org/article/2f33a9be099441798c65209457b94d1c |
| work_keys_str_mv |
AT balazsaczel consensusbasedguidanceforconductingandreportingmultianalyststudies AT barnabasszaszi consensusbasedguidanceforconductingandreportingmultianalyststudies AT gustavnilsonne consensusbasedguidanceforconductingandreportingmultianalyststudies AT olmorvandenakker consensusbasedguidanceforconductingandreportingmultianalyststudies AT casperjalbers consensusbasedguidanceforconductingandreportingmultianalyststudies AT marcelalmvanassen consensusbasedguidanceforconductingandreportingmultianalyststudies AT jojannekeabastiaansen consensusbasedguidanceforconductingandreportingmultianalyststudies AT danielbenjamin consensusbasedguidanceforconductingandreportingmultianalyststudies AT udoboehm consensusbasedguidanceforconductingandreportingmultianalyststudies AT rotembotviniknezer consensusbasedguidanceforconductingandreportingmultianalyststudies AT laurafbringmann consensusbasedguidanceforconductingandreportingmultianalyststudies AT nikoabusch consensusbasedguidanceforconductingandreportingmultianalyststudies AT emmanuelcaruyer consensusbasedguidanceforconductingandreportingmultianalyststudies AT andreamcataldo consensusbasedguidanceforconductingandreportingmultianalyststudies AT nelsoncowan consensusbasedguidanceforconductingandreportingmultianalyststudies AT andrewdelios consensusbasedguidanceforconductingandreportingmultianalyststudies AT noahnnvandongen consensusbasedguidanceforconductingandreportingmultianalyststudies AT chrisdonkin consensusbasedguidanceforconductingandreportingmultianalyststudies AT johnnybvandoorn consensusbasedguidanceforconductingandreportingmultianalyststudies AT annadreber consensusbasedguidanceforconductingandreportingmultianalyststudies AT gillesdutilh consensusbasedguidanceforconductingandreportingmultianalyststudies AT garyfegan consensusbasedguidanceforconductingandreportingmultianalyststudies AT mortonanngernsbacher consensusbasedguidanceforconductingandreportingmultianalyststudies AT rinkhoekstra consensusbasedguidanceforconductingandreportingmultianalyststudies AT sabinehoffmann consensusbasedguidanceforconductingandreportingmultianalyststudies AT felixholzmeister consensusbasedguidanceforconductingandreportingmultianalyststudies AT juergenhuber consensusbasedguidanceforconductingandreportingmultianalyststudies AT magnusjohannesson consensusbasedguidanceforconductingandreportingmultianalyststudies AT kaijjonas consensusbasedguidanceforconductingandreportingmultianalyststudies AT alexandertkindel consensusbasedguidanceforconductingandreportingmultianalyststudies AT michaelkirchler consensusbasedguidanceforconductingandreportingmultianalyststudies AT yoramkkunkels consensusbasedguidanceforconductingandreportingmultianalyststudies AT dstephenlindsay consensusbasedguidanceforconductingandreportingmultianalyststudies AT jeanfrancoismangin consensusbasedguidanceforconductingandreportingmultianalyststudies AT doramatzke consensusbasedguidanceforconductingandreportingmultianalyststudies AT marcusrmunafo consensusbasedguidanceforconductingandreportingmultianalyststudies AT benrnewell consensusbasedguidanceforconductingandreportingmultianalyststudies AT briananosek consensusbasedguidanceforconductingandreportingmultianalyststudies AT russellapoldrack consensusbasedguidanceforconductingandreportingmultianalyststudies AT donvanravenzwaaij consensusbasedguidanceforconductingandreportingmultianalyststudies AT jorgrieskamp consensusbasedguidanceforconductingandreportingmultianalyststudies AT matthewjsalganik consensusbasedguidanceforconductingandreportingmultianalyststudies AT alexandrasarafoglou consensusbasedguidanceforconductingandreportingmultianalyststudies AT tomschonberg consensusbasedguidanceforconductingandreportingmultianalyststudies AT martinschweinsberg consensusbasedguidanceforconductingandreportingmultianalyststudies AT davidshanks consensusbasedguidanceforconductingandreportingmultianalyststudies AT raphaelsilberzahn consensusbasedguidanceforconductingandreportingmultianalyststudies AT danieljsimons consensusbasedguidanceforconductingandreportingmultianalyststudies AT barbaraaspellman consensusbasedguidanceforconductingandreportingmultianalyststudies AT samuelstjean consensusbasedguidanceforconductingandreportingmultianalyststudies AT jeffreyjstarns consensusbasedguidanceforconductingandreportingmultianalyststudies AT ericluisuhlmann consensusbasedguidanceforconductingandreportingmultianalyststudies AT jeltewicherts consensusbasedguidanceforconductingandreportingmultianalyststudies AT ericjanwagenmakers consensusbasedguidanceforconductingandreportingmultianalyststudies |
| _version_ |
1718409526573531136 |