The Use of Questionable Research Practices to Survive in Academia Examined With Expert Elicitation, Prior-Data Conflicts, Bayes Factors for Replication Effects, and the Bayes Truth Serum

The popularity and use of Bayesian methods have increased across many research domains. The current article demonstrates how some less familiar Bayesian methods can be used. Specifically, we applied expert elicitation, testing for prior-data conflicts, the Bayesian Truth Serum, and testing for repli...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Rens van de Schoot, Sonja D. Winter, Elian Griffioen, Stephan Grimmelikhuijsen, Ingrid Arts, Duco Veen, Elizabeth M. Grandfield, Lars G. Tummers
Formato:	article
Lenguaje:	EN
Publicado:	Frontiers Media S.A. 2021
Materias:	informative prior Bayes truth serum expert elicitation replication study questionable research practices Ph.D. students Psychology BF1-990
Acceso en línea:	https://doaj.org/article/06bf6b517288460a95623f011a16f8a5
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:06bf6b517288460a95623f011a16f8a5
record_format	dspace
spelling	oai:doaj.org-article:06bf6b517288460a95623f011a16f8a52021-12-01T13:42:33ZThe Use of Questionable Research Practices to Survive in Academia Examined With Expert Elicitation, Prior-Data Conflicts, Bayes Factors for Replication Effects, and the Bayes Truth Serum1664-107810.3389/fpsyg.2021.621547https://doaj.org/article/06bf6b517288460a95623f011a16f8a52021-11-01T00:00:00Zhttps://www.frontiersin.org/articles/10.3389/fpsyg.2021.621547/fullhttps://doaj.org/toc/1664-1078The popularity and use of Bayesian methods have increased across many research domains. The current article demonstrates how some less familiar Bayesian methods can be used. Specifically, we applied expert elicitation, testing for prior-data conflicts, the Bayesian Truth Serum, and testing for replication effects via Bayes Factors in a series of four studies investigating the use of questionable research practices (QRPs). Scientifically fraudulent or unethical research practices have caused quite a stir in academia and beyond. Improving science starts with educating Ph.D. candidates: the scholars of tomorrow. In four studies concerning 765 Ph.D. candidates, we investigate whether Ph.D. candidates can differentiate between ethical and unethical or even fraudulent research practices. We probed the Ph.D.s’ willingness to publish research from such practices and tested whether this is influenced by (un)ethical behavior pressure from supervisors or peers. Furthermore, 36 academic leaders (deans, vice-deans, and heads of research) were interviewed and asked to predict what Ph.D.s would answer for different vignettes. Our study shows, and replicates, that some Ph.D. candidates are willing to publish results deriving from even blatant fraudulent behavior–data fabrication. Additionally, some academic leaders underestimated this behavior, which is alarming. Academic leaders have to keep in mind that Ph.D. candidates can be under more pressure than they realize and might be susceptible to using QRPs. As an inspiring example and to encourage others to make their Bayesian work reproducible, we published data, annotated scripts, and detailed output on the Open Science Framework (OSF).Rens van de SchootRens van de SchootSonja D. WinterElian GriffioenStephan GrimmelikhuijsenIngrid ArtsDuco VeenDuco VeenElizabeth M. GrandfieldLars G. TummersFrontiers Media S.A.articleinformative priorBayes truth serumexpert elicitationreplication studyquestionable research practicesPh.D. studentsPsychologyBF1-990ENFrontiers in Psychology, Vol 12 (2021)
institution	DOAJ
collection	DOAJ
language	EN
topic	informative prior Bayes truth serum expert elicitation replication study questionable research practices Ph.D. students Psychology BF1-990
spellingShingle	informative prior Bayes truth serum expert elicitation replication study questionable research practices Ph.D. students Psychology BF1-990 Rens van de Schoot Rens van de Schoot Sonja D. Winter Elian Griffioen Stephan Grimmelikhuijsen Ingrid Arts Duco Veen Duco Veen Elizabeth M. Grandfield Lars G. Tummers The Use of Questionable Research Practices to Survive in Academia Examined With Expert Elicitation, Prior-Data Conflicts, Bayes Factors for Replication Effects, and the Bayes Truth Serum
description	The popularity and use of Bayesian methods have increased across many research domains. The current article demonstrates how some less familiar Bayesian methods can be used. Specifically, we applied expert elicitation, testing for prior-data conflicts, the Bayesian Truth Serum, and testing for replication effects via Bayes Factors in a series of four studies investigating the use of questionable research practices (QRPs). Scientifically fraudulent or unethical research practices have caused quite a stir in academia and beyond. Improving science starts with educating Ph.D. candidates: the scholars of tomorrow. In four studies concerning 765 Ph.D. candidates, we investigate whether Ph.D. candidates can differentiate between ethical and unethical or even fraudulent research practices. We probed the Ph.D.s’ willingness to publish research from such practices and tested whether this is influenced by (un)ethical behavior pressure from supervisors or peers. Furthermore, 36 academic leaders (deans, vice-deans, and heads of research) were interviewed and asked to predict what Ph.D.s would answer for different vignettes. Our study shows, and replicates, that some Ph.D. candidates are willing to publish results deriving from even blatant fraudulent behavior–data fabrication. Additionally, some academic leaders underestimated this behavior, which is alarming. Academic leaders have to keep in mind that Ph.D. candidates can be under more pressure than they realize and might be susceptible to using QRPs. As an inspiring example and to encourage others to make their Bayesian work reproducible, we published data, annotated scripts, and detailed output on the Open Science Framework (OSF).
format	article
author	Rens van de Schoot Rens van de Schoot Sonja D. Winter Elian Griffioen Stephan Grimmelikhuijsen Ingrid Arts Duco Veen Duco Veen Elizabeth M. Grandfield Lars G. Tummers
author_facet	Rens van de Schoot Rens van de Schoot Sonja D. Winter Elian Griffioen Stephan Grimmelikhuijsen Ingrid Arts Duco Veen Duco Veen Elizabeth M. Grandfield Lars G. Tummers
author_sort	Rens van de Schoot
title	The Use of Questionable Research Practices to Survive in Academia Examined With Expert Elicitation, Prior-Data Conflicts, Bayes Factors for Replication Effects, and the Bayes Truth Serum
title_short	The Use of Questionable Research Practices to Survive in Academia Examined With Expert Elicitation, Prior-Data Conflicts, Bayes Factors for Replication Effects, and the Bayes Truth Serum
title_full	The Use of Questionable Research Practices to Survive in Academia Examined With Expert Elicitation, Prior-Data Conflicts, Bayes Factors for Replication Effects, and the Bayes Truth Serum
title_fullStr	The Use of Questionable Research Practices to Survive in Academia Examined With Expert Elicitation, Prior-Data Conflicts, Bayes Factors for Replication Effects, and the Bayes Truth Serum
title_full_unstemmed	The Use of Questionable Research Practices to Survive in Academia Examined With Expert Elicitation, Prior-Data Conflicts, Bayes Factors for Replication Effects, and the Bayes Truth Serum
title_sort	use of questionable research practices to survive in academia examined with expert elicitation, prior-data conflicts, bayes factors for replication effects, and the bayes truth serum
publisher	Frontiers Media S.A.
publishDate	2021
url	https://doaj.org/article/06bf6b517288460a95623f011a16f8a5
work_keys_str_mv	AT rensvandeschoot theuseofquestionableresearchpracticestosurviveinacademiaexaminedwithexpertelicitationpriordataconflictsbayesfactorsforreplicationeffectsandthebayestruthserum AT rensvandeschoot theuseofquestionableresearchpracticestosurviveinacademiaexaminedwithexpertelicitationpriordataconflictsbayesfactorsforreplicationeffectsandthebayestruthserum AT sonjadwinter theuseofquestionableresearchpracticestosurviveinacademiaexaminedwithexpertelicitationpriordataconflictsbayesfactorsforreplicationeffectsandthebayestruthserum AT eliangriffioen theuseofquestionableresearchpracticestosurviveinacademiaexaminedwithexpertelicitationpriordataconflictsbayesfactorsforreplicationeffectsandthebayestruthserum AT stephangrimmelikhuijsen theuseofquestionableresearchpracticestosurviveinacademiaexaminedwithexpertelicitationpriordataconflictsbayesfactorsforreplicationeffectsandthebayestruthserum AT ingridarts theuseofquestionableresearchpracticestosurviveinacademiaexaminedwithexpertelicitationpriordataconflictsbayesfactorsforreplicationeffectsandthebayestruthserum AT ducoveen theuseofquestionableresearchpracticestosurviveinacademiaexaminedwithexpertelicitationpriordataconflictsbayesfactorsforreplicationeffectsandthebayestruthserum AT ducoveen theuseofquestionableresearchpracticestosurviveinacademiaexaminedwithexpertelicitationpriordataconflictsbayesfactorsforreplicationeffectsandthebayestruthserum AT elizabethmgrandfield theuseofquestionableresearchpracticestosurviveinacademiaexaminedwithexpertelicitationpriordataconflictsbayesfactorsforreplicationeffectsandthebayestruthserum AT larsgtummers theuseofquestionableresearchpracticestosurviveinacademiaexaminedwithexpertelicitationpriordataconflictsbayesfactorsforreplicationeffectsandthebayestruthserum AT rensvandeschoot useofquestionableresearchpracticestosurviveinacademiaexaminedwithexpertelicitationpriordataconflictsbayesfactorsforreplicationeffectsandthebayestruthserum AT rensvandeschoot useofquestionableresearchpracticestosurviveinacademiaexaminedwithexpertelicitationpriordataconflictsbayesfactorsforreplicationeffectsandthebayestruthserum AT sonjadwinter useofquestionableresearchpracticestosurviveinacademiaexaminedwithexpertelicitationpriordataconflictsbayesfactorsforreplicationeffectsandthebayestruthserum AT eliangriffioen useofquestionableresearchpracticestosurviveinacademiaexaminedwithexpertelicitationpriordataconflictsbayesfactorsforreplicationeffectsandthebayestruthserum AT stephangrimmelikhuijsen useofquestionableresearchpracticestosurviveinacademiaexaminedwithexpertelicitationpriordataconflictsbayesfactorsforreplicationeffectsandthebayestruthserum AT ingridarts useofquestionableresearchpracticestosurviveinacademiaexaminedwithexpertelicitationpriordataconflictsbayesfactorsforreplicationeffectsandthebayestruthserum AT ducoveen useofquestionableresearchpracticestosurviveinacademiaexaminedwithexpertelicitationpriordataconflictsbayesfactorsforreplicationeffectsandthebayestruthserum AT ducoveen useofquestionableresearchpracticestosurviveinacademiaexaminedwithexpertelicitationpriordataconflictsbayesfactorsforreplicationeffectsandthebayestruthserum AT elizabethmgrandfield useofquestionableresearchpracticestosurviveinacademiaexaminedwithexpertelicitationpriordataconflictsbayesfactorsforreplicationeffectsandthebayestruthserum AT larsgtummers useofquestionableresearchpracticestosurviveinacademiaexaminedwithexpertelicitationpriordataconflictsbayesfactorsforreplicationeffectsandthebayestruthserum
_version_	1718405097929572352

The Use of Questionable Research Practices to Survive in Academia Examined With Expert Elicitation, Prior-Data Conflicts, Bayes Factors for Replication Effects, and the Bayes Truth Serum

Ejemplares similares