autopsych: An R Shiny tool for the reproducible Rasch analysis, differential item functioning, equating, and examination of group effects.

In this paper, we present autopsych, a novel online tool that allows school assessment experts, test developers, and researchers to perform routine psychometric analyses and equating of student test data and to examine the effect of student demographic and group conditions on student test performanc...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Matthew G R Courtney, Kevin C T Chang, Bing Mei, Kane Meissel, Luke I Rowe, Laila B Issayeva
Formato:	article
Lenguaje:	EN
Publicado:	Public Library of Science (PLoS) 2021
Materias:	Medicine R Science Q
Acceso en línea:	https://doaj.org/article/c09659d560984c4481c75ddf43835a2b
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:c09659d560984c4481c75ddf43835a2b
record_format	dspace
spelling	oai:doaj.org-article:c09659d560984c4481c75ddf43835a2b2021-12-02T20:17:02Zautopsych: An R Shiny tool for the reproducible Rasch analysis, differential item functioning, equating, and examination of group effects.1932-620310.1371/journal.pone.0257682https://doaj.org/article/c09659d560984c4481c75ddf43835a2b2021-01-01T00:00:00Zhttps://doi.org/10.1371/journal.pone.0257682https://doaj.org/toc/1932-6203In this paper, we present autopsych, a novel online tool that allows school assessment experts, test developers, and researchers to perform routine psychometric analyses and equating of student test data and to examine the effect of student demographic and group conditions on student test performance. The app extends current open-source software by providing (1) extensive embedded result narration and summaries for written reports, (2) improved handling of partial credit data via customizable item-person Wright maps, (3) customizable item- and person-flagging systems, (4) item-response theory model constraints and controls, (5) many-facets Rasch analysis to examine item bias, (6) Rasch fixed item equating for mapping student ability across test forms, (7) tabbed spreadsheet outputs and immediate options for secondary data analysis, (8) customizable graphical color schemes, (9) extended ANOVA analysis for examining group differences, and (10) inter-rater reliability analyses for the verifying the consistency of rater scoring systems. We present the app's architecture and functionalities and test its performance with simulated and real-world small-, medium-, and large-scale assessment data. Implications and planned future developments are also discussed.Matthew G R CourtneyKevin C T ChangBing MeiKane MeisselLuke I RoweLaila B IssayevaPublic Library of Science (PLoS)articleMedicineRScienceQENPLoS ONE, Vol 16, Iss 10, p e0257682 (2021)
institution	DOAJ
collection	DOAJ
language	EN
topic	Medicine R Science Q
spellingShingle	Medicine R Science Q Matthew G R Courtney Kevin C T Chang Bing Mei Kane Meissel Luke I Rowe Laila B Issayeva autopsych: An R Shiny tool for the reproducible Rasch analysis, differential item functioning, equating, and examination of group effects.
description	In this paper, we present autopsych, a novel online tool that allows school assessment experts, test developers, and researchers to perform routine psychometric analyses and equating of student test data and to examine the effect of student demographic and group conditions on student test performance. The app extends current open-source software by providing (1) extensive embedded result narration and summaries for written reports, (2) improved handling of partial credit data via customizable item-person Wright maps, (3) customizable item- and person-flagging systems, (4) item-response theory model constraints and controls, (5) many-facets Rasch analysis to examine item bias, (6) Rasch fixed item equating for mapping student ability across test forms, (7) tabbed spreadsheet outputs and immediate options for secondary data analysis, (8) customizable graphical color schemes, (9) extended ANOVA analysis for examining group differences, and (10) inter-rater reliability analyses for the verifying the consistency of rater scoring systems. We present the app's architecture and functionalities and test its performance with simulated and real-world small-, medium-, and large-scale assessment data. Implications and planned future developments are also discussed.
format	article
author	Matthew G R Courtney Kevin C T Chang Bing Mei Kane Meissel Luke I Rowe Laila B Issayeva
author_facet	Matthew G R Courtney Kevin C T Chang Bing Mei Kane Meissel Luke I Rowe Laila B Issayeva
author_sort	Matthew G R Courtney
title	autopsych: An R Shiny tool for the reproducible Rasch analysis, differential item functioning, equating, and examination of group effects.
title_short	autopsych: An R Shiny tool for the reproducible Rasch analysis, differential item functioning, equating, and examination of group effects.
title_full	autopsych: An R Shiny tool for the reproducible Rasch analysis, differential item functioning, equating, and examination of group effects.
title_fullStr	autopsych: An R Shiny tool for the reproducible Rasch analysis, differential item functioning, equating, and examination of group effects.
title_full_unstemmed	autopsych: An R Shiny tool for the reproducible Rasch analysis, differential item functioning, equating, and examination of group effects.
title_sort	autopsych: an r shiny tool for the reproducible rasch analysis, differential item functioning, equating, and examination of group effects.
publisher	Public Library of Science (PLoS)
publishDate	2021
url	https://doaj.org/article/c09659d560984c4481c75ddf43835a2b
work_keys_str_mv	AT matthewgrcourtney autopsychanrshinytoolforthereproducibleraschanalysisdifferentialitemfunctioningequatingandexaminationofgroupeffects AT kevinctchang autopsychanrshinytoolforthereproducibleraschanalysisdifferentialitemfunctioningequatingandexaminationofgroupeffects AT bingmei autopsychanrshinytoolforthereproducibleraschanalysisdifferentialitemfunctioningequatingandexaminationofgroupeffects AT kanemeissel autopsychanrshinytoolforthereproducibleraschanalysisdifferentialitemfunctioningequatingandexaminationofgroupeffects AT lukeirowe autopsychanrshinytoolforthereproducibleraschanalysisdifferentialitemfunctioningequatingandexaminationofgroupeffects AT lailabissayeva autopsychanrshinytoolforthereproducibleraschanalysisdifferentialitemfunctioningequatingandexaminationofgroupeffects
_version_	1718374428599910400

autopsych: An R Shiny tool for the reproducible Rasch analysis, differential item functioning, equating, and examination of group effects.

Ejemplares similares