A Motivational-Developmental Free Response Assessment Through a Bifactor Lens

The Motivational-Developmental Assessment (MDA) measures a university student’s motivational and developmental attributes by utilizing overlapping constructs measured across four writing prompts. The MDA’s format may lead to the violation of the local item independence (LII) assumption for unidimens...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	David Alpizar, Brian F. French
Formato:	article
Lenguaje:	EN
Publicado:	Frontiers Media S.A. 2021
Materias:	local item dependence restricted bifactor testlet method effect factor analysis Psychology BF1-990
Acceso en línea:	https://doaj.org/article/2fcc755b805a4f6d8643a4a92645342e
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:2fcc755b805a4f6d8643a4a92645342e
record_format	dspace
spelling	oai:doaj.org-article:2fcc755b805a4f6d8643a4a92645342e2021-12-03T07:17:26ZA Motivational-Developmental Free Response Assessment Through a Bifactor Lens1664-107810.3389/fpsyg.2021.770327https://doaj.org/article/2fcc755b805a4f6d8643a4a92645342e2021-12-01T00:00:00Zhttps://www.frontiersin.org/articles/10.3389/fpsyg.2021.770327/fullhttps://doaj.org/toc/1664-1078The Motivational-Developmental Assessment (MDA) measures a university student’s motivational and developmental attributes by utilizing overlapping constructs measured across four writing prompts. The MDA’s format may lead to the violation of the local item independence (LII) assumption for unidimensional item response theory (IRT) scoring models, or the uncorrelated errors assumption for scoring models in classical test theory (CTT) due to the measurement of overlapping constructs within a prompt. This assumption violation is known as a testlet effect, which can be viewed as a method effect. The application of a unidimensional IRT or CTT model to score the MDA can result in imprecise parameter estimates when this effect is ignored. To control for this effect in the MDA responses, we first examined the presence of local dependence via a restricted bifactor model and Yen’s Q3 statistic. Second, we applied bifactor models to account for the testlet effect in the responses, as this effect is modeled as an additional latent variable in a factor model. Results support the presence of local dependence in two of the four MDA prompts, and the use of the restricted bifactor model to account for the testlet effect in the responses. Modeling the testlet effect through the restricted bifactor model supports a scoring inference in a validation argument framework. Implications are discussed.David AlpizarBrian F. FrenchFrontiers Media S.A.articlelocal item dependencerestricted bifactortestletmethod effectfactor analysisPsychologyBF1-990ENFrontiers in Psychology, Vol 12 (2021)
institution	DOAJ
collection	DOAJ
language	EN
topic	local item dependence restricted bifactor testlet method effect factor analysis Psychology BF1-990
spellingShingle	local item dependence restricted bifactor testlet method effect factor analysis Psychology BF1-990 David Alpizar Brian F. French A Motivational-Developmental Free Response Assessment Through a Bifactor Lens
description	The Motivational-Developmental Assessment (MDA) measures a university student’s motivational and developmental attributes by utilizing overlapping constructs measured across four writing prompts. The MDA’s format may lead to the violation of the local item independence (LII) assumption for unidimensional item response theory (IRT) scoring models, or the uncorrelated errors assumption for scoring models in classical test theory (CTT) due to the measurement of overlapping constructs within a prompt. This assumption violation is known as a testlet effect, which can be viewed as a method effect. The application of a unidimensional IRT or CTT model to score the MDA can result in imprecise parameter estimates when this effect is ignored. To control for this effect in the MDA responses, we first examined the presence of local dependence via a restricted bifactor model and Yen’s Q3 statistic. Second, we applied bifactor models to account for the testlet effect in the responses, as this effect is modeled as an additional latent variable in a factor model. Results support the presence of local dependence in two of the four MDA prompts, and the use of the restricted bifactor model to account for the testlet effect in the responses. Modeling the testlet effect through the restricted bifactor model supports a scoring inference in a validation argument framework. Implications are discussed.
format	article
author	David Alpizar Brian F. French
author_facet	David Alpizar Brian F. French
author_sort	David Alpizar
title	A Motivational-Developmental Free Response Assessment Through a Bifactor Lens
title_short	A Motivational-Developmental Free Response Assessment Through a Bifactor Lens
title_full	A Motivational-Developmental Free Response Assessment Through a Bifactor Lens
title_fullStr	A Motivational-Developmental Free Response Assessment Through a Bifactor Lens
title_full_unstemmed	A Motivational-Developmental Free Response Assessment Through a Bifactor Lens
title_sort	motivational-developmental free response assessment through a bifactor lens
publisher	Frontiers Media S.A.
publishDate	2021
url	https://doaj.org/article/2fcc755b805a4f6d8643a4a92645342e
work_keys_str_mv	AT davidalpizar amotivationaldevelopmentalfreeresponseassessmentthroughabifactorlens AT brianffrench amotivationaldevelopmentalfreeresponseassessmentthroughabifactorlens AT davidalpizar motivationaldevelopmentalfreeresponseassessmentthroughabifactorlens AT brianffrench motivationaldevelopmentalfreeresponseassessmentthroughabifactorlens
_version_	1718373801547268096

A Motivational-Developmental Free Response Assessment Through a Bifactor Lens

Ejemplares similares