Test-level and Item-level Model Fit Comparison of General vs. Specific Diagnostic Classification Models: A Case of True DCM

Abstract The current study compared the model fit indices, skill mastery probabilities, and classification accuracy of six Diagnostic Classification Models (DCMs): a general model (G-DINA) against five specific models (LLM, RRUM, ACDM, DINA, and DINO). To do so, the response data to the grammar and...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Mahdieh Shafipoor, Hamdollah Ravand, Parviz Maftoon
Formato:	article
Lenguaje:	EN
Publicado:	SpringerOpen 2021
Materias:	Attribute General vs. specific diagnostic classification models Model fit Q-matrix True diagnostic classification models Language and Literature P
Acceso en línea:	https://doaj.org/article/6b5ba01703744fff8d60f94064fa3565
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:6b5ba01703744fff8d60f94064fa3565
record_format	dspace
spelling	oai:doaj.org-article:6b5ba01703744fff8d60f94064fa35652021-11-28T12:22:07ZTest-level and Item-level Model Fit Comparison of General vs. Specific Diagnostic Classification Models: A Case of True DCM10.1186/s40468-021-00148-z2229-0443https://doaj.org/article/6b5ba01703744fff8d60f94064fa35652021-11-01T00:00:00Zhttps://doi.org/10.1186/s40468-021-00148-zhttps://doaj.org/toc/2229-0443Abstract The current study compared the model fit indices, skill mastery probabilities, and classification accuracy of six Diagnostic Classification Models (DCMs): a general model (G-DINA) against five specific models (LLM, RRUM, ACDM, DINA, and DINO). To do so, the response data to the grammar and vocabulary sections of a General English Achievement Test, designed specifically for cognitive diagnostic purposes from scratch, was analyzed. The results of the test-level-model fit values obtained strong evidence in supporting the G-DINA and LLM models possessing the best model fit. In addition, the ACDM and RRUM were almost very identical to that of the G-DINA. The value indices of the DINO and DINA models were very close to each other but larger than those of the G-DINA and LLM. The model fit was also investigated at the item level, and the results revealed that model selection should be performed at the item level rather than the test level, and most of the specific models might perform well for the test. The findings of this study suggested that the relationships among the attributes of grammar and vocabulary are not ‘either-or’ compensatory or non-compensatory but a combination of both.Mahdieh ShafipoorHamdollah RavandParviz MaftoonSpringerOpenarticleAttributeGeneral vs. specific diagnostic classification modelsModel fitQ-matrixTrue diagnostic classification modelsLanguage and LiteraturePENLanguage Testing in Asia, Vol 11, Iss 1, Pp 1-20 (2021)
institution	DOAJ
collection	DOAJ
language	EN
topic	Attribute General vs. specific diagnostic classification models Model fit Q-matrix True diagnostic classification models Language and Literature P
spellingShingle	Attribute General vs. specific diagnostic classification models Model fit Q-matrix True diagnostic classification models Language and Literature P Mahdieh Shafipoor Hamdollah Ravand Parviz Maftoon Test-level and Item-level Model Fit Comparison of General vs. Specific Diagnostic Classification Models: A Case of True DCM
description	Abstract The current study compared the model fit indices, skill mastery probabilities, and classification accuracy of six Diagnostic Classification Models (DCMs): a general model (G-DINA) against five specific models (LLM, RRUM, ACDM, DINA, and DINO). To do so, the response data to the grammar and vocabulary sections of a General English Achievement Test, designed specifically for cognitive diagnostic purposes from scratch, was analyzed. The results of the test-level-model fit values obtained strong evidence in supporting the G-DINA and LLM models possessing the best model fit. In addition, the ACDM and RRUM were almost very identical to that of the G-DINA. The value indices of the DINO and DINA models were very close to each other but larger than those of the G-DINA and LLM. The model fit was also investigated at the item level, and the results revealed that model selection should be performed at the item level rather than the test level, and most of the specific models might perform well for the test. The findings of this study suggested that the relationships among the attributes of grammar and vocabulary are not ‘either-or’ compensatory or non-compensatory but a combination of both.
format	article
author	Mahdieh Shafipoor Hamdollah Ravand Parviz Maftoon
author_facet	Mahdieh Shafipoor Hamdollah Ravand Parviz Maftoon
author_sort	Mahdieh Shafipoor
title	Test-level and Item-level Model Fit Comparison of General vs. Specific Diagnostic Classification Models: A Case of True DCM
title_short	Test-level and Item-level Model Fit Comparison of General vs. Specific Diagnostic Classification Models: A Case of True DCM
title_full	Test-level and Item-level Model Fit Comparison of General vs. Specific Diagnostic Classification Models: A Case of True DCM
title_fullStr	Test-level and Item-level Model Fit Comparison of General vs. Specific Diagnostic Classification Models: A Case of True DCM
title_full_unstemmed	Test-level and Item-level Model Fit Comparison of General vs. Specific Diagnostic Classification Models: A Case of True DCM
title_sort	test-level and item-level model fit comparison of general vs. specific diagnostic classification models: a case of true dcm
publisher	SpringerOpen
publishDate	2021
url	https://doaj.org/article/6b5ba01703744fff8d60f94064fa3565
work_keys_str_mv	AT mahdiehshafipoor testlevelanditemlevelmodelfitcomparisonofgeneralvsspecificdiagnosticclassificationmodelsacaseoftruedcm AT hamdollahravand testlevelanditemlevelmodelfitcomparisonofgeneralvsspecificdiagnosticclassificationmodelsacaseoftruedcm AT parvizmaftoon testlevelanditemlevelmodelfitcomparisonofgeneralvsspecificdiagnosticclassificationmodelsacaseoftruedcm
_version_	1718408021678227456

Test-level and Item-level Model Fit Comparison of General vs. Specific Diagnostic Classification Models: A Case of True DCM

Ejemplares similares