Does assessment type matter? A measurement invariance analysis of online and paper and pencil assessment of the Community Assessment of Psychic Experiences (CAPE).

<h4>Background</h4>The psychometric properties of an online test are not necessarily identical to its paper and pencil original. The aim of this study is to test whether the factor structure of the Community Assessment of Psychic Experiences (CAPE) is measurement invariant with respect t...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Marloes Vleeschouwer, Chris D Schubart, Cecile Henquet, Inez Myin-Germeys, Willemijn A van Gastel, Manon H J Hillegers, Jim J van Os, Marco P M Boks, Eske M Derks
Formato:	article
Lenguaje:	EN
Publicado:	Public Library of Science (PLoS) 2014
Materias:	Medicine R Science Q
Acceso en línea:	https://doaj.org/article/a7162d00327f4755bfe0439990fece97
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:a7162d00327f4755bfe0439990fece97
record_format	dspace
spelling	oai:doaj.org-article:a7162d00327f4755bfe0439990fece972021-11-18T08:36:40ZDoes assessment type matter? A measurement invariance analysis of online and paper and pencil assessment of the Community Assessment of Psychic Experiences (CAPE).1932-620310.1371/journal.pone.0084011https://doaj.org/article/a7162d00327f4755bfe0439990fece972014-01-01T00:00:00Zhttps://www.ncbi.nlm.nih.gov/pmc/articles/pmid/24465389/pdf/?tool=EBIhttps://doaj.org/toc/1932-6203<h4>Background</h4>The psychometric properties of an online test are not necessarily identical to its paper and pencil original. The aim of this study is to test whether the factor structure of the Community Assessment of Psychic Experiences (CAPE) is measurement invariant with respect to online vs. paper and pencil assessment.<h4>Method</h4>The factor structure of CAPE items assessed by paper and pencil (N = 796) was compared with the factor structure of CAPE items assessed by the Internet (N = 21,590) using formal tests for Measurement Invariance (MI). The effect size was calculated by estimating the Signed Item Difference in the Sample (SIDS) index and the Signed Test Difference in the Sample (STDS) for a hypothetical subject who scores 2 standard deviations above average on the latent dimensions.<h4>Results</h4>The more restricted Metric Invariance model showed a significantly worse fit compared to the less restricted Configural Invariance model (χ(2)(23) = 152.75, p<0.001). However, the SIDS indices appear to be small, with an average of -0.11. A STDS of -4.80 indicates that Internet sample members who score 2 standard deviations above average would be expected to score 4.80 points lower on the CAPE total scale (ranging from 42 to 114 points) than would members of the Paper sample with the same latent trait score.<h4>Conclusions</h4>Our findings did not support measurement invariance with respect to assessment method. Because of the small effect sizes, the measurement differences between the online assessed CAPE and its paper and pencil original can be neglected without major consequences for research purposes. However, a person with a high vulnerability for psychotic symptoms would score 4.80 points lower on the total scale if the CAPE is assessed online compared to paper and pencil assessment. Therefore, for clinical purposes, one should be cautious with online assessment of the CAPE.Marloes VleeschouwerChris D SchubartCecile HenquetInez Myin-GermeysWillemijn A van GastelManon H J HillegersJim J van OsMarco P M BoksEske M DerksPublic Library of Science (PLoS)articleMedicineRScienceQENPLoS ONE, Vol 9, Iss 1, p e84011 (2014)
institution	DOAJ
collection	DOAJ
language	EN
topic	Medicine R Science Q
spellingShingle	Medicine R Science Q Marloes Vleeschouwer Chris D Schubart Cecile Henquet Inez Myin-Germeys Willemijn A van Gastel Manon H J Hillegers Jim J van Os Marco P M Boks Eske M Derks Does assessment type matter? A measurement invariance analysis of online and paper and pencil assessment of the Community Assessment of Psychic Experiences (CAPE).
description	<h4>Background</h4>The psychometric properties of an online test are not necessarily identical to its paper and pencil original. The aim of this study is to test whether the factor structure of the Community Assessment of Psychic Experiences (CAPE) is measurement invariant with respect to online vs. paper and pencil assessment.<h4>Method</h4>The factor structure of CAPE items assessed by paper and pencil (N = 796) was compared with the factor structure of CAPE items assessed by the Internet (N = 21,590) using formal tests for Measurement Invariance (MI). The effect size was calculated by estimating the Signed Item Difference in the Sample (SIDS) index and the Signed Test Difference in the Sample (STDS) for a hypothetical subject who scores 2 standard deviations above average on the latent dimensions.<h4>Results</h4>The more restricted Metric Invariance model showed a significantly worse fit compared to the less restricted Configural Invariance model (χ(2)(23) = 152.75, p<0.001). However, the SIDS indices appear to be small, with an average of -0.11. A STDS of -4.80 indicates that Internet sample members who score 2 standard deviations above average would be expected to score 4.80 points lower on the CAPE total scale (ranging from 42 to 114 points) than would members of the Paper sample with the same latent trait score.<h4>Conclusions</h4>Our findings did not support measurement invariance with respect to assessment method. Because of the small effect sizes, the measurement differences between the online assessed CAPE and its paper and pencil original can be neglected without major consequences for research purposes. However, a person with a high vulnerability for psychotic symptoms would score 4.80 points lower on the total scale if the CAPE is assessed online compared to paper and pencil assessment. Therefore, for clinical purposes, one should be cautious with online assessment of the CAPE.
format	article
author	Marloes Vleeschouwer Chris D Schubart Cecile Henquet Inez Myin-Germeys Willemijn A van Gastel Manon H J Hillegers Jim J van Os Marco P M Boks Eske M Derks
author_facet	Marloes Vleeschouwer Chris D Schubart Cecile Henquet Inez Myin-Germeys Willemijn A van Gastel Manon H J Hillegers Jim J van Os Marco P M Boks Eske M Derks
author_sort	Marloes Vleeschouwer
title	Does assessment type matter? A measurement invariance analysis of online and paper and pencil assessment of the Community Assessment of Psychic Experiences (CAPE).
title_short	Does assessment type matter? A measurement invariance analysis of online and paper and pencil assessment of the Community Assessment of Psychic Experiences (CAPE).
title_full	Does assessment type matter? A measurement invariance analysis of online and paper and pencil assessment of the Community Assessment of Psychic Experiences (CAPE).
title_fullStr	Does assessment type matter? A measurement invariance analysis of online and paper and pencil assessment of the Community Assessment of Psychic Experiences (CAPE).
title_full_unstemmed	Does assessment type matter? A measurement invariance analysis of online and paper and pencil assessment of the Community Assessment of Psychic Experiences (CAPE).
title_sort	does assessment type matter? a measurement invariance analysis of online and paper and pencil assessment of the community assessment of psychic experiences (cape).
publisher	Public Library of Science (PLoS)
publishDate	2014
url	https://doaj.org/article/a7162d00327f4755bfe0439990fece97
work_keys_str_mv	AT marloesvleeschouwer doesassessmenttypematterameasurementinvarianceanalysisofonlineandpaperandpencilassessmentofthecommunityassessmentofpsychicexperiencescape AT chrisdschubart doesassessmenttypematterameasurementinvarianceanalysisofonlineandpaperandpencilassessmentofthecommunityassessmentofpsychicexperiencescape AT cecilehenquet doesassessmenttypematterameasurementinvarianceanalysisofonlineandpaperandpencilassessmentofthecommunityassessmentofpsychicexperiencescape AT inezmyingermeys doesassessmenttypematterameasurementinvarianceanalysisofonlineandpaperandpencilassessmentofthecommunityassessmentofpsychicexperiencescape AT willemijnavangastel doesassessmenttypematterameasurementinvarianceanalysisofonlineandpaperandpencilassessmentofthecommunityassessmentofpsychicexperiencescape AT manonhjhillegers doesassessmenttypematterameasurementinvarianceanalysisofonlineandpaperandpencilassessmentofthecommunityassessmentofpsychicexperiencescape AT jimjvanos doesassessmenttypematterameasurementinvarianceanalysisofonlineandpaperandpencilassessmentofthecommunityassessmentofpsychicexperiencescape AT marcopmboks doesassessmenttypematterameasurementinvarianceanalysisofonlineandpaperandpencilassessmentofthecommunityassessmentofpsychicexperiencescape AT eskemderks doesassessmenttypematterameasurementinvarianceanalysisofonlineandpaperandpencilassessmentofthecommunityassessmentofpsychicexperiencescape
_version_	1718421579232182272

Does assessment type matter? A measurement invariance analysis of online and paper and pencil assessment of the Community Assessment of Psychic Experiences (CAPE).

Ejemplares similares