Does It Work for Everyone? The Influence of Demographic Variables on Statistical Reliability

Recent developments have highlighted the importance of tailored health education efforts. However, little research has explored differential functioning of survey items for diverse populations. This work explores differences in statistical reliability for multiple scales across demographic groups. U...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Andrew C. Pickett, Danny Valdez, Adam E. Barry
Formato:	article
Lenguaje:	EN
Publicado:	New Prairie Press 2020
Materias:	reliability reliability generalization health behavior psychometrics diversity Special aspects of education LC8-6691 Public aspects of medicine RA1-1270
Acceso en línea:	https://doaj.org/article/b4876be366b2400bbe4c96994160c8f9
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:b4876be366b2400bbe4c96994160c8f9
record_format	dspace
spelling	oai:doaj.org-article:b4876be366b2400bbe4c96994160c8f92021-11-19T21:12:34ZDoes It Work for Everyone? The Influence of Demographic Variables on Statistical Reliability10.4148/2572-1836.10792572-1836https://doaj.org/article/b4876be366b2400bbe4c96994160c8f92020-07-01T00:00:00Zhttps://newprairiepress.org/cgi/viewcontent.cgi?article=1079&context=hbrhttps://doaj.org/toc/2572-1836Recent developments have highlighted the importance of tailored health education efforts. However, little research has explored differential functioning of survey items for diverse populations. This work explores differences in statistical reliability for multiple scales across demographic groups. Understanding such differences is important in health research, given the rapid shifts occurring in global demographics. Study data were collected from eight years of the National College Health Assessment (n = 885,084), a large-scale annual survey of U.S. university students. Meta-analytic reliability generalization was used to compare reliability of two scale measures for multiple demographic groups. In nearly all cases, there were statistically significant differences in reliability across demographic groups. Researchers should consider relative functioning of any scale employed in their work. For certain demographic groups, various scales may not be sufficiently reliable. However, this may be obfuscated in larger samples, containing large numbers of individuals for whom the scale is sufficiently reliable. We suggest a thorough subsets analysis of data to ensure uniform functioning of items prior to use. Just as health interventions should be tailored to populations of interest, so too must research methods and tools.Andrew C. PickettDanny ValdezAdam E. BarryNew Prairie Pressarticlereliabilityreliability generalizationhealth behaviorpsychometricsdiversitySpecial aspects of educationLC8-6691Public aspects of medicineRA1-1270ENHealth Behavior Research, Vol 3, Iss 2 (2020)
institution	DOAJ
collection	DOAJ
language	EN
topic	reliability reliability generalization health behavior psychometrics diversity Special aspects of education LC8-6691 Public aspects of medicine RA1-1270
spellingShingle	reliability reliability generalization health behavior psychometrics diversity Special aspects of education LC8-6691 Public aspects of medicine RA1-1270 Andrew C. Pickett Danny Valdez Adam E. Barry Does It Work for Everyone? The Influence of Demographic Variables on Statistical Reliability
description	Recent developments have highlighted the importance of tailored health education efforts. However, little research has explored differential functioning of survey items for diverse populations. This work explores differences in statistical reliability for multiple scales across demographic groups. Understanding such differences is important in health research, given the rapid shifts occurring in global demographics. Study data were collected from eight years of the National College Health Assessment (n = 885,084), a large-scale annual survey of U.S. university students. Meta-analytic reliability generalization was used to compare reliability of two scale measures for multiple demographic groups. In nearly all cases, there were statistically significant differences in reliability across demographic groups. Researchers should consider relative functioning of any scale employed in their work. For certain demographic groups, various scales may not be sufficiently reliable. However, this may be obfuscated in larger samples, containing large numbers of individuals for whom the scale is sufficiently reliable. We suggest a thorough subsets analysis of data to ensure uniform functioning of items prior to use. Just as health interventions should be tailored to populations of interest, so too must research methods and tools.
format	article
author	Andrew C. Pickett Danny Valdez Adam E. Barry
author_facet	Andrew C. Pickett Danny Valdez Adam E. Barry
author_sort	Andrew C. Pickett
title	Does It Work for Everyone? The Influence of Demographic Variables on Statistical Reliability
title_short	Does It Work for Everyone? The Influence of Demographic Variables on Statistical Reliability
title_full	Does It Work for Everyone? The Influence of Demographic Variables on Statistical Reliability
title_fullStr	Does It Work for Everyone? The Influence of Demographic Variables on Statistical Reliability
title_full_unstemmed	Does It Work for Everyone? The Influence of Demographic Variables on Statistical Reliability
title_sort	does it work for everyone? the influence of demographic variables on statistical reliability
publisher	New Prairie Press
publishDate	2020
url	https://doaj.org/article/b4876be366b2400bbe4c96994160c8f9
work_keys_str_mv	AT andrewcpickett doesitworkforeveryonetheinfluenceofdemographicvariablesonstatisticalreliability AT dannyvaldez doesitworkforeveryonetheinfluenceofdemographicvariablesonstatisticalreliability AT adamebarry doesitworkforeveryonetheinfluenceofdemographicvariablesonstatisticalreliability
_version_	1718419858444517376

Does It Work for Everyone? The Influence of Demographic Variables on Statistical Reliability

Ejemplares similares