Can Likert scales predict choices? Testing the congruence between using Likert scale and comparative judgment on measuring attribution

How people make choices among alternatives are of interest in different areas of psychological research. One paradigm to answer this question is by applying Likert Scale (LS) to compare the agreements to different alternatives, and the respective LS scores are then transferred into rank order of pre...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Che Cheng, Keng-Ling Lay, Yung-Fong Hsu, Yi-Miau Tsai
Formato: article
Lenguaje:EN
Publicado: Elsevier 2021
Materias:
Acceso en línea:https://doaj.org/article/d10d4c0424bc49eeb00b46f4dae59f2e
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:d10d4c0424bc49eeb00b46f4dae59f2e
record_format dspace
spelling oai:doaj.org-article:d10d4c0424bc49eeb00b46f4dae59f2e2021-12-02T05:03:39ZCan Likert scales predict choices? Testing the congruence between using Likert scale and comparative judgment on measuring attribution2590-260110.1016/j.metip.2021.100081https://doaj.org/article/d10d4c0424bc49eeb00b46f4dae59f2e2021-12-01T00:00:00Zhttp://www.sciencedirect.com/science/article/pii/S2590260121000382https://doaj.org/toc/2590-2601How people make choices among alternatives are of interest in different areas of psychological research. One paradigm to answer this question is by applying Likert Scale (LS) to compare the agreements to different alternatives, and the respective LS scores are then transferred into rank order of preference. However, using LS to infer choices is somewhat debatable because the measurement format of LS was not designed for revealing psychological preference. In this article, we examined to what extent it is appropriate to use quantitative indicators derived from LS to infer choices, with which we used the Comparative Judgment (CJ) procedure to represent a direct measurement of choice decision to compare. A total of 929 adolescents reported their effort and ability attributions for academic failure and success using both LS and CJ. We found that while using LS is generally accurate in predicting results obtained via CJ, the percentage of people revealing different choices inferred from LS versus CJ was 14.7% and 12.1% for the success and failure scenarios, respectively, suggesting that inferring psychological preference from LS is not without risk, at least for this sample of adolescents from a culturally-Chinese society. Furthermore, the majority of participants displaying incongruent decisions of achievement attribution via LS and CJ showed equivalent LS scores between effort and ability attributions. A goodness-of-fit test was conducted (on a model motivated by the beta-binomial distribution) and successfully eliminated the possibility that the tied LS scores in effort and ability attributions actually represent participants’ true psychological state.Che ChengKeng-Ling LayYung-Fong HsuYi-Miau TsaiElsevierarticleChoiceComparative judgmentLikert scalePreferencePsychologyBF1-990ENMethods in Psychology, Vol 5, Iss , Pp 100081- (2021)
institution DOAJ
collection DOAJ
language EN
topic Choice
Comparative judgment
Likert scale
Preference
Psychology
BF1-990
spellingShingle Choice
Comparative judgment
Likert scale
Preference
Psychology
BF1-990
Che Cheng
Keng-Ling Lay
Yung-Fong Hsu
Yi-Miau Tsai
Can Likert scales predict choices? Testing the congruence between using Likert scale and comparative judgment on measuring attribution
description How people make choices among alternatives are of interest in different areas of psychological research. One paradigm to answer this question is by applying Likert Scale (LS) to compare the agreements to different alternatives, and the respective LS scores are then transferred into rank order of preference. However, using LS to infer choices is somewhat debatable because the measurement format of LS was not designed for revealing psychological preference. In this article, we examined to what extent it is appropriate to use quantitative indicators derived from LS to infer choices, with which we used the Comparative Judgment (CJ) procedure to represent a direct measurement of choice decision to compare. A total of 929 adolescents reported their effort and ability attributions for academic failure and success using both LS and CJ. We found that while using LS is generally accurate in predicting results obtained via CJ, the percentage of people revealing different choices inferred from LS versus CJ was 14.7% and 12.1% for the success and failure scenarios, respectively, suggesting that inferring psychological preference from LS is not without risk, at least for this sample of adolescents from a culturally-Chinese society. Furthermore, the majority of participants displaying incongruent decisions of achievement attribution via LS and CJ showed equivalent LS scores between effort and ability attributions. A goodness-of-fit test was conducted (on a model motivated by the beta-binomial distribution) and successfully eliminated the possibility that the tied LS scores in effort and ability attributions actually represent participants’ true psychological state.
format article
author Che Cheng
Keng-Ling Lay
Yung-Fong Hsu
Yi-Miau Tsai
author_facet Che Cheng
Keng-Ling Lay
Yung-Fong Hsu
Yi-Miau Tsai
author_sort Che Cheng
title Can Likert scales predict choices? Testing the congruence between using Likert scale and comparative judgment on measuring attribution
title_short Can Likert scales predict choices? Testing the congruence between using Likert scale and comparative judgment on measuring attribution
title_full Can Likert scales predict choices? Testing the congruence between using Likert scale and comparative judgment on measuring attribution
title_fullStr Can Likert scales predict choices? Testing the congruence between using Likert scale and comparative judgment on measuring attribution
title_full_unstemmed Can Likert scales predict choices? Testing the congruence between using Likert scale and comparative judgment on measuring attribution
title_sort can likert scales predict choices? testing the congruence between using likert scale and comparative judgment on measuring attribution
publisher Elsevier
publishDate 2021
url https://doaj.org/article/d10d4c0424bc49eeb00b46f4dae59f2e
work_keys_str_mv AT checheng canlikertscalespredictchoicestestingthecongruencebetweenusinglikertscaleandcomparativejudgmentonmeasuringattribution
AT kenglinglay canlikertscalespredictchoicestestingthecongruencebetweenusinglikertscaleandcomparativejudgmentonmeasuringattribution
AT yungfonghsu canlikertscalespredictchoicestestingthecongruencebetweenusinglikertscaleandcomparativejudgmentonmeasuringattribution
AT yimiautsai canlikertscalespredictchoicestestingthecongruencebetweenusinglikertscaleandcomparativejudgmentonmeasuringattribution
_version_ 1718400677114281984