CurmElo: The theory and practice of a forced-choice approach to producing preference rankings.

We introduce CurmElo, a forced-choice approach to producing a preference ranking of an arbitrary set of objects that combines the Elo algorithm with novel techniques for detecting and correcting for (1) preference heterogeneity induced polarization in preferences among raters, and (2) intransitivity...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Soham Sankaran, Jacob Derechin, Nicholas A Christakis
Formato:	article
Lenguaje:	EN
Publicado:	Public Library of Science (PLoS) 2021
Materias:	Medicine R Science Q
Acceso en línea:	https://doaj.org/article/ddee4a058e8c44cdbba7ee94d02e40da
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:ddee4a058e8c44cdbba7ee94d02e40da
record_format	dspace
spelling	oai:doaj.org-article:ddee4a058e8c44cdbba7ee94d02e40da2021-11-25T06:23:44ZCurmElo: The theory and practice of a forced-choice approach to producing preference rankings.1932-620310.1371/journal.pone.0252145https://doaj.org/article/ddee4a058e8c44cdbba7ee94d02e40da2021-01-01T00:00:00Zhttps://doi.org/10.1371/journal.pone.0252145https://doaj.org/toc/1932-6203We introduce CurmElo, a forced-choice approach to producing a preference ranking of an arbitrary set of objects that combines the Elo algorithm with novel techniques for detecting and correcting for (1) preference heterogeneity induced polarization in preferences among raters, and (2) intransitivity in preference rankings. We detail the application of CurmElo to the problem of generating approximately preference-neutral identifiers, in this case four-letter and five-letter nonsense words patterned on the phonological conventions of the English language, using a population of Amazon Mechanical Turk workers. We find evidence that human raters have significant non-uniform preferences over these nonsense words, and we detail the consequences of this finding for social science work that utilizes identifiers without accounting for the bias this can induce. In addition, we describe how CurmElo can be used to produce rankings of arbitrary features or dimensions of preference of a set of objects relative to a population of raters.Soham SankaranJacob DerechinNicholas A ChristakisPublic Library of Science (PLoS)articleMedicineRScienceQENPLoS ONE, Vol 16, Iss 5, p e0252145 (2021)
institution	DOAJ
collection	DOAJ
language	EN
topic	Medicine R Science Q
spellingShingle	Medicine R Science Q Soham Sankaran Jacob Derechin Nicholas A Christakis CurmElo: The theory and practice of a forced-choice approach to producing preference rankings.
description	We introduce CurmElo, a forced-choice approach to producing a preference ranking of an arbitrary set of objects that combines the Elo algorithm with novel techniques for detecting and correcting for (1) preference heterogeneity induced polarization in preferences among raters, and (2) intransitivity in preference rankings. We detail the application of CurmElo to the problem of generating approximately preference-neutral identifiers, in this case four-letter and five-letter nonsense words patterned on the phonological conventions of the English language, using a population of Amazon Mechanical Turk workers. We find evidence that human raters have significant non-uniform preferences over these nonsense words, and we detail the consequences of this finding for social science work that utilizes identifiers without accounting for the bias this can induce. In addition, we describe how CurmElo can be used to produce rankings of arbitrary features or dimensions of preference of a set of objects relative to a population of raters.
format	article
author	Soham Sankaran Jacob Derechin Nicholas A Christakis
author_facet	Soham Sankaran Jacob Derechin Nicholas A Christakis
author_sort	Soham Sankaran
title	CurmElo: The theory and practice of a forced-choice approach to producing preference rankings.
title_short	CurmElo: The theory and practice of a forced-choice approach to producing preference rankings.
title_full	CurmElo: The theory and practice of a forced-choice approach to producing preference rankings.
title_fullStr	CurmElo: The theory and practice of a forced-choice approach to producing preference rankings.
title_full_unstemmed	CurmElo: The theory and practice of a forced-choice approach to producing preference rankings.
title_sort	curmelo: the theory and practice of a forced-choice approach to producing preference rankings.
publisher	Public Library of Science (PLoS)
publishDate	2021
url	https://doaj.org/article/ddee4a058e8c44cdbba7ee94d02e40da
work_keys_str_mv	AT sohamsankaran curmelothetheoryandpracticeofaforcedchoiceapproachtoproducingpreferencerankings AT jacobderechin curmelothetheoryandpracticeofaforcedchoiceapproachtoproducingpreferencerankings AT nicholasachristakis curmelothetheoryandpracticeofaforcedchoiceapproachtoproducingpreferencerankings
_version_	1718413774474444800

CurmElo: The theory and practice of a forced-choice approach to producing preference rankings.

Ejemplares similares