An association between prediction errors and risk-seeking: Theory and behavioral evidence.

Reward prediction errors (RPEs) and risk preferences have two things in common: both can shape decision making behavior, and both are commonly associated with dopamine. RPEs drive value learning and are thought to be represented in the phasic release of striatal dopamine. Risk preferences bias choic...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Moritz Moeller, Jan Grohn, Sanjay Manohar, Rafal Bogacz
Formato: article
Lenguaje:EN
Publicado: Public Library of Science (PLoS) 2021
Materias:
Acceso en línea:https://doaj.org/article/afd61b9f51544179b7133edf6fc32e13
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:afd61b9f51544179b7133edf6fc32e13
record_format dspace
spelling oai:doaj.org-article:afd61b9f51544179b7133edf6fc32e132021-12-02T19:57:24ZAn association between prediction errors and risk-seeking: Theory and behavioral evidence.1553-734X1553-735810.1371/journal.pcbi.1009213https://doaj.org/article/afd61b9f51544179b7133edf6fc32e132021-07-01T00:00:00Zhttps://doi.org/10.1371/journal.pcbi.1009213https://doaj.org/toc/1553-734Xhttps://doaj.org/toc/1553-7358Reward prediction errors (RPEs) and risk preferences have two things in common: both can shape decision making behavior, and both are commonly associated with dopamine. RPEs drive value learning and are thought to be represented in the phasic release of striatal dopamine. Risk preferences bias choices towards or away from uncertainty; they can be manipulated with drugs that target the dopaminergic system. Based on the common neural substrate, we hypothesize that RPEs and risk preferences are linked on the level of behavior as well. Here, we develop this hypothesis theoretically and test it empirically. First, we apply a recent theory of learning in the basal ganglia to predict how RPEs influence risk preferences. We find that positive RPEs should cause increased risk-seeking, while negative RPEs should cause risk-aversion. We then test our behavioral predictions using a novel bandit task in which value and risk vary independently across options. Critically, conditions are included where options vary in risk but are matched for value. We find that our prediction was correct: participants become more risk-seeking if choices are preceded by positive RPEs, and more risk-averse if choices are preceded by negative RPEs. These findings cannot be explained by other known effects, such as nonlinear utility curves or dynamic learning rates.Moritz MoellerJan GrohnSanjay ManoharRafal BogaczPublic Library of Science (PLoS)articleBiology (General)QH301-705.5ENPLoS Computational Biology, Vol 17, Iss 7, p e1009213 (2021)
institution DOAJ
collection DOAJ
language EN
topic Biology (General)
QH301-705.5
spellingShingle Biology (General)
QH301-705.5
Moritz Moeller
Jan Grohn
Sanjay Manohar
Rafal Bogacz
An association between prediction errors and risk-seeking: Theory and behavioral evidence.
description Reward prediction errors (RPEs) and risk preferences have two things in common: both can shape decision making behavior, and both are commonly associated with dopamine. RPEs drive value learning and are thought to be represented in the phasic release of striatal dopamine. Risk preferences bias choices towards or away from uncertainty; they can be manipulated with drugs that target the dopaminergic system. Based on the common neural substrate, we hypothesize that RPEs and risk preferences are linked on the level of behavior as well. Here, we develop this hypothesis theoretically and test it empirically. First, we apply a recent theory of learning in the basal ganglia to predict how RPEs influence risk preferences. We find that positive RPEs should cause increased risk-seeking, while negative RPEs should cause risk-aversion. We then test our behavioral predictions using a novel bandit task in which value and risk vary independently across options. Critically, conditions are included where options vary in risk but are matched for value. We find that our prediction was correct: participants become more risk-seeking if choices are preceded by positive RPEs, and more risk-averse if choices are preceded by negative RPEs. These findings cannot be explained by other known effects, such as nonlinear utility curves or dynamic learning rates.
format article
author Moritz Moeller
Jan Grohn
Sanjay Manohar
Rafal Bogacz
author_facet Moritz Moeller
Jan Grohn
Sanjay Manohar
Rafal Bogacz
author_sort Moritz Moeller
title An association between prediction errors and risk-seeking: Theory and behavioral evidence.
title_short An association between prediction errors and risk-seeking: Theory and behavioral evidence.
title_full An association between prediction errors and risk-seeking: Theory and behavioral evidence.
title_fullStr An association between prediction errors and risk-seeking: Theory and behavioral evidence.
title_full_unstemmed An association between prediction errors and risk-seeking: Theory and behavioral evidence.
title_sort association between prediction errors and risk-seeking: theory and behavioral evidence.
publisher Public Library of Science (PLoS)
publishDate 2021
url https://doaj.org/article/afd61b9f51544179b7133edf6fc32e13
work_keys_str_mv AT moritzmoeller anassociationbetweenpredictionerrorsandriskseekingtheoryandbehavioralevidence
AT jangrohn anassociationbetweenpredictionerrorsandriskseekingtheoryandbehavioralevidence
AT sanjaymanohar anassociationbetweenpredictionerrorsandriskseekingtheoryandbehavioralevidence
AT rafalbogacz anassociationbetweenpredictionerrorsandriskseekingtheoryandbehavioralevidence
AT moritzmoeller associationbetweenpredictionerrorsandriskseekingtheoryandbehavioralevidence
AT jangrohn associationbetweenpredictionerrorsandriskseekingtheoryandbehavioralevidence
AT sanjaymanohar associationbetweenpredictionerrorsandriskseekingtheoryandbehavioralevidence
AT rafalbogacz associationbetweenpredictionerrorsandriskseekingtheoryandbehavioralevidence
_version_ 1718375859464699904