Dopamine blockade impairs the exploration-exploitation trade-off in rats

Abstract In a volatile environment where rewards are uncertain, successful performance requires a delicate balance between exploitation of the best option and exploration of alternative choices. It has theoretically been proposed that dopamine contributes to the control of this exploration-exploitat...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	François Cinotti, Virginie Fresno, Nassim Aklil, Etienne Coutureau, Benoît Girard, Alain R. Marchand, Mehdi Khamassi
Formato:	article
Lenguaje:	EN
Publicado:	Nature Portfolio 2019
Materias:	Medicine R Science Q
Acceso en línea:	https://doaj.org/article/d1bb9e78fd0848418f42e45b81e98ce3
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:d1bb9e78fd0848418f42e45b81e98ce3
record_format	dspace
spelling	oai:doaj.org-article:d1bb9e78fd0848418f42e45b81e98ce32021-12-02T15:09:00ZDopamine blockade impairs the exploration-exploitation trade-off in rats10.1038/s41598-019-43245-z2045-2322https://doaj.org/article/d1bb9e78fd0848418f42e45b81e98ce32019-05-01T00:00:00Zhttps://doi.org/10.1038/s41598-019-43245-zhttps://doaj.org/toc/2045-2322Abstract In a volatile environment where rewards are uncertain, successful performance requires a delicate balance between exploitation of the best option and exploration of alternative choices. It has theoretically been proposed that dopamine contributes to the control of this exploration-exploitation trade-off, specifically that the higher the level of tonic dopamine, the more exploitation is favored. We demonstrate here that there is a formal relationship between the rescaling of dopamine positive reward prediction errors and the exploration-exploitation trade-off in simple non-stationary multi-armed bandit tasks. We further show in rats performing such a task that systemically antagonizing dopamine receptors greatly increases the number of random choices without affecting learning capacities. Simulations and comparison of a set of different computational models (an extended Q-learning model, a directed exploration model, and a meta-learning model) fitted on each individual confirm that, independently of the model, decreasing dopaminergic activity does not affect learning rate but is equivalent to an increase in random exploration rate. This study shows that dopamine could adapt the exploration-exploitation trade-off in decision-making when facing changing environmental contingencies.François CinottiVirginie FresnoNassim AklilEtienne CoutureauBenoît GirardAlain R. MarchandMehdi KhamassiNature PortfolioarticleMedicineRScienceQENScientific Reports, Vol 9, Iss 1, Pp 1-14 (2019)
institution	DOAJ
collection	DOAJ
language	EN
topic	Medicine R Science Q
spellingShingle	Medicine R Science Q François Cinotti Virginie Fresno Nassim Aklil Etienne Coutureau Benoît Girard Alain R. Marchand Mehdi Khamassi Dopamine blockade impairs the exploration-exploitation trade-off in rats
description	Abstract In a volatile environment where rewards are uncertain, successful performance requires a delicate balance between exploitation of the best option and exploration of alternative choices. It has theoretically been proposed that dopamine contributes to the control of this exploration-exploitation trade-off, specifically that the higher the level of tonic dopamine, the more exploitation is favored. We demonstrate here that there is a formal relationship between the rescaling of dopamine positive reward prediction errors and the exploration-exploitation trade-off in simple non-stationary multi-armed bandit tasks. We further show in rats performing such a task that systemically antagonizing dopamine receptors greatly increases the number of random choices without affecting learning capacities. Simulations and comparison of a set of different computational models (an extended Q-learning model, a directed exploration model, and a meta-learning model) fitted on each individual confirm that, independently of the model, decreasing dopaminergic activity does not affect learning rate but is equivalent to an increase in random exploration rate. This study shows that dopamine could adapt the exploration-exploitation trade-off in decision-making when facing changing environmental contingencies.
format	article
author	François Cinotti Virginie Fresno Nassim Aklil Etienne Coutureau Benoît Girard Alain R. Marchand Mehdi Khamassi
author_facet	François Cinotti Virginie Fresno Nassim Aklil Etienne Coutureau Benoît Girard Alain R. Marchand Mehdi Khamassi
author_sort	François Cinotti
title	Dopamine blockade impairs the exploration-exploitation trade-off in rats
title_short	Dopamine blockade impairs the exploration-exploitation trade-off in rats
title_full	Dopamine blockade impairs the exploration-exploitation trade-off in rats
title_fullStr	Dopamine blockade impairs the exploration-exploitation trade-off in rats
title_full_unstemmed	Dopamine blockade impairs the exploration-exploitation trade-off in rats
title_sort	dopamine blockade impairs the exploration-exploitation trade-off in rats
publisher	Nature Portfolio
publishDate	2019
url	https://doaj.org/article/d1bb9e78fd0848418f42e45b81e98ce3
work_keys_str_mv	AT francoiscinotti dopamineblockadeimpairstheexplorationexploitationtradeoffinrats AT virginiefresno dopamineblockadeimpairstheexplorationexploitationtradeoffinrats AT nassimaklil dopamineblockadeimpairstheexplorationexploitationtradeoffinrats AT etiennecoutureau dopamineblockadeimpairstheexplorationexploitationtradeoffinrats AT benoitgirard dopamineblockadeimpairstheexplorationexploitationtradeoffinrats AT alainrmarchand dopamineblockadeimpairstheexplorationexploitationtradeoffinrats AT mehdikhamassi dopamineblockadeimpairstheexplorationexploitationtradeoffinrats
_version_	1718387968085852160

Dopamine blockade impairs the exploration-exploitation trade-off in rats

Ejemplares similares