Optogenetic stimulation in a computational model of the basal ganglia biases action selection and reward prediction error.

Optogenetic stimulation of specific types of medium spiny neurons (MSNs) in the striatum has been shown to bias the selection of mice in a two choices task. This shift is dependent on the localisation and on the intensity of the stimulation but also on the recent reward history. We have implemented...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Pierre Berthet, Anders Lansner
Formato:	article
Lenguaje:	EN
Publicado:	Public Library of Science (PLoS) 2014
Materias:	Medicine R Science Q
Acceso en línea:	https://doaj.org/article/323e71a953604292817a7fdef1c1bff7
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:323e71a953604292817a7fdef1c1bff7
record_format	dspace
spelling	oai:doaj.org-article:323e71a953604292817a7fdef1c1bff72021-11-18T08:29:01ZOptogenetic stimulation in a computational model of the basal ganglia biases action selection and reward prediction error.1932-620310.1371/journal.pone.0090578https://doaj.org/article/323e71a953604292817a7fdef1c1bff72014-01-01T00:00:00Zhttps://www.ncbi.nlm.nih.gov/pmc/articles/pmid/24614169/pdf/?tool=EBIhttps://doaj.org/toc/1932-6203Optogenetic stimulation of specific types of medium spiny neurons (MSNs) in the striatum has been shown to bias the selection of mice in a two choices task. This shift is dependent on the localisation and on the intensity of the stimulation but also on the recent reward history. We have implemented a way to simulate this increased activity produced by the optical flash in our computational model of the basal ganglia (BG). This abstract model features the direct and indirect pathways commonly described in biology, and a reward prediction pathway (RP). The framework is similar to Actor-Critic methods and to the ventral/dorsal distinction in the striatum. We thus investigated the impact on the selection caused by an added stimulation in each of the three pathways. We were able to reproduce in our model the bias in action selection observed in mice. Our results also showed that biasing the reward prediction is sufficient to create a modification in the action selection. However, we had to increase the percentage of trials with stimulation relative to that in experiments in order to impact the selection. We found that increasing only the reward prediction had a different effect if the stimulation in RP was action dependent (only for a specific action) or not. We further looked at the evolution of the change in the weights depending on the stage of learning within a block. A bias in RP impacts the plasticity differently depending on that stage but also on the outcome. It remains to experimentally test how the dopaminergic neurons are affected by specific stimulations of neurons in the striatum and to relate data to predictions of our model.Pierre BerthetAnders LansnerPublic Library of Science (PLoS)articleMedicineRScienceQENPLoS ONE, Vol 9, Iss 3, p e90578 (2014)
institution	DOAJ
collection	DOAJ
language	EN
topic	Medicine R Science Q
spellingShingle	Medicine R Science Q Pierre Berthet Anders Lansner Optogenetic stimulation in a computational model of the basal ganglia biases action selection and reward prediction error.
description	Optogenetic stimulation of specific types of medium spiny neurons (MSNs) in the striatum has been shown to bias the selection of mice in a two choices task. This shift is dependent on the localisation and on the intensity of the stimulation but also on the recent reward history. We have implemented a way to simulate this increased activity produced by the optical flash in our computational model of the basal ganglia (BG). This abstract model features the direct and indirect pathways commonly described in biology, and a reward prediction pathway (RP). The framework is similar to Actor-Critic methods and to the ventral/dorsal distinction in the striatum. We thus investigated the impact on the selection caused by an added stimulation in each of the three pathways. We were able to reproduce in our model the bias in action selection observed in mice. Our results also showed that biasing the reward prediction is sufficient to create a modification in the action selection. However, we had to increase the percentage of trials with stimulation relative to that in experiments in order to impact the selection. We found that increasing only the reward prediction had a different effect if the stimulation in RP was action dependent (only for a specific action) or not. We further looked at the evolution of the change in the weights depending on the stage of learning within a block. A bias in RP impacts the plasticity differently depending on that stage but also on the outcome. It remains to experimentally test how the dopaminergic neurons are affected by specific stimulations of neurons in the striatum and to relate data to predictions of our model.
format	article
author	Pierre Berthet Anders Lansner
author_facet	Pierre Berthet Anders Lansner
author_sort	Pierre Berthet
title	Optogenetic stimulation in a computational model of the basal ganglia biases action selection and reward prediction error.
title_short	Optogenetic stimulation in a computational model of the basal ganglia biases action selection and reward prediction error.
title_full	Optogenetic stimulation in a computational model of the basal ganglia biases action selection and reward prediction error.
title_fullStr	Optogenetic stimulation in a computational model of the basal ganglia biases action selection and reward prediction error.
title_full_unstemmed	Optogenetic stimulation in a computational model of the basal ganglia biases action selection and reward prediction error.
title_sort	optogenetic stimulation in a computational model of the basal ganglia biases action selection and reward prediction error.
publisher	Public Library of Science (PLoS)
publishDate	2014
url	https://doaj.org/article/323e71a953604292817a7fdef1c1bff7
work_keys_str_mv	AT pierreberthet optogeneticstimulationinacomputationalmodelofthebasalgangliabiasesactionselectionandrewardpredictionerror AT anderslansner optogeneticstimulationinacomputationalmodelofthebasalgangliabiasesactionselectionandrewardpredictionerror
_version_	1718421731448717312

Optogenetic stimulation in a computational model of the basal ganglia biases action selection and reward prediction error.

Ejemplares similares