Interference and shaping in sensorimotor adaptations with rewards.

When a perturbation is applied in a sensorimotor transformation task, subjects can adapt and maintain performance by either relying on sensory feedback, or, in the absence of such feedback, on information provided by rewards. For example, in a classical rotation task where movement endpoints must be...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Ran Darshan, Arthur Leblois, David Hansel
Formato:	article
Lenguaje:	EN
Publicado:	Public Library of Science (PLoS) 2014
Materias:	Biology (General) QH301-705.5
Acceso en línea:	https://doaj.org/article/dcc9c2881efa477da60fe389d7c967a4
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:dcc9c2881efa477da60fe389d7c967a4
record_format	dspace
spelling	oai:doaj.org-article:dcc9c2881efa477da60fe389d7c967a42021-11-18T05:53:14ZInterference and shaping in sensorimotor adaptations with rewards.1553-734X1553-735810.1371/journal.pcbi.1003377https://doaj.org/article/dcc9c2881efa477da60fe389d7c967a42014-01-01T00:00:00Zhttps://www.ncbi.nlm.nih.gov/pmc/articles/pmid/24415925/pdf/?tool=EBIhttps://doaj.org/toc/1553-734Xhttps://doaj.org/toc/1553-7358When a perturbation is applied in a sensorimotor transformation task, subjects can adapt and maintain performance by either relying on sensory feedback, or, in the absence of such feedback, on information provided by rewards. For example, in a classical rotation task where movement endpoints must be rotated to reach a fixed target, human subjects can successfully adapt their reaching movements solely on the basis of binary rewards, although this proves much more difficult than with visual feedback. Here, we investigate such a reward-driven sensorimotor adaptation process in a minimal computational model of the task. The key assumption of the model is that synaptic plasticity is gated by the reward. We study how the learning dynamics depend on the target size, the movement variability, the rotation angle and the number of targets. We show that when the movement is perturbed for multiple targets, the adaptation process for the different targets can interfere destructively or constructively depending on the similarities between the sensory stimuli (the targets) and the overlap in their neuronal representations. Destructive interferences can result in a drastic slowdown of the adaptation. As a result of interference, the time to adapt varies non-linearly with the number of targets. Our analysis shows that these interferences are weaker if the reward varies smoothly with the subject's performance instead of being binary. We demonstrate how shaping the reward or shaping the task can accelerate the adaptation dramatically by reducing the destructive interferences. We argue that experimentally investigating the dynamics of reward-driven sensorimotor adaptation for more than one sensory stimulus can shed light on the underlying learning rules.Ran DarshanArthur LebloisDavid HanselPublic Library of Science (PLoS)articleBiology (General)QH301-705.5ENPLoS Computational Biology, Vol 10, Iss 1, p e1003377 (2014)
institution	DOAJ
collection	DOAJ
language	EN
topic	Biology (General) QH301-705.5
spellingShingle	Biology (General) QH301-705.5 Ran Darshan Arthur Leblois David Hansel Interference and shaping in sensorimotor adaptations with rewards.
description	When a perturbation is applied in a sensorimotor transformation task, subjects can adapt and maintain performance by either relying on sensory feedback, or, in the absence of such feedback, on information provided by rewards. For example, in a classical rotation task where movement endpoints must be rotated to reach a fixed target, human subjects can successfully adapt their reaching movements solely on the basis of binary rewards, although this proves much more difficult than with visual feedback. Here, we investigate such a reward-driven sensorimotor adaptation process in a minimal computational model of the task. The key assumption of the model is that synaptic plasticity is gated by the reward. We study how the learning dynamics depend on the target size, the movement variability, the rotation angle and the number of targets. We show that when the movement is perturbed for multiple targets, the adaptation process for the different targets can interfere destructively or constructively depending on the similarities between the sensory stimuli (the targets) and the overlap in their neuronal representations. Destructive interferences can result in a drastic slowdown of the adaptation. As a result of interference, the time to adapt varies non-linearly with the number of targets. Our analysis shows that these interferences are weaker if the reward varies smoothly with the subject's performance instead of being binary. We demonstrate how shaping the reward or shaping the task can accelerate the adaptation dramatically by reducing the destructive interferences. We argue that experimentally investigating the dynamics of reward-driven sensorimotor adaptation for more than one sensory stimulus can shed light on the underlying learning rules.
format	article
author	Ran Darshan Arthur Leblois David Hansel
author_facet	Ran Darshan Arthur Leblois David Hansel
author_sort	Ran Darshan
title	Interference and shaping in sensorimotor adaptations with rewards.
title_short	Interference and shaping in sensorimotor adaptations with rewards.
title_full	Interference and shaping in sensorimotor adaptations with rewards.
title_fullStr	Interference and shaping in sensorimotor adaptations with rewards.
title_full_unstemmed	Interference and shaping in sensorimotor adaptations with rewards.
title_sort	interference and shaping in sensorimotor adaptations with rewards.
publisher	Public Library of Science (PLoS)
publishDate	2014
url	https://doaj.org/article/dcc9c2881efa477da60fe389d7c967a4
work_keys_str_mv	AT randarshan interferenceandshapinginsensorimotoradaptationswithrewards AT arthurleblois interferenceandshapinginsensorimotoradaptationswithrewards AT davidhansel interferenceandshapinginsensorimotoradaptationswithrewards
_version_	1718424698810793984

Interference and shaping in sensorimotor adaptations with rewards.

Ejemplares similares