Higher-Order Conditioning With Simultaneous and Backward Conditioned Stimulus: Implications for Models of Pavlovian Conditioning

In a new environment, humans and animals can detect and learn that cues predict meaningful outcomes, and use this information to adapt their responses. This process is termed Pavlovian conditioning. Pavlovian conditioning is also observed for stimuli that predict outcome-associated cues; a second ty...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Arthur Prével, Ruth M. Krebs
Formato: article
Lenguaje:EN
Publicado: Frontiers Media S.A. 2021
Materias:
Acceso en línea:https://doaj.org/article/6d1d944bdef24d549ebb111eebace604
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:6d1d944bdef24d549ebb111eebace604
record_format dspace
spelling oai:doaj.org-article:6d1d944bdef24d549ebb111eebace6042021-11-11T10:15:44ZHigher-Order Conditioning With Simultaneous and Backward Conditioned Stimulus: Implications for Models of Pavlovian Conditioning1662-515310.3389/fnbeh.2021.749517https://doaj.org/article/6d1d944bdef24d549ebb111eebace6042021-11-01T00:00:00Zhttps://www.frontiersin.org/articles/10.3389/fnbeh.2021.749517/fullhttps://doaj.org/toc/1662-5153In a new environment, humans and animals can detect and learn that cues predict meaningful outcomes, and use this information to adapt their responses. This process is termed Pavlovian conditioning. Pavlovian conditioning is also observed for stimuli that predict outcome-associated cues; a second type of conditioning is termed higher-order Pavlovian conditioning. In this review, we will focus on higher-order conditioning studies with simultaneous and backward conditioned stimuli. We will examine how the results from these experiments pose a challenge to models of Pavlovian conditioning like the Temporal Difference (TD) models, in which learning is mainly driven by reward prediction errors. Contrasting with this view, the results suggest that humans and animals can form complex representations of the (temporal) structure of the task, and use this information to guide behavior, which seems consistent with model-based reinforcement learning. Future investigations involving these procedures could result in important new insights on the mechanisms that underlie Pavlovian conditioning.Arthur PrévelRuth M. KrebsFrontiers Media S.A.articlebackward conditioninghigher-order conditioningreinforcement learningreward prediction errorsimultaneous conditioningNeurosciences. Biological psychiatry. NeuropsychiatryRC321-571ENFrontiers in Behavioral Neuroscience, Vol 15 (2021)
institution DOAJ
collection DOAJ
language EN
topic backward conditioning
higher-order conditioning
reinforcement learning
reward prediction error
simultaneous conditioning
Neurosciences. Biological psychiatry. Neuropsychiatry
RC321-571
spellingShingle backward conditioning
higher-order conditioning
reinforcement learning
reward prediction error
simultaneous conditioning
Neurosciences. Biological psychiatry. Neuropsychiatry
RC321-571
Arthur Prével
Ruth M. Krebs
Higher-Order Conditioning With Simultaneous and Backward Conditioned Stimulus: Implications for Models of Pavlovian Conditioning
description In a new environment, humans and animals can detect and learn that cues predict meaningful outcomes, and use this information to adapt their responses. This process is termed Pavlovian conditioning. Pavlovian conditioning is also observed for stimuli that predict outcome-associated cues; a second type of conditioning is termed higher-order Pavlovian conditioning. In this review, we will focus on higher-order conditioning studies with simultaneous and backward conditioned stimuli. We will examine how the results from these experiments pose a challenge to models of Pavlovian conditioning like the Temporal Difference (TD) models, in which learning is mainly driven by reward prediction errors. Contrasting with this view, the results suggest that humans and animals can form complex representations of the (temporal) structure of the task, and use this information to guide behavior, which seems consistent with model-based reinforcement learning. Future investigations involving these procedures could result in important new insights on the mechanisms that underlie Pavlovian conditioning.
format article
author Arthur Prével
Ruth M. Krebs
author_facet Arthur Prével
Ruth M. Krebs
author_sort Arthur Prével
title Higher-Order Conditioning With Simultaneous and Backward Conditioned Stimulus: Implications for Models of Pavlovian Conditioning
title_short Higher-Order Conditioning With Simultaneous and Backward Conditioned Stimulus: Implications for Models of Pavlovian Conditioning
title_full Higher-Order Conditioning With Simultaneous and Backward Conditioned Stimulus: Implications for Models of Pavlovian Conditioning
title_fullStr Higher-Order Conditioning With Simultaneous and Backward Conditioned Stimulus: Implications for Models of Pavlovian Conditioning
title_full_unstemmed Higher-Order Conditioning With Simultaneous and Backward Conditioned Stimulus: Implications for Models of Pavlovian Conditioning
title_sort higher-order conditioning with simultaneous and backward conditioned stimulus: implications for models of pavlovian conditioning
publisher Frontiers Media S.A.
publishDate 2021
url https://doaj.org/article/6d1d944bdef24d549ebb111eebace604
work_keys_str_mv AT arthurprevel higherorderconditioningwithsimultaneousandbackwardconditionedstimulusimplicationsformodelsofpavlovianconditioning
AT ruthmkrebs higherorderconditioningwithsimultaneousandbackwardconditionedstimulusimplicationsformodelsofpavlovianconditioning
_version_ 1718439224714199040