Adaptation to criticality through organizational invariance in embodied agents

Abstract Many biological and cognitive systems do not operate deep within one or other regime of activity. Instead, they are poised at critical points located at phase transitions in their parameter space. The pervasiveness of criticality suggests that there may be general principles inducing this b...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Miguel Aguilera, Manuel G. Bedia
Formato:	article
Lenguaje:	EN
Publicado:	Nature Portfolio 2018
Materias:	Medicine R Science Q
Acceso en línea:	https://doaj.org/article/40dbdf45191d4d109a4aa645dffd5262
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:40dbdf45191d4d109a4aa645dffd5262
record_format	dspace
spelling	oai:doaj.org-article:40dbdf45191d4d109a4aa645dffd52622021-12-02T15:07:44ZAdaptation to criticality through organizational invariance in embodied agents10.1038/s41598-018-25925-42045-2322https://doaj.org/article/40dbdf45191d4d109a4aa645dffd52622018-05-01T00:00:00Zhttps://doi.org/10.1038/s41598-018-25925-4https://doaj.org/toc/2045-2322Abstract Many biological and cognitive systems do not operate deep within one or other regime of activity. Instead, they are poised at critical points located at phase transitions in their parameter space. The pervasiveness of criticality suggests that there may be general principles inducing this behaviour, yet there is no well-founded theory for understanding how criticality is generated at a wide span of levels and contexts. In order to explore how criticality might emerge from general adaptive mechanisms, we propose a simple learning rule that maintains an internal organizational structure from a specific family of systems at criticality. We implement the mechanism in artificial embodied agents controlled by a neural network maintaining a correlation structure randomly sampled from an Ising model at critical temperature. Agents are evaluated in two classical reinforcement learning scenarios: the Mountain Car and the Acrobot double pendulum. In both cases the neural controller appears to reach a point of criticality, which coincides with a transition point between two regimes of the agent’s behaviour. These results suggest that adaptation to criticality could be used as a general adaptive mechanism in some circumstances, providing an alternative explanation for the pervasive presence of criticality in biological and cognitive systems.Miguel AguileraManuel G. BediaNature PortfolioarticleMedicineRScienceQENScientific Reports, Vol 8, Iss 1, Pp 1-11 (2018)
institution	DOAJ
collection	DOAJ
language	EN
topic	Medicine R Science Q
spellingShingle	Medicine R Science Q Miguel Aguilera Manuel G. Bedia Adaptation to criticality through organizational invariance in embodied agents
description	Abstract Many biological and cognitive systems do not operate deep within one or other regime of activity. Instead, they are poised at critical points located at phase transitions in their parameter space. The pervasiveness of criticality suggests that there may be general principles inducing this behaviour, yet there is no well-founded theory for understanding how criticality is generated at a wide span of levels and contexts. In order to explore how criticality might emerge from general adaptive mechanisms, we propose a simple learning rule that maintains an internal organizational structure from a specific family of systems at criticality. We implement the mechanism in artificial embodied agents controlled by a neural network maintaining a correlation structure randomly sampled from an Ising model at critical temperature. Agents are evaluated in two classical reinforcement learning scenarios: the Mountain Car and the Acrobot double pendulum. In both cases the neural controller appears to reach a point of criticality, which coincides with a transition point between two regimes of the agent’s behaviour. These results suggest that adaptation to criticality could be used as a general adaptive mechanism in some circumstances, providing an alternative explanation for the pervasive presence of criticality in biological and cognitive systems.
format	article
author	Miguel Aguilera Manuel G. Bedia
author_facet	Miguel Aguilera Manuel G. Bedia
author_sort	Miguel Aguilera
title	Adaptation to criticality through organizational invariance in embodied agents
title_short	Adaptation to criticality through organizational invariance in embodied agents
title_full	Adaptation to criticality through organizational invariance in embodied agents
title_fullStr	Adaptation to criticality through organizational invariance in embodied agents
title_full_unstemmed	Adaptation to criticality through organizational invariance in embodied agents
title_sort	adaptation to criticality through organizational invariance in embodied agents
publisher	Nature Portfolio
publishDate	2018
url	https://doaj.org/article/40dbdf45191d4d109a4aa645dffd5262
work_keys_str_mv	AT miguelaguilera adaptationtocriticalitythroughorganizationalinvarianceinembodiedagents AT manuelgbedia adaptationtocriticalitythroughorganizationalinvarianceinembodiedagents
_version_	1718388443993604096

Adaptation to criticality through organizational invariance in embodied agents

Ejemplares similares