Meaning Guides Attention during Real-World Scene Description

Abstract Intelligent analysis of a visual scene requires that important regions be prioritized and attentionally selected for preferential processing. What is the basis for this selection? Here we compared the influence of meaning and image salience on attentional guidance in real-world scenes durin...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	John M. Henderson, Taylor R. Hayes, Gwendolyn Rehrig, Fernanda Ferreira
Formato:	article
Lenguaje:	EN
Publicado:	Nature Portfolio 2018
Materias:	Medicine R Science Q
Acceso en línea:	https://doaj.org/article/8fc3120e11324b53a417720964bf6a06
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:8fc3120e11324b53a417720964bf6a06
record_format	dspace
spelling	oai:doaj.org-article:8fc3120e11324b53a417720964bf6a062021-12-02T15:09:09ZMeaning Guides Attention during Real-World Scene Description10.1038/s41598-018-31894-52045-2322https://doaj.org/article/8fc3120e11324b53a417720964bf6a062018-09-01T00:00:00Zhttps://doi.org/10.1038/s41598-018-31894-5https://doaj.org/toc/2045-2322Abstract Intelligent analysis of a visual scene requires that important regions be prioritized and attentionally selected for preferential processing. What is the basis for this selection? Here we compared the influence of meaning and image salience on attentional guidance in real-world scenes during two free-viewing scene description tasks. Meaning was represented by meaning maps capturing the spatial distribution of semantic features. Image salience was represented by saliency maps capturing the spatial distribution of image features. Both types of maps were coded in a format that could be directly compared to maps of the spatial distribution of attention derived from viewers’ eye fixations in the scene description tasks. The results showed that both meaning and salience predicted the spatial distribution of attention in these tasks, but that when the correlation between meaning and salience was statistically controlled, only meaning accounted for unique variance in attention. The results support theories in which cognitive relevance plays the dominant functional role in controlling human attentional guidance in scenes. The results also have practical implications for current artificial intelligence approaches to labeling real-world images.John M. HendersonTaylor R. HayesGwendolyn RehrigFernanda FerreiraNature PortfolioarticleMedicineRScienceQENScientific Reports, Vol 8, Iss 1, Pp 1-9 (2018)
institution	DOAJ
collection	DOAJ
language	EN
topic	Medicine R Science Q
spellingShingle	Medicine R Science Q John M. Henderson Taylor R. Hayes Gwendolyn Rehrig Fernanda Ferreira Meaning Guides Attention during Real-World Scene Description
description	Abstract Intelligent analysis of a visual scene requires that important regions be prioritized and attentionally selected for preferential processing. What is the basis for this selection? Here we compared the influence of meaning and image salience on attentional guidance in real-world scenes during two free-viewing scene description tasks. Meaning was represented by meaning maps capturing the spatial distribution of semantic features. Image salience was represented by saliency maps capturing the spatial distribution of image features. Both types of maps were coded in a format that could be directly compared to maps of the spatial distribution of attention derived from viewers’ eye fixations in the scene description tasks. The results showed that both meaning and salience predicted the spatial distribution of attention in these tasks, but that when the correlation between meaning and salience was statistically controlled, only meaning accounted for unique variance in attention. The results support theories in which cognitive relevance plays the dominant functional role in controlling human attentional guidance in scenes. The results also have practical implications for current artificial intelligence approaches to labeling real-world images.
format	article
author	John M. Henderson Taylor R. Hayes Gwendolyn Rehrig Fernanda Ferreira
author_facet	John M. Henderson Taylor R. Hayes Gwendolyn Rehrig Fernanda Ferreira
author_sort	John M. Henderson
title	Meaning Guides Attention during Real-World Scene Description
title_short	Meaning Guides Attention during Real-World Scene Description
title_full	Meaning Guides Attention during Real-World Scene Description
title_fullStr	Meaning Guides Attention during Real-World Scene Description
title_full_unstemmed	Meaning Guides Attention during Real-World Scene Description
title_sort	meaning guides attention during real-world scene description
publisher	Nature Portfolio
publishDate	2018
url	https://doaj.org/article/8fc3120e11324b53a417720964bf6a06
work_keys_str_mv	AT johnmhenderson meaningguidesattentionduringrealworldscenedescription AT taylorrhayes meaningguidesattentionduringrealworldscenedescription AT gwendolynrehrig meaningguidesattentionduringrealworldscenedescription AT fernandaferreira meaningguidesattentionduringrealworldscenedescription
_version_	1718387888618471424

Meaning Guides Attention during Real-World Scene Description

Ejemplares similares