Unveiling functions of the visual cortex using task-specific deep neural networks.

The human visual cortex enables visual perception through a cascade of hierarchical computations in cortical regions with distinct functionalities. Here, we introduce an AI-driven approach to discover the functional mapping of the visual cortex. We related human brain responses to scene images measu...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Kshitij Dwivedi, Michael F Bonner, Radoslaw Martin Cichy, Gemma Roig
Formato:	article
Lenguaje:	EN
Publicado:	Public Library of Science (PLoS) 2021
Materias:	Biology (General) QH301-705.5
Acceso en línea:	https://doaj.org/article/342e003ef74b46c0aa41a954dd3f4c5e
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:342e003ef74b46c0aa41a954dd3f4c5e
record_format	dspace
spelling	oai:doaj.org-article:342e003ef74b46c0aa41a954dd3f4c5e2021-12-02T19:58:04ZUnveiling functions of the visual cortex using task-specific deep neural networks.1553-734X1553-735810.1371/journal.pcbi.1009267https://doaj.org/article/342e003ef74b46c0aa41a954dd3f4c5e2021-08-01T00:00:00Zhttps://doi.org/10.1371/journal.pcbi.1009267https://doaj.org/toc/1553-734Xhttps://doaj.org/toc/1553-7358The human visual cortex enables visual perception through a cascade of hierarchical computations in cortical regions with distinct functionalities. Here, we introduce an AI-driven approach to discover the functional mapping of the visual cortex. We related human brain responses to scene images measured with functional MRI (fMRI) systematically to a diverse set of deep neural networks (DNNs) optimized to perform different scene perception tasks. We found a structured mapping between DNN tasks and brain regions along the ventral and dorsal visual streams. Low-level visual tasks mapped onto early brain regions, 3-dimensional scene perception tasks mapped onto the dorsal stream, and semantic tasks mapped onto the ventral stream. This mapping was of high fidelity, with more than 60% of the explainable variance in nine key regions being explained. Together, our results provide a novel functional mapping of the human visual cortex and demonstrate the power of the computational approach.Kshitij DwivediMichael F BonnerRadoslaw Martin CichyGemma RoigPublic Library of Science (PLoS)articleBiology (General)QH301-705.5ENPLoS Computational Biology, Vol 17, Iss 8, p e1009267 (2021)
institution	DOAJ
collection	DOAJ
language	EN
topic	Biology (General) QH301-705.5
spellingShingle	Biology (General) QH301-705.5 Kshitij Dwivedi Michael F Bonner Radoslaw Martin Cichy Gemma Roig Unveiling functions of the visual cortex using task-specific deep neural networks.
description	The human visual cortex enables visual perception through a cascade of hierarchical computations in cortical regions with distinct functionalities. Here, we introduce an AI-driven approach to discover the functional mapping of the visual cortex. We related human brain responses to scene images measured with functional MRI (fMRI) systematically to a diverse set of deep neural networks (DNNs) optimized to perform different scene perception tasks. We found a structured mapping between DNN tasks and brain regions along the ventral and dorsal visual streams. Low-level visual tasks mapped onto early brain regions, 3-dimensional scene perception tasks mapped onto the dorsal stream, and semantic tasks mapped onto the ventral stream. This mapping was of high fidelity, with more than 60% of the explainable variance in nine key regions being explained. Together, our results provide a novel functional mapping of the human visual cortex and demonstrate the power of the computational approach.
format	article
author	Kshitij Dwivedi Michael F Bonner Radoslaw Martin Cichy Gemma Roig
author_facet	Kshitij Dwivedi Michael F Bonner Radoslaw Martin Cichy Gemma Roig
author_sort	Kshitij Dwivedi
title	Unveiling functions of the visual cortex using task-specific deep neural networks.
title_short	Unveiling functions of the visual cortex using task-specific deep neural networks.
title_full	Unveiling functions of the visual cortex using task-specific deep neural networks.
title_fullStr	Unveiling functions of the visual cortex using task-specific deep neural networks.
title_full_unstemmed	Unveiling functions of the visual cortex using task-specific deep neural networks.
title_sort	unveiling functions of the visual cortex using task-specific deep neural networks.
publisher	Public Library of Science (PLoS)
publishDate	2021
url	https://doaj.org/article/342e003ef74b46c0aa41a954dd3f4c5e
work_keys_str_mv	AT kshitijdwivedi unveilingfunctionsofthevisualcortexusingtaskspecificdeepneuralnetworks AT michaelfbonner unveilingfunctionsofthevisualcortexusingtaskspecificdeepneuralnetworks AT radoslawmartincichy unveilingfunctionsofthevisualcortexusingtaskspecificdeepneuralnetworks AT gemmaroig unveilingfunctionsofthevisualcortexusingtaskspecificdeepneuralnetworks
_version_	1718375769037602816

Unveiling functions of the visual cortex using task-specific deep neural networks.

Ejemplares similares