Unveiling functions of the visual cortex using task-specific deep neural networks.

The human visual cortex enables visual perception through a cascade of hierarchical computations in cortical regions with distinct functionalities. Here, we introduce an AI-driven approach to discover the functional mapping of the visual cortex. We related human brain responses to scene images measu...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Kshitij Dwivedi, Michael F Bonner, Radoslaw Martin Cichy, Gemma Roig
Formato: article
Lenguaje:EN
Publicado: Public Library of Science (PLoS) 2021
Materias:
Acceso en línea:https://doaj.org/article/342e003ef74b46c0aa41a954dd3f4c5e
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:342e003ef74b46c0aa41a954dd3f4c5e
record_format dspace
spelling oai:doaj.org-article:342e003ef74b46c0aa41a954dd3f4c5e2021-12-02T19:58:04ZUnveiling functions of the visual cortex using task-specific deep neural networks.1553-734X1553-735810.1371/journal.pcbi.1009267https://doaj.org/article/342e003ef74b46c0aa41a954dd3f4c5e2021-08-01T00:00:00Zhttps://doi.org/10.1371/journal.pcbi.1009267https://doaj.org/toc/1553-734Xhttps://doaj.org/toc/1553-7358The human visual cortex enables visual perception through a cascade of hierarchical computations in cortical regions with distinct functionalities. Here, we introduce an AI-driven approach to discover the functional mapping of the visual cortex. We related human brain responses to scene images measured with functional MRI (fMRI) systematically to a diverse set of deep neural networks (DNNs) optimized to perform different scene perception tasks. We found a structured mapping between DNN tasks and brain regions along the ventral and dorsal visual streams. Low-level visual tasks mapped onto early brain regions, 3-dimensional scene perception tasks mapped onto the dorsal stream, and semantic tasks mapped onto the ventral stream. This mapping was of high fidelity, with more than 60% of the explainable variance in nine key regions being explained. Together, our results provide a novel functional mapping of the human visual cortex and demonstrate the power of the computational approach.Kshitij DwivediMichael F BonnerRadoslaw Martin CichyGemma RoigPublic Library of Science (PLoS)articleBiology (General)QH301-705.5ENPLoS Computational Biology, Vol 17, Iss 8, p e1009267 (2021)
institution DOAJ
collection DOAJ
language EN
topic Biology (General)
QH301-705.5
spellingShingle Biology (General)
QH301-705.5
Kshitij Dwivedi
Michael F Bonner
Radoslaw Martin Cichy
Gemma Roig
Unveiling functions of the visual cortex using task-specific deep neural networks.
description The human visual cortex enables visual perception through a cascade of hierarchical computations in cortical regions with distinct functionalities. Here, we introduce an AI-driven approach to discover the functional mapping of the visual cortex. We related human brain responses to scene images measured with functional MRI (fMRI) systematically to a diverse set of deep neural networks (DNNs) optimized to perform different scene perception tasks. We found a structured mapping between DNN tasks and brain regions along the ventral and dorsal visual streams. Low-level visual tasks mapped onto early brain regions, 3-dimensional scene perception tasks mapped onto the dorsal stream, and semantic tasks mapped onto the ventral stream. This mapping was of high fidelity, with more than 60% of the explainable variance in nine key regions being explained. Together, our results provide a novel functional mapping of the human visual cortex and demonstrate the power of the computational approach.
format article
author Kshitij Dwivedi
Michael F Bonner
Radoslaw Martin Cichy
Gemma Roig
author_facet Kshitij Dwivedi
Michael F Bonner
Radoslaw Martin Cichy
Gemma Roig
author_sort Kshitij Dwivedi
title Unveiling functions of the visual cortex using task-specific deep neural networks.
title_short Unveiling functions of the visual cortex using task-specific deep neural networks.
title_full Unveiling functions of the visual cortex using task-specific deep neural networks.
title_fullStr Unveiling functions of the visual cortex using task-specific deep neural networks.
title_full_unstemmed Unveiling functions of the visual cortex using task-specific deep neural networks.
title_sort unveiling functions of the visual cortex using task-specific deep neural networks.
publisher Public Library of Science (PLoS)
publishDate 2021
url https://doaj.org/article/342e003ef74b46c0aa41a954dd3f4c5e
work_keys_str_mv AT kshitijdwivedi unveilingfunctionsofthevisualcortexusingtaskspecificdeepneuralnetworks
AT michaelfbonner unveilingfunctionsofthevisualcortexusingtaskspecificdeepneuralnetworks
AT radoslawmartincichy unveilingfunctionsofthevisualcortexusingtaskspecificdeepneuralnetworks
AT gemmaroig unveilingfunctionsofthevisualcortexusingtaskspecificdeepneuralnetworks
_version_ 1718375769037602816