Unveiling functions of the visual cortex using task-specific deep neural networks.
The human visual cortex enables visual perception through a cascade of hierarchical computations in cortical regions with distinct functionalities. Here, we introduce an AI-driven approach to discover the functional mapping of the visual cortex. We related human brain responses to scene images measu...
Guardado en:
Autores principales: | , , , |
---|---|
Formato: | article |
Lenguaje: | EN |
Publicado: |
Public Library of Science (PLoS)
2021
|
Materias: | |
Acceso en línea: | https://doaj.org/article/342e003ef74b46c0aa41a954dd3f4c5e |
Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
id |
oai:doaj.org-article:342e003ef74b46c0aa41a954dd3f4c5e |
---|---|
record_format |
dspace |
spelling |
oai:doaj.org-article:342e003ef74b46c0aa41a954dd3f4c5e2021-12-02T19:58:04ZUnveiling functions of the visual cortex using task-specific deep neural networks.1553-734X1553-735810.1371/journal.pcbi.1009267https://doaj.org/article/342e003ef74b46c0aa41a954dd3f4c5e2021-08-01T00:00:00Zhttps://doi.org/10.1371/journal.pcbi.1009267https://doaj.org/toc/1553-734Xhttps://doaj.org/toc/1553-7358The human visual cortex enables visual perception through a cascade of hierarchical computations in cortical regions with distinct functionalities. Here, we introduce an AI-driven approach to discover the functional mapping of the visual cortex. We related human brain responses to scene images measured with functional MRI (fMRI) systematically to a diverse set of deep neural networks (DNNs) optimized to perform different scene perception tasks. We found a structured mapping between DNN tasks and brain regions along the ventral and dorsal visual streams. Low-level visual tasks mapped onto early brain regions, 3-dimensional scene perception tasks mapped onto the dorsal stream, and semantic tasks mapped onto the ventral stream. This mapping was of high fidelity, with more than 60% of the explainable variance in nine key regions being explained. Together, our results provide a novel functional mapping of the human visual cortex and demonstrate the power of the computational approach.Kshitij DwivediMichael F BonnerRadoslaw Martin CichyGemma RoigPublic Library of Science (PLoS)articleBiology (General)QH301-705.5ENPLoS Computational Biology, Vol 17, Iss 8, p e1009267 (2021) |
institution |
DOAJ |
collection |
DOAJ |
language |
EN |
topic |
Biology (General) QH301-705.5 |
spellingShingle |
Biology (General) QH301-705.5 Kshitij Dwivedi Michael F Bonner Radoslaw Martin Cichy Gemma Roig Unveiling functions of the visual cortex using task-specific deep neural networks. |
description |
The human visual cortex enables visual perception through a cascade of hierarchical computations in cortical regions with distinct functionalities. Here, we introduce an AI-driven approach to discover the functional mapping of the visual cortex. We related human brain responses to scene images measured with functional MRI (fMRI) systematically to a diverse set of deep neural networks (DNNs) optimized to perform different scene perception tasks. We found a structured mapping between DNN tasks and brain regions along the ventral and dorsal visual streams. Low-level visual tasks mapped onto early brain regions, 3-dimensional scene perception tasks mapped onto the dorsal stream, and semantic tasks mapped onto the ventral stream. This mapping was of high fidelity, with more than 60% of the explainable variance in nine key regions being explained. Together, our results provide a novel functional mapping of the human visual cortex and demonstrate the power of the computational approach. |
format |
article |
author |
Kshitij Dwivedi Michael F Bonner Radoslaw Martin Cichy Gemma Roig |
author_facet |
Kshitij Dwivedi Michael F Bonner Radoslaw Martin Cichy Gemma Roig |
author_sort |
Kshitij Dwivedi |
title |
Unveiling functions of the visual cortex using task-specific deep neural networks. |
title_short |
Unveiling functions of the visual cortex using task-specific deep neural networks. |
title_full |
Unveiling functions of the visual cortex using task-specific deep neural networks. |
title_fullStr |
Unveiling functions of the visual cortex using task-specific deep neural networks. |
title_full_unstemmed |
Unveiling functions of the visual cortex using task-specific deep neural networks. |
title_sort |
unveiling functions of the visual cortex using task-specific deep neural networks. |
publisher |
Public Library of Science (PLoS) |
publishDate |
2021 |
url |
https://doaj.org/article/342e003ef74b46c0aa41a954dd3f4c5e |
work_keys_str_mv |
AT kshitijdwivedi unveilingfunctionsofthevisualcortexusingtaskspecificdeepneuralnetworks AT michaelfbonner unveilingfunctionsofthevisualcortexusingtaskspecificdeepneuralnetworks AT radoslawmartincichy unveilingfunctionsofthevisualcortexusingtaskspecificdeepneuralnetworks AT gemmaroig unveilingfunctionsofthevisualcortexusingtaskspecificdeepneuralnetworks |
_version_ |
1718375769037602816 |