Feature-Based Interpretation of the Deep Neural Network
The significant advantage of deep neural networks is that the upper layer can capture the high-level features of data based on the information acquired from the lower layer by stacking layers deeply. Since it is challenging to interpret what knowledge the neural network has learned, various studies...
Guardado en:
Autores principales: | , |
---|---|
Formato: | article |
Lenguaje: | EN |
Publicado: |
MDPI AG
2021
|
Materias: | |
Acceso en línea: | https://doaj.org/article/8e911b6ca70f453995ea77a9bb616082 |
Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
id |
oai:doaj.org-article:8e911b6ca70f453995ea77a9bb616082 |
---|---|
record_format |
dspace |
spelling |
oai:doaj.org-article:8e911b6ca70f453995ea77a9bb6160822021-11-11T15:40:43ZFeature-Based Interpretation of the Deep Neural Network10.3390/electronics102126872079-9292https://doaj.org/article/8e911b6ca70f453995ea77a9bb6160822021-11-01T00:00:00Zhttps://www.mdpi.com/2079-9292/10/21/2687https://doaj.org/toc/2079-9292The significant advantage of deep neural networks is that the upper layer can capture the high-level features of data based on the information acquired from the lower layer by stacking layers deeply. Since it is challenging to interpret what knowledge the neural network has learned, various studies for explaining neural networks have emerged to overcome this problem. However, these studies generate the local explanation of a single instance rather than providing a generalized global interpretation of the neural network model itself. To overcome such drawbacks of the previous approaches, we propose the global interpretation method for the deep neural network through features of the model. We first analyzed the relationship between the input and hidden layers to represent the high-level features of the model, then interpreted the decision-making process of neural networks through high-level features. In addition, we applied network pruning techniques to make concise explanations and analyzed the effect of layer complexity on interpretability. We present experiments on the proposed approach using three different datasets and show that our approach could generate global explanations on deep neural network models with high accuracy and fidelity.Eun-Hun LeeHyeoncheol KimMDPI AGarticleneural networkexplainable artificial intelligence (XAI)interpretabilityElectronicsTK7800-8360ENElectronics, Vol 10, Iss 2687, p 2687 (2021) |
institution |
DOAJ |
collection |
DOAJ |
language |
EN |
topic |
neural network explainable artificial intelligence (XAI) interpretability Electronics TK7800-8360 |
spellingShingle |
neural network explainable artificial intelligence (XAI) interpretability Electronics TK7800-8360 Eun-Hun Lee Hyeoncheol Kim Feature-Based Interpretation of the Deep Neural Network |
description |
The significant advantage of deep neural networks is that the upper layer can capture the high-level features of data based on the information acquired from the lower layer by stacking layers deeply. Since it is challenging to interpret what knowledge the neural network has learned, various studies for explaining neural networks have emerged to overcome this problem. However, these studies generate the local explanation of a single instance rather than providing a generalized global interpretation of the neural network model itself. To overcome such drawbacks of the previous approaches, we propose the global interpretation method for the deep neural network through features of the model. We first analyzed the relationship between the input and hidden layers to represent the high-level features of the model, then interpreted the decision-making process of neural networks through high-level features. In addition, we applied network pruning techniques to make concise explanations and analyzed the effect of layer complexity on interpretability. We present experiments on the proposed approach using three different datasets and show that our approach could generate global explanations on deep neural network models with high accuracy and fidelity. |
format |
article |
author |
Eun-Hun Lee Hyeoncheol Kim |
author_facet |
Eun-Hun Lee Hyeoncheol Kim |
author_sort |
Eun-Hun Lee |
title |
Feature-Based Interpretation of the Deep Neural Network |
title_short |
Feature-Based Interpretation of the Deep Neural Network |
title_full |
Feature-Based Interpretation of the Deep Neural Network |
title_fullStr |
Feature-Based Interpretation of the Deep Neural Network |
title_full_unstemmed |
Feature-Based Interpretation of the Deep Neural Network |
title_sort |
feature-based interpretation of the deep neural network |
publisher |
MDPI AG |
publishDate |
2021 |
url |
https://doaj.org/article/8e911b6ca70f453995ea77a9bb616082 |
work_keys_str_mv |
AT eunhunlee featurebasedinterpretationofthedeepneuralnetwork AT hyeoncheolkim featurebasedinterpretationofthedeepneuralnetwork |
_version_ |
1718434424029184000 |