Methods for interpreting and understanding deep neural networks

Grégoire Montavon, Wojciech Samek, Klaus Muller

Research output: Contribution to journalReview article

232 Citations (Scopus)

Abstract

This paper provides an entry point to the problem of interpreting a deep neural network model and explaining its predictions. It is based on a tutorial given at ICASSP 2017. As a tutorial paper, the set of methods covered here is not exhaustive, but sufficiently representative to discuss a number of questions in interpretability, technical challenges, and possible applications. The second part of the tutorial focuses on the recently proposed layer-wise relevance propagation (LRP) technique, for which we provide theory, recommendations, and tricks, to make most efficient use of it on real data.

Original languageEnglish
Pages (from-to)1-15
Number of pages15
JournalDigital Signal Processing: A Review Journal
Volume73
DOIs
Publication statusPublished - 2018 Feb 1

    Fingerprint

Keywords

  • Activation maximization
  • Deep neural networks
  • Layer-wise relevance propagation
  • Sensitivity analysis
  • Taylor decomposition

ASJC Scopus subject areas

  • Signal Processing
  • Electrical and Electronic Engineering

Cite this