Layer-wise relevance propagation for neural networks with local renormalization layers

Alexander Binder, Grégoire Montavon, Sebastian Lapuschkin, Klaus Robert Müller, Wojciech Samek

Research output: Chapter in Book/Report/Conference proceedingConference contribution

115 Citations (Scopus)

Abstract

Layer-wise relevance propagation is a framework which allows to decompose the prediction of a deep neural network computed over a sample, e.g. an image, down to relevance scores for the single input dimensions of the sample such as subpixels of an image. While this approach can be applied directly to generalized linear mappings, product type non-linearities are not covered. This paper proposes an approach to extend layer-wise relevance propagation to neural networks with local renormalization layers, which is a very common product-type non-linearity in convolutional neural networks. We evaluate the proposed method for local renormalization layers on the CIFAR-10, Imagenet and MIT Places datasets.

Original languageEnglish
Title of host publicationArtificial Neural Networks and Machine Learning - 25th International Conference on Artificial Neural Networks, ICANN 2016, Proceedings
EditorsAlessandro E.P. Villa, Paolo Masulli, Antonio Javier Pons Rivero
PublisherSpringer Verlag
Pages63-71
Number of pages9
ISBN (Print)9783319447803
DOIs
Publication statusPublished - 2016
Event25th International Conference on Artificial Neural Networks and Machine Learning, ICANN 2016 - Barcelona, Spain
Duration: 2016 Sept 62016 Sept 9

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9887 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other25th International Conference on Artificial Neural Networks and Machine Learning, ICANN 2016
Country/TerritorySpain
CityBarcelona
Period16/9/616/9/9

Keywords

  • Image classification
  • Interpretability
  • Neural networks

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint

Dive into the research topics of 'Layer-wise relevance propagation for neural networks with local renormalization layers'. Together they form a unique fingerprint.

Cite this