Skip to yearly menu bar Skip to main content


Structured Gradient-based Interpretations via Norm-Regularized Adversarial Training

Shizhan Gong · Qi Dou · Farzan Farnia

Arch 4A-E Poster #132
[ ]
Thu 20 Jun 10:30 a.m. PDT — noon PDT


Gradient-based saliency maps have been widely used to explain the decisions of deep neural network classifiers. However, standard gradient-based interpretation maps, including the simple gradient and integrated gradient algorithms, often lack desired structures such as sparsity and connectedness in their application to real-world computer vision models. A common approach to induce sparsity-based structures into gradient-based saliency maps is to modify the simple gradient scheme using sparsification or norm-based regularization. However, one drawback with such post-processing approaches is the potentially significant loss in fidelity to the original simple gradient map. In this work, we propose to apply adversarial training as an in-processing scheme to train neural networks with structured simple gradient maps. We demonstrate an existing duality between the regularized norms of the adversarial perturbations and gradient-based maps, whereby we design adversarial training schemes promoting sparsity and group-sparsity properties in simple gradient maps. We present comprehensive numerical results to show the influence of our proposed norm-based adversarial training methods on the standard gradient-based maps of standard neural network architectures on benchmark image datasets.

Live content is unavailable. Log in and register to view live content