Skip to content

Initialize CRP with Relevance instead of Activation for RelMax reference samples #11

Description

@rachtibat

We know that activation != relevance. To localize concepts in input space, we initialize CRP with channel activations using the start_layer argument of the CondAttribution class. This works well for ActMax and is highly efficient. But for RelMax, the heatmap could be inverted or missing parts. Thus, in a future version of zennit-crp, we will perform localization of RelMax samples with a complete backward pass beginning at the output of the model to utilize the intermediate relevances i.e. the condition set = [{layer: channel, y:class}] and not start_layer argument. This is computationally less efficient, but results in better localization.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions