CLIP Explainability
This repo contains the code for the CLIP Explainability project. In this project, we conduct an in-depth study of CLIP’s learned image and text representations using saliency map visualization. We propose a modification to the existing saliency visualization method that improves its performance as shown by our qualitative evaluations. We then use this method to study CLIP’s ability in capturing similarities and dissimilarities between an input image and targets belonging to different domains including image, text, and emotion.
Setup
To install the required libraries run the following command:
pip install -r requirements.txt
Organization
code directory contains
- the implementation of saliency visualization methods: for ViT and ResNet-based CLIP
- GradCAM implementation based on pytorch-grad-cam slightly modified to adapt to CLIP.
- A re-implementation of CLIP taken from Transformer-MM-Explainability repo that keeps tack of attention maps and gradients: clip_.py
- Notebooks for the experiments explained in the report
Images contains images used in the experiments.
results contains the results obtained from the experiments. Any result generated by the notebooks will be stored in this directory.
Experiments
| Notebook Name | Experiment | Note |
|---|---|---|
| vit_block_vis | Layer-wise Attention Visualization | - |
| saliency_method_compare | ViT Explainability Method Comparison | Qualitative comparison |
| affectnet_emotions | ViT Explainability Method Comparison | Bias comparison; you need to download a sample of the AffectNet dataset here and place it in Images. |
| pos_neg_vis | Positive vs Negative Saliency | - |
| artemis_emotions | Emotion-Image Similarity | you need to download the pre-processed WikiArt images here and place it in Images. Note that this notebook chooses images randomly so the results may not be the same as the ones in the report. |
| perword_vis | Word-Wise Saliency Visualization | |
| global_vis | - | can be used to visualize saliency maps for ViT and ResNet-based CLIP. |