ChantalPellegrini
commited on
Commit
·
4f6ca1e
1
Parent(s):
16c60f0
update readme
Browse files
README.md
CHANGED
@@ -10,32 +10,3 @@ app_file: app.py
|
|
10 |
pinned: false
|
11 |
license: mit
|
12 |
---
|
13 |
-
|
14 |
-
This is the official demo for the paper "Xplainer: From X-Ray Observations to Explainable Zero-Shot Diagnosis" (https://arxiv.org/pdf/2303.13391.pdf), which was accepted for publication at MICCAI 2023.
|
15 |
-
|
16 |
-
We propose a new way of explainability for zero-shot diagnosis prediction in the clinical domain. Instead of directly predicting a diagnosis, we prompt the model to classify the existence of descriptive observations, which a radiologist would look for on an X-Ray scan, and use the descriptor probabilities to estimate the likelihood of a diagnosis, making our model explainable by design. For this we leverage BioVil, a pretrained CLIP model for X-rays and apply contrastive observation-based prompting. We evaluate Xplainer on two chest X-ray
|
17 |
-
datasets, CheXpert and ChestX-ray14, and demonstrate its effectiveness
|
18 |
-
in improving the performance and explainability of zero-shot diagnosis.
|
19 |
-
**Authors**: [Chantal Pellegrini][cp], [Matthias Keicher][mk], [Ege Özsoy][eo], [Petra Jiraskova][pj], [Rickmer Braren][rb], [Nassir Navab][nn]
|
20 |
-
|
21 |
-
[cp]:https://www.cs.cit.tum.de/camp/members/chantal-pellegrini/
|
22 |
-
[eo]:https://www.cs.cit.tum.de/camp/members/ege-oezsoy/
|
23 |
-
[mk]:https://www.cs.cit.tum.de/camp/members/matthias-keicher/
|
24 |
-
[pj]:https://campus.tum.de/tumonline/ee/ui/ca2/app/desktop/#/pl/ui/$ctx/visitenkarte.show_vcard?$ctx=design=ca2;header=max;lang=de&pPersonenGruppe=3&pPersonenId=46F3A857F258DEE6
|
25 |
-
[rb]:https://radiologie.mri.tum.de/de/person/prof-dr-rickmer-f-braren
|
26 |
-
[nn]:https://www.cs.cit.tum.de/camp/members/cv-nassir-navab/nassir-navab/
|
27 |
-
|
28 |
-
Github: https://github.com/ChantalMP/Xplainer/tree/master
|
29 |
-
|
30 |
-
```
|
31 |
-
@inproceedings{pellegrini2023xplainer,
|
32 |
-
title={Xplainer: From X-Ray Observations to Explainable Zero-Shot Diagnosis},
|
33 |
-
author={Pellegrini, Chantal and Keicher, Matthias and Özsoy, Ege and Jiraskova, Petra and Braren, Rickmer and Navab, Nassir},
|
34 |
-
booktitle={International Conference on Medical Image Computing and Computer-Assisted Intervention},
|
35 |
-
year={2023},
|
36 |
-
organization={Springer}
|
37 |
-
}
|
38 |
-
```
|
39 |
-
|
40 |
-
### Intended Use
|
41 |
-
This model is intended to be used solely for (I) future research on visual-language processing and (II) reproducibility of the experimental results reported in the reference paper.
|
|
|
10 |
pinned: false
|
11 |
license: mit
|
12 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|