Image Feature Extraction
Transformers
Safetensors
dinov2
Inference Endpoints
fepegar commited on
Commit
f8c75fd
1 Parent(s): d3473c8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -9
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  library_name: transformers
3
- tags: []
4
  ---
5
 
6
  # Model card for RAD-DINO
@@ -24,27 +24,28 @@ RAD-DINO is described in detail in [RAD-DINO: Exploring Scalable Medical Image E
24
 
25
  <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
26
 
27
- ### Downstream use
 
 
 
28
 
29
  <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
30
 
31
- RAD-DINO is a vision backbone that can be plugged to other models for downstream tasks.
32
  Some potential uses are:
33
 
34
  - Image classification, with a classifier trained on top of the `CLS` token
35
  - Image segmentation, with a decoder trained using the patch tokens
 
36
  - Image retrieval, using nearest neighbors of the CLS token
37
  - Report generation, with a language model to decode text
38
 
39
  Fine-tuning RAD-DINO is typically not necessary to obtain good performance in downstream tasks.
40
 
41
- ### Out-of-scope use
42
 
43
  <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
44
 
45
- This model is shared for research purposes only.
46
- It is not meant to be used for clinical practice.
47
-
48
  ## Bias, risks, and limitations
49
 
50
  <!-- This section is meant to convey both technical and sociotechnical limitations. -->
@@ -116,7 +117,8 @@ torch.Size([1, 768, 16, 16])
116
  <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
117
 
118
  We used images from five public, deidentified chest X-ray datasets to train this checkpoint of RAD-DINO.
119
- Images in the validation and test sets from [MAIRA-1](https://arxiv.org/abs/2311.13668) were excluded from the training set of RAD-DINO.
 
120
 
121
  | Dataset | Num. images |
122
  | --------- | ----------: |
@@ -218,4 +220,4 @@ We used [SimpleITK](https://simpleitk.org/) and [Pydicom](https://pydicom.github
218
 
219
  ## Model card contact
220
 
221
- Fernando Pérez-García ([`fperezgarcia@microsoft.com`](mailto:fperezgarcia@microsoft.com)).
 
1
  ---
2
  library_name: transformers
3
+ license: mit
4
  ---
5
 
6
  # Model card for RAD-DINO
 
24
 
25
  <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
26
 
27
+ RAD-DINO is shared for research purposes only.
28
+ It is **not meant to be used for clinical practice**.
29
+
30
+ <!-- ### Downstream use -->
31
 
32
  <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
33
 
34
+ The model is a vision backbone that can be plugged to other models for downstream tasks.
35
  Some potential uses are:
36
 
37
  - Image classification, with a classifier trained on top of the `CLS` token
38
  - Image segmentation, with a decoder trained using the patch tokens
39
+ - Clustering, using the image embeddings directly
40
  - Image retrieval, using nearest neighbors of the CLS token
41
  - Report generation, with a language model to decode text
42
 
43
  Fine-tuning RAD-DINO is typically not necessary to obtain good performance in downstream tasks.
44
 
45
+ <!-- ### Out-of-scope use -->
46
 
47
  <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
48
 
 
 
 
49
  ## Bias, risks, and limitations
50
 
51
  <!-- This section is meant to convey both technical and sociotechnical limitations. -->
 
117
  <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
118
 
119
  We used images from five public, deidentified chest X-ray datasets to train this checkpoint of RAD-DINO.
120
+ Images in the validation and test sets used to train [MAIRA](https://arxiv.org/abs/2311.13668) were excluded from the training set of RAD-DINO.
121
+ The list of image files used for training is available at [`./training_images.csv`](./training_images.csv).
122
 
123
  | Dataset | Num. images |
124
  | --------- | ----------: |
 
220
 
221
  ## Model card contact
222
 
223
+ Fernando Pérez-García ([`fperezgarcia@microsoft.com`](mailto:fperezgarcia@microsoft.com)).