Zero-Shot Image Classification
OpenCLIP
clip
visheratin commited on
Commit
119e3b7
1 Parent(s): 5e4b4f1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -2
README.md CHANGED
@@ -3,6 +3,18 @@ tags:
3
  - clip
4
  library_name: open_clip
5
  pipeline_tag: zero-shot-image-classification
6
- license: mit
 
 
7
  ---
8
- # Model card for nllb-clip-base-oc
 
 
 
 
 
 
 
 
 
 
 
3
  - clip
4
  library_name: open_clip
5
  pipeline_tag: zero-shot-image-classification
6
+ license: cc-by-nc-4.0
7
+ datasets:
8
+ - visheratin/laion-coco-nllb
9
  ---
10
+
11
+ ## Model Summary
12
+
13
+ NLLB-CLIP is a model that combines a text encoder from the [NLLB model](https://huggingface.co/facebook/nllb-200-distilled-600M) and an image encoder from the
14
+ standard [CLIP](https://huggingface.co/openai/clip-vit-base-patch32). This allows us to extend the model capabilities
15
+ to 201 languages of the Flores-200. NLLB-CLIP sets state-of-the-art on the [Crossmodal-3600](https://google.github.io/crossmodal-3600/) dataset by performing very
16
+ well on low-resource languages. You can find more details about the model in the [paper](https://arxiv.org/abs/2309.01859).
17
+
18
+ ## Acknowledgements
19
+
20
+ I thank [ML Collective](https://mlcollective.org/) for providing Google Cloud compute resources to train the OpenCLIP-compatible version of NLLB-CLIP.