s-emanuilov commited on
Commit
ccd0db3
1 Parent(s): deecdec

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -0
README.md CHANGED
@@ -1,3 +1,30 @@
1
  ---
2
  license: mit
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
+ language:
4
+ - en
5
  ---
6
+ # CLIP ViT-B/32 in OpenVINO™ format
7
+
8
+ ## Original model details
9
+
10
+ The CLIP model was developed by researchers at OpenAI to learn about what contributes to robustness in computer vision tasks. The model was also developed to test the ability of models to generalize to arbitrary image classification tasks in a zero-shot manner. It was not developed for general model deployment - to deploy models like CLIP, researchers will first need to carefully study their capabilities in relation to the specific context they’re being deployed within.
11
+
12
+ ## Model type
13
+ The model uses a ViT-B/32 Transformer architecture as an image encoder and uses a masked self-attention Transformer as a text encoder. These encoders are trained to maximize the similarity of (image, text) pairs via a contrastive loss.
14
+
15
+ ## OpenVINO optimization
16
+
17
+ To increase the efficiency of the model during inference, we utilized the OpenVINO™ toolkit for optimization. The table below showcases the inference time improvements achieved with OpenVINO™ compared to the original PyTorch implementation:
18
+
19
+ | Metric | PyTorch Inference Time (seconds) | OpenVINO Inference Time (seconds) | Similarity |
20
+ |:-------------------|-----------------------------------:|------------------------------------:|-------------:|
21
+ | Mean | 0.518564 | 0.461107 | 1 |
22
+ | Standard Deviation | 0.109119 | 0.0917191 | 0 |
23
+ | Min | 0.390102 | 0.360006 | 1 |
24
+ | Max | 0.699677 | 0.620042 | 1 |
25
+
26
+ The results indicate that the OpenVINO™ optimization provides a consistent improvement in inference time while maintaining the same level of accuracy (as indicated by the similarity score).
27
+
28
+ ## Usage
29
+
30
+ You can utilize this optimized model for faster inferences in environments where time is a critical factor. Ensure you have the necessary libraries and dependencies installed to leverage the power of OpenVINO™.