s-emanuilov
commited on
Commit
•
ccd0db3
1
Parent(s):
deecdec
Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,30 @@
|
|
1 |
---
|
2 |
license: mit
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: mit
|
3 |
+
language:
|
4 |
+
- en
|
5 |
---
|
6 |
+
# CLIP ViT-B/32 in OpenVINO™ format
|
7 |
+
|
8 |
+
## Original model details
|
9 |
+
|
10 |
+
The CLIP model was developed by researchers at OpenAI to learn about what contributes to robustness in computer vision tasks. The model was also developed to test the ability of models to generalize to arbitrary image classification tasks in a zero-shot manner. It was not developed for general model deployment - to deploy models like CLIP, researchers will first need to carefully study their capabilities in relation to the specific context they’re being deployed within.
|
11 |
+
|
12 |
+
## Model type
|
13 |
+
The model uses a ViT-B/32 Transformer architecture as an image encoder and uses a masked self-attention Transformer as a text encoder. These encoders are trained to maximize the similarity of (image, text) pairs via a contrastive loss.
|
14 |
+
|
15 |
+
## OpenVINO optimization
|
16 |
+
|
17 |
+
To increase the efficiency of the model during inference, we utilized the OpenVINO™ toolkit for optimization. The table below showcases the inference time improvements achieved with OpenVINO™ compared to the original PyTorch implementation:
|
18 |
+
|
19 |
+
| Metric | PyTorch Inference Time (seconds) | OpenVINO Inference Time (seconds) | Similarity |
|
20 |
+
|:-------------------|-----------------------------------:|------------------------------------:|-------------:|
|
21 |
+
| Mean | 0.518564 | 0.461107 | 1 |
|
22 |
+
| Standard Deviation | 0.109119 | 0.0917191 | 0 |
|
23 |
+
| Min | 0.390102 | 0.360006 | 1 |
|
24 |
+
| Max | 0.699677 | 0.620042 | 1 |
|
25 |
+
|
26 |
+
The results indicate that the OpenVINO™ optimization provides a consistent improvement in inference time while maintaining the same level of accuracy (as indicated by the similarity score).
|
27 |
+
|
28 |
+
## Usage
|
29 |
+
|
30 |
+
You can utilize this optimized model for faster inferences in environments where time is a critical factor. Ensure you have the necessary libraries and dependencies installed to leverage the power of OpenVINO™.
|