echarlaix HF staff commited on
Commit
34fd070
1 Parent(s): d012f11

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +37 -0
README.md ADDED
@@ -0,0 +1,37 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: microsoft/Phi-3-mini-4k-instruct
3
+ language:
4
+ - en
5
+ license: mit
6
+ license_link: https://huggingface.co/microsoft/Phi-3-mini-4k-instruct/resolve/main/LICENSE
7
+ pipeline_tag: text-generation
8
+ tags:
9
+ - nlp
10
+ - code
11
+ - openvino
12
+ inference:
13
+ parameters:
14
+ temperature: 0.0
15
+ widget:
16
+ - messages:
17
+ - role: user
18
+ content: Can you provide ways to eat combinations of bananas and dragonfruits?
19
+ ---
20
+
21
+ This model was converted to OpenVINO from [`microsoft/Phi-3-mini-4k-instruct`](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct) using [optimum-intel](https://github.com/huggingface/optimum-intel)
22
+ via the [export](https://huggingface.co/spaces/echarlaix/openvino-export) space.
23
+
24
+ First make sure you have optimum-intel installed:
25
+
26
+ ```bash
27
+ pip install optimum[openvino]
28
+ ```
29
+
30
+ To load your model you can do as follows:
31
+
32
+ ```python
33
+ from optimum.intel import OVModelForCausalLM
34
+
35
+ model_id = "echarlaix/Phi-3-mini-4k-instruct-openvino"
36
+ model = OVModelForCausalLM.from_pretrained(model_id)
37
+ ```