Merge branch 'main' of hf.co:atamurad/llama2-7b-4bit-awq into main
Browse files
README.md
CHANGED
@@ -12,18 +12,27 @@ Inference code: https://github.com/atamurad/llama2.c/tree/int4-avx2
|
|
12 |
|
13 |
## Sample usage/prompt format:
|
14 |
|
15 |
-
Hello World
|
|
|
16 |
```
|
17 |
./run llama2-7b-4bit-awq/llama2-7b-chat.awq -p 0.0 -i "[INST] say hi [/INST]"
|
18 |
-
|
|
|
|
|
|
|
19 |
|
20 |
Feel free to start a conversation or ask me anything, I'm here to assist you! *hi five*
|
21 |
```
|
22 |
|
23 |
-
Sample #2:
|
|
|
24 |
```
|
25 |
./run llama2-7b-4bit-awq/llama2-7b-chat.awq -p 0.9 -t 0.0 -i "[INST] write a poem about math [/INST]"
|
26 |
-
|
|
|
|
|
|
|
|
|
27 |
nobody knows the secrets I hold
|
28 |
In numbers and formulas, I'm told
|
29 |
From pi to infinity, I'm the key
|
|
|
12 |
|
13 |
## Sample usage/prompt format:
|
14 |
|
15 |
+
### Hello World
|
16 |
+
Command / Prompt:
|
17 |
```
|
18 |
./run llama2-7b-4bit-awq/llama2-7b-chat.awq -p 0.0 -i "[INST] say hi [/INST]"
|
19 |
+
```
|
20 |
+
Output:
|
21 |
+
```
|
22 |
+
Sure, I'd be happy to say hi to you! *smiling face* How are you today? Is there anything you'd like to chat about or ask me? I'm here to help with any questions you may have.
|
23 |
|
24 |
Feel free to start a conversation or ask me anything, I'm here to assist you! *hi five*
|
25 |
```
|
26 |
|
27 |
+
### Sample #2:
|
28 |
+
Command / Prompt:
|
29 |
```
|
30 |
./run llama2-7b-4bit-awq/llama2-7b-chat.awq -p 0.9 -t 0.0 -i "[INST] write a poem about math [/INST]"
|
31 |
+
```
|
32 |
+
|
33 |
+
Output:
|
34 |
+
```
|
35 |
+
Sure! Here's a poem about math:
|
36 |
nobody knows the secrets I hold
|
37 |
In numbers and formulas, I'm told
|
38 |
From pi to infinity, I'm the key
|