Devarui379
commited on
Commit
•
d4ea967
1
Parent(s):
adabfc1
Update README.md
Browse files
README.md
CHANGED
@@ -7,12 +7,13 @@ tags:
|
|
7 |
- trl
|
8 |
- sft
|
9 |
- llama-cpp
|
10 |
-
-
|
11 |
licence: license
|
|
|
12 |
---
|
13 |
|
14 |
# Devarui379/llama32-3b-it_CoT-it_SFT_BoN_iter1-Q8_0-GGUF
|
15 |
-
This model was converted to GGUF format
|
16 |
Refer to the [original model card](https://huggingface.co/RyanYr/llama32-3b-it_CoT-it_SFT_BoN_iter1) for more details on the model.
|
17 |
|
18 |
## Use with llama.cpp
|
@@ -53,4 +54,4 @@ Step 3: Run inference through the main binary.
|
|
53 |
or
|
54 |
```
|
55 |
./llama-server --hf-repo Devarui379/llama32-3b-it_CoT-it_SFT_BoN_iter1-Q8_0-GGUF --hf-file llama32-3b-it_cot-it_sft_bon_iter1-q8_0.gguf -c 2048
|
56 |
-
```
|
|
|
7 |
- trl
|
8 |
- sft
|
9 |
- llama-cpp
|
10 |
+
- text-generation-inference
|
11 |
licence: license
|
12 |
+
license: mit
|
13 |
---
|
14 |
|
15 |
# Devarui379/llama32-3b-it_CoT-it_SFT_BoN_iter1-Q8_0-GGUF
|
16 |
+
This model was converted to GGUF format
|
17 |
Refer to the [original model card](https://huggingface.co/RyanYr/llama32-3b-it_CoT-it_SFT_BoN_iter1) for more details on the model.
|
18 |
|
19 |
## Use with llama.cpp
|
|
|
54 |
or
|
55 |
```
|
56 |
./llama-server --hf-repo Devarui379/llama32-3b-it_CoT-it_SFT_BoN_iter1-Q8_0-GGUF --hf-file llama32-3b-it_cot-it_sft_bon_iter1-q8_0.gguf -c 2048
|
57 |
+
```
|