Di Zhang
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -19,9 +19,6 @@ should probably proofread and complete it, then remove this comment. -->
|
|
19 |
This model is a fine-tuned version of [SimpleBerry/LLaMA-O1-Base-1127](https://huggingface.co/SimpleBerry/LLaMA-O1-Base-1127) on the [SimpleBerry/OpenLongCoT-SFT](https://huggingface.co/datasets/SimpleBerry/OpenLongCoT-SFT) dataset.
|
20 |
|
21 |
# Inference
|
22 |
-
GGUF: https://huggingface.co/Lyte/LLaMA-O1-Supervised-1129-Q4_K_M-GGUF
|
23 |
-
|
24 |
-
Run with Ollama: `ollama run hf.co/Lyte/LLaMA-O1-Supervised-1129-Q4_K_M-GGUF`
|
25 |
|
26 |
```Python
|
27 |
import json
|
@@ -61,6 +58,10 @@ print(assitant_responses)
|
|
61 |
|
62 |
```
|
63 |
|
|
|
|
|
|
|
|
|
64 |
## Example
|
65 |
|
66 |
```
|
|
|
19 |
This model is a fine-tuned version of [SimpleBerry/LLaMA-O1-Base-1127](https://huggingface.co/SimpleBerry/LLaMA-O1-Base-1127) on the [SimpleBerry/OpenLongCoT-SFT](https://huggingface.co/datasets/SimpleBerry/OpenLongCoT-SFT) dataset.
|
20 |
|
21 |
# Inference
|
|
|
|
|
|
|
22 |
|
23 |
```Python
|
24 |
import json
|
|
|
58 |
|
59 |
```
|
60 |
|
61 |
+
Or GGUF for CPU only devices: https://huggingface.co/Lyte/LLaMA-O1-Supervised-1129-Q4_K_M-GGUF
|
62 |
+
|
63 |
+
Run with Ollama: `ollama run hf.co/Lyte/LLaMA-O1-Supervised-1129-Q4_K_M-GGUF`
|
64 |
+
|
65 |
## Example
|
66 |
|
67 |
```
|