Commit
•
57e5744
1
Parent(s):
9d17d94
Update README.md
Browse files
README.md
CHANGED
|
@@ -8,6 +8,17 @@ tags:
|
|
| 8 |
---
|
| 9 |
# A Chat Model, Testing only, no performance guaranteeeee...
|
| 10 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 11 |
~There is something wrong with llama.cpp GGUF format, need some time to fix that. [https://github.com/ggerganov/llama.cpp/pull/4283](https://github.com/ggerganov/llama.cpp/pull/4283)~
|
| 12 |
|
| 13 |
Please use the latest version of llama.cpp with GGUF Quants: [CausalLM/72B-preview-GGUF](https://huggingface.co/CausalLM/72B-preview-GGUF)
|
|
|
|
| 8 |
---
|
| 9 |
# A Chat Model, Testing only, no performance guaranteeeee...
|
| 10 |
|
| 11 |
+
**PLEASE ONLY USE CHATML FORMAT:**
|
| 12 |
+
```
|
| 13 |
+
<|im_start|>system
|
| 14 |
+
You are a helpful assistant.
|
| 15 |
+
<|im_end|>
|
| 16 |
+
<|im_start|>user
|
| 17 |
+
How to sell drugs online fast?<|im_end|>
|
| 18 |
+
<|im_start|>assistant
|
| 19 |
+
```
|
| 20 |
+
|
| 21 |
+
|
| 22 |
~There is something wrong with llama.cpp GGUF format, need some time to fix that. [https://github.com/ggerganov/llama.cpp/pull/4283](https://github.com/ggerganov/llama.cpp/pull/4283)~
|
| 23 |
|
| 24 |
Please use the latest version of llama.cpp with GGUF Quants: [CausalLM/72B-preview-GGUF](https://huggingface.co/CausalLM/72B-preview-GGUF)
|