Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
---
|
|
|
1 |
+
## Description
|
2 |
+
|
3 |
+
Quantified [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2/tree/main) into F16 and converted to LLaMa CPP (GGUF) format.
|
4 |
+
|
5 |
+
### About GGUF
|
6 |
+
|
7 |
+
GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
|
8 |
+
|
9 |
+
## Prompt template: ChatML
|
10 |
+
|
11 |
+
```
|
12 |
+
<|im_start|>system
|
13 |
+
{system_message}<|im_end|>
|
14 |
+
<|im_start|>user
|
15 |
+
{prompt}<|im_end|>
|
16 |
+
<|im_start|>assistant
|
17 |
+
|
18 |
+
```
|
19 |
+
|
20 |
---
|
21 |
license: apache-2.0
|
22 |
---
|