Rocwo commited on
Commit
0dfdbfd
·
verified ·
1 Parent(s): 61479d0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -0
README.md CHANGED
@@ -1,3 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
  ---
 
1
+ ## Description
2
+
3
+ Quantified [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2/tree/main) into F16 and converted to LLaMa CPP (GGUF) format.
4
+
5
+ ### About GGUF
6
+
7
+ GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
8
+
9
+ ## Prompt template: ChatML
10
+
11
+ ```
12
+ <|im_start|>system
13
+ {system_message}<|im_end|>
14
+ <|im_start|>user
15
+ {prompt}<|im_end|>
16
+ <|im_start|>assistant
17
+
18
+ ```
19
+
20
  ---
21
  license: apache-2.0
22
  ---