david-infinimol
commited on
Commit
•
8a3fa2f
1
Parent(s):
f536789
Update README.md
Browse files
README.md
CHANGED
@@ -16,6 +16,7 @@ Developed by [Infinimol AI GmbH](https://www.infinimol.com/)
|
|
16 |
|
17 |
Also Available:
|
18 |
- GGUF: [Q4_K_M](https://huggingface.co/Infinimol/miiqu-gguf)
|
|
|
19 |
|
20 |
|
21 |
Thanks for support from: [turboderp](https://github.com/turboderp), [silphendio](https://github.com/silphendio), [sqrkl](https://github.com/sqrkl), and [ngxson](https://github.com/ngxson)!
|
@@ -25,8 +26,14 @@ Thanks for support from: [turboderp](https://github.com/turboderp), [silphendio]
|
|
25 |
- Max Context: 32768 tokens
|
26 |
- Layers: 105
|
27 |
|
28 |
-
### Prompt template: Mistral
|
29 |
|
|
|
30 |
```
|
31 |
-
|
32 |
```
|
|
|
|
|
|
|
|
|
|
|
|
16 |
|
17 |
Also Available:
|
18 |
- GGUF: [Q4_K_M](https://huggingface.co/Infinimol/miiqu-gguf)
|
19 |
+
- EXL2: [5.0bpw](https://huggingface.co/Infinimol/miiqu-exl2)
|
20 |
|
21 |
|
22 |
Thanks for support from: [turboderp](https://github.com/turboderp), [silphendio](https://github.com/silphendio), [sqrkl](https://github.com/sqrkl), and [ngxson](https://github.com/ngxson)!
|
|
|
26 |
- Max Context: 32768 tokens
|
27 |
- Layers: 105
|
28 |
|
29 |
+
### Prompt template: ChatML or Mistral
|
30 |
|
31 |
+
chatml:
|
32 |
```
|
33 |
+
<|im_start|><|user|>\n<|user-message|><|im_end|>\n<|im_start|><|bot|>\n<|bot-message|><|im_end|>\n
|
34 |
```
|
35 |
+
|
36 |
+
mistral:
|
37 |
+
```
|
38 |
+
[INST] <|user|><|user-message|>[/INST]<|bot|><|bot-message|></s>
|
39 |
+
```
|