david-infinimol commited on
Commit
8a3fa2f
1 Parent(s): f536789

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -2
README.md CHANGED
@@ -16,6 +16,7 @@ Developed by [Infinimol AI GmbH](https://www.infinimol.com/)
16
 
17
  Also Available:
18
  - GGUF: [Q4_K_M](https://huggingface.co/Infinimol/miiqu-gguf)
 
19
 
20
 
21
  Thanks for support from: [turboderp](https://github.com/turboderp), [silphendio](https://github.com/silphendio), [sqrkl](https://github.com/sqrkl), and [ngxson](https://github.com/ngxson)!
@@ -25,8 +26,14 @@ Thanks for support from: [turboderp](https://github.com/turboderp), [silphendio]
25
  - Max Context: 32768 tokens
26
  - Layers: 105
27
 
28
- ### Prompt template: Mistral
29
 
 
30
  ```
31
- <s>[INST] {prompt}[/INST]
32
  ```
 
 
 
 
 
 
16
 
17
  Also Available:
18
  - GGUF: [Q4_K_M](https://huggingface.co/Infinimol/miiqu-gguf)
19
+ - EXL2: [5.0bpw](https://huggingface.co/Infinimol/miiqu-exl2)
20
 
21
 
22
  Thanks for support from: [turboderp](https://github.com/turboderp), [silphendio](https://github.com/silphendio), [sqrkl](https://github.com/sqrkl), and [ngxson](https://github.com/ngxson)!
 
26
  - Max Context: 32768 tokens
27
  - Layers: 105
28
 
29
+ ### Prompt template: ChatML or Mistral
30
 
31
+ chatml:
32
  ```
33
+ <|im_start|><|user|>\n<|user-message|><|im_end|>\n<|im_start|><|bot|>\n<|bot-message|><|im_end|>\n
34
  ```
35
+
36
+ mistral:
37
+ ```
38
+ [INST] <|user|><|user-message|>[/INST]<|bot|><|bot-message|></s>
39
+ ```