File size: 1,870 Bytes
df6deb6 36cf1d1 df6deb6 36cf1d1 812e760 36cf1d1 0d2cc0b 36cf1d1 1b03d7e 36cf1d1 1b03d7e 36cf1d1 1b03d7e 36cf1d1 1b03d7e 36cf1d1 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 |
---
language:
- en
- de
- fr
- es
- it
library_name: transformers
tags:
- merge
license: other
---
# miiqu-105b-v1.0
Developed by [Infinimol AI GmbH](https://www.infinimol.com/)
Also Available:
- EXL2: [5.0bpw](https://huggingface.co/Infinimol/miiqu-exl2)
- F16: [HF](https://huggingface.co/Infinimol/miiqu-f16)
8th place on [EQ-Bench](https://eqbench.com/), beating Qwen1.5-72B-Chat, miqudev/miqu-1-70b, mistral-medium and claude-3-sonnet-20240229. All without fine-tuning or additional training.
Thanks for support from: [turboderp](https://github.com/turboderp), [silphendio](https://github.com/silphendio), [sqrkl](https://github.com/sqrkl), and [ngxson](https://github.com/ngxson)!
### ❗ Q4_K_M files are split and require joining
**Note:** HF does not support uploading files larger than 50GB. The Q4_K_M files are supplied as split files.
<details><summary>Click for instructions regarding Q4_K_M files</summary>
#### Process
Please download:
- `miiqu.gguf-split-aa`
- `miiqu.gguf-split-ab`
- `miiqu.gguf-split-ac`
- `miiqu.gguf-split-ad`
- `miiqu.gguf-split-ae`
- `miiqu.gguf-split-af`
To join the files, do the following:
Linux and macOS:
```sh
cat miiqu.gguf-split-a* > miiqu_Q4_K_M.gguf && rm miiqu.gguf-split-a*
```
Windows command line:
```cmd
COPY /B miiqu.gguf-split-aa + miiqu.gguf-split-ab + miiqu.gguf-split-ac + miiqu.gguf-split-ad + miiqu.gguf-split-ae + miiqu.gguf-split-af miiqu_Q4_K_M.gguf
DEL miiqu.gguf-split-aa miiqu.gguf-split-ab miiqu.gguf-split-ac miiqu.gguf-split-ad miiqu.gguf-split-ae miiqu.gguf-split-af
```
</details>
## Model Details
- Max Context: 32768 tokens
- Layers: 105
### Prompt template: ChatML or Mistral
chatml:
```
<|im_start|><|user|>\n<|user-message|><|im_end|>\n<|im_start|><|bot|>\n<|bot-message|><|im_end|>\n
```
mistral:
```
[INST] <|user|><|user-message|>[/INST]<|bot|><|bot-message|></s>
``` |