File size: 1,406 Bytes
9eba7ef c1d0506 9eba7ef |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 |
---
base_model:
- mistralai/Mixtral-8x7B-v0.1
- jondurbin/bagel-dpo-8x7b-v0.2
- Sao10K/Sensualize-Mixtral-bf16
- mistralai/Mixtral-8x7B-v0.1
- Doctor-Shotgun/limarp-zloss-mixtral-8x7b-qlora
- mistralai/Mixtral-8x7B-Instruct-v0.1
tags:
- mergekit
- merge
license: cc-by-nc-4.0
---
# BagelMIsteryTour-v2-8x7B 3.5bpw
Imatrix GGUF quant of [ycros/BagelMIsteryTour-v2-8x7B](https://huggingface.co/ycros/BagelMIsteryTour-v2-8x7B)
## Other quants:
EXL2: [5bpw](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-5bpw-exl2), [3.5bpw](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-3.5bpw-exl2)
[GGUF](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-Imatrix-GGUF): [IQ3_XXS](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-Imatrix-GGUF/blob/main/BagelMIsteryTour-v2-8x7B-IQ3_XXS.gguf), [IQ2_XS](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-Imatrix-GGUF/blob/main/BagelMIsteryTour-v2-8x7B-IQ2_XS.gguf), [IQ2_XXS](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-Imatrix-GGUF/blob/main/BagelMIsteryTour-v2-8x7B-IQ2_XXS.gguf)
## Prompt format: Alpaca
It is noted to also work with mistral
```
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Input:
{input}
### Response:
```
## Contact
Kooten on discord
[ko-fi.com/kooten](https://ko-fi.com/kooten) if you would like to support me
|