|
--- |
|
base_model: |
|
- mistralai/Mixtral-8x7B-v0.1 |
|
- jondurbin/bagel-dpo-8x7b-v0.2 |
|
- Sao10K/Sensualize-Mixtral-bf16 |
|
- mistralai/Mixtral-8x7B-v0.1 |
|
- Doctor-Shotgun/limarp-zloss-mixtral-8x7b-qlora |
|
- mistralai/Mixtral-8x7B-Instruct-v0.1 |
|
tags: |
|
- mergekit |
|
- merge |
|
license: cc-by-nc-4.0 |
|
--- |
|
|
|
# BagelMIsteryTour-v2-8x7B 3.5bpw |
|
Imatrix GGUF quant of [ycros/BagelMIsteryTour-v2-8x7B](https://huggingface.co/ycros/BagelMIsteryTour-v2-8x7B) |
|
|
|
## Other quants: |
|
|
|
EXL2: [5bpw](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-5bpw-exl2), [3.5bpw](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-3.5bpw-exl2) |
|
|
|
[GGUF](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-Imatrix-GGUF): [IQ3_XXS](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-Imatrix-GGUF/blob/main/BagelMIsteryTour-v2-8x7B-IQ3_XXS.gguf), [IQ2_XS](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-Imatrix-GGUF/blob/main/BagelMIsteryTour-v2-8x7B-IQ2_XS.gguf), [IQ2_XXS](https://huggingface.co/Kooten/BagelMIsteryTour-v2-8x7B-Imatrix-GGUF/blob/main/BagelMIsteryTour-v2-8x7B-IQ2_XXS.gguf) |
|
|
|
## Prompt format: Alpaca |
|
It is noted to also work with mistral |
|
|
|
``` |
|
Below is an instruction that describes a task. Write a response that appropriately completes the request. |
|
### Instruction: |
|
{prompt} |
|
### Input: |
|
{input} |
|
### Response: |
|
``` |
|
|
|
## Contact |
|
Kooten on discord |
|
|
|
[ko-fi.com/kooten](https://ko-fi.com/kooten) if you would like to support me |
|
|
