BagelMIsteryTour-v2-8x7B 4bpw
Exllama quant of ycros/BagelMIsteryTour-v2-8x7B
Other quants:
EXL2: 8bpw, 6bpw, 5bpw, 4bpw, 3.5bpw
Prompt format: Alpaca
It is noted to also work with mistral
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Input:
{input}
### Response:
Contact
Kooten on discord
ko-fi.com/kooten if you would like to support me
- Downloads last month
- 12
This model does not have enough activity to be deployed to Inference API (serverless) yet.
Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.