Hugging Face's logo

Kooten
/
Echidna-13b-v0.1-3bpw-h8-exl2

Text Generation
Transformers
Safetensors
llama
Not-For-All-Audiences
nsfw
text-generation-inference
Inference Endpoints
Model card Files Community

Description

Exllama 2 quant of NeverSleep/Echidna-13b-v0.1

3 BPW, Head bit set to 8

Prompt template: Alpaca 

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:
Downloads last month
8
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported Inference Providers.

Collection including Kooten/Echidna-13b-v0.1-3bpw-h8-exl2