ShiveringSpine
/

Euryale-1.4-L2-70B-5.0bpw-h6-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Euryale-1.4-L2-70B-5.0bpw-h6-exl2 / README.md

ShiveringSpine's picture

Update README.md

ed19e2c 12 months ago

|

165 Bytes

	---
	license: llama2
	---

	exl2 quantization of Sao10K/Euryale-1.4-L2-70B

	I haven't tested perplexity of this, but it seems to work fine compared to Euryale 1.3 5bpw.