FluffyKaeloky
/

Euryale-Inverted-L2-70B-exl2-6.0bpw

Text Generation

text-generation-inference

Model card Files Files and versions Community

Edit model card

Exl2 version of Sao10K's Euryale-Inverted-L2-70B.

6.0 bpw version.

Model original card : https://huggingface.co/Sao10K/Euryale-Inverted-L2-70B

Tested with 16K context with alpha value, fits just below 60Gb of VRAM divided over 3 GPUs.

Downloads last month: -; Downloads are not tracked for this model. How to track