LoneStriker

/

Meta-Llama-3-70B-Instruct-2.4bpw-h6-exl2

like 0

Hello.
Is there any chances for 2.25 bpw quant? 2.4 is to huge for rope scaling on single 24gb gpu even with cache_4bit