LoneStriker

/

Llama-3-70B-Instruct-Gradient-262k-2.4bpw-h6-exl2

like 0

Could you please quantize it to 2.25 bpw, and maybe even lower? That way we can take advantage of the extended context with a 24 GB card. Thank you!