Unsloth 4-bit Dynamic Quants
Collection
Unsloths Dynamic 4bit Quants selectively skips quantizing certain parameters; greatly improving accuracy while only using <10% more VRAM than BnB 4bit
•
27 items
•
Updated
•
71