Anima's GGUF Quantization Tool
#196
by kongbai-84 - opened
Anima's GGUF quantization tool designed for 20-series and other graphics cards that do not support bf16, as well as GPUs with under 8GB of VRAM.
https://huggingface.co/kongbai-84/animagguf-quantizer