FantasiaFoundry
/

GGUF-Quantization-Script

Text Generation

text-generation-inference

Model card Files Files and versions Community

FantasiaFoundry commited on Mar 3

Commit

d578be4

•

1 Parent(s): 08c544d

Update README.md

Files changed (1) hide show

README.md +6 -0

README.md CHANGED Viewed

@@ -1,5 +1,11 @@
 ---
 license: cc-by-nc-4.0
 ---
 Simple python script (`gguf-imat.py`) to generate various GGUF-IQ-Imatrix quantizations from a Hugging Face `author/model` input, for Windows and NVIDIA hardware.

 ---
 license: cc-by-nc-4.0
+inference: false
+pipeline_tag: text-generation
+tags:
+- gguf
+- quantized
+- text-generation-inference
 ---
 Simple python script (`gguf-imat.py`) to generate various GGUF-IQ-Imatrix quantizations from a Hugging Face `author/model` input, for Windows and NVIDIA hardware.