Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
FantasiaFoundry
/
GGUF-Quantization-Script
like
47
Text Generation
GGUF
quantized
text-generation-inference
License:
cc-by-nc-4.0
Model card
Files
Files and versions
Community
35
Deploy
Use this model
refs/pr/35
GGUF-Quantization-Script
3 contributors
History:
74 commits
Lewdiculous
match new script name
8c83b2b
verified
15 days ago
imatrix
Upload 2 files
5 months ago
.gitattributes
1.52 kB
initial commit
5 months ago
README.md
4.39 kB
Update README.md
about 1 month ago
gguf-imat-for-FP16.py
7.71 kB
Update Windows executable naming as per llama.cpp changes
about 1 month ago
gguf-imat-lossless-for-BF16.py
8.36 kB
match new script name
15 days ago
gguf-imat.py
7.7 kB
Forgot to double check. (#24)
3 months ago
requirements.txt
500 Bytes
Upload requirements.txt
about 2 months ago