Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
eaddario
/
Watt-Tool-8B-GGUF
like
3
Text Generation
GGUF
eaddario/imatrix-calibration
English
quant
experimental
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Deploy
Use this model
main
Watt-Tool-8B-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
78 commits
eaddario
Update README.md
590426d
verified
16 days ago
imatrix
Regenerate importance matrices
16 days ago
logits
Regenerate logits
16 days ago
scores
Regenerate Perplexity, KLD, ARC, HellaSwag, MMLU, Truthful QA and WinoGrande scores
16 days ago
.gitattributes
Safe
1.65 kB
Update lfs attributes
2 months ago
.gitignore
Safe
6.78 kB
Update lfs attributes and ignores
2 months ago
README.md
15.3 kB
Update README.md
16 days ago
Watt-Tool-8B-F16.gguf
Safe
16.1 GB
LFS
Rename file
about 1 month ago
Watt-Tool-8B-IQ3_M.gguf
3.4 GB
LFS
Selective quantization IQ3_M
16 days ago
Watt-Tool-8B-IQ3_S.gguf
3.24 GB
LFS
Selective quantization IQ3_S
16 days ago
Watt-Tool-8B-IQ4_NL.gguf
4.3 GB
LFS
Selective quantization IQ4_NL
16 days ago
Watt-Tool-8B-Q3_K_L.gguf
3.31 GB
LFS
Selective quantization Q3_K_L
16 days ago
Watt-Tool-8B-Q3_K_M.gguf
3.3 GB
LFS
Selective quantization Q3_K_M
16 days ago
Watt-Tool-8B-Q3_K_S.gguf
3.28 GB
LFS
Selective quantization Q3_K_S
16 days ago
Watt-Tool-8B-Q4_K_M.gguf
4.44 GB
LFS
Selective quantization Q4_K_M
16 days ago
Watt-Tool-8B-Q4_K_S.gguf
4.31 GB
LFS
Selective quantization Q4_K_S
16 days ago
Watt-Tool-8B-Q5_K_M.gguf
5.35 GB
LFS
Selective quantization Q5_K_M
16 days ago
Watt-Tool-8B-Q5_K_S.gguf
5.19 GB
LFS
Selective quantization Q5_K_S
16 days ago
Watt-Tool-8B-Q6_K.gguf
6.17 GB
LFS
Selective quantization Q6_K
16 days ago
Watt-Tool-8B-Q8_0.gguf
7.84 GB
LFS
Selective quantization Q8_0
16 days ago
