Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
dranger003
/
bagel-34b-v0.4-iMat.GGUF
like
1
Text Generation
GGUF
Inference Endpoints
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Deploy
Use this model
426e992
bagel-34b-v0.4-iMat.GGUF
2 contributors
History:
17 commits
dranger003
Upload ggml-bagel-34b-v0.4-iq3_xxs.gguf
426e992
verified
11 months ago
.gitattributes
1.93 kB
Upload ggml-bagel-34b-v0.4-iq2_xs.gguf
11 months ago
README.md
983 Bytes
Update README.md
11 months ago
ggml-bagel-34b-v0.4-iq2_xs.gguf
10.3 GB
LFS
Upload ggml-bagel-34b-v0.4-iq2_xs.gguf
11 months ago
ggml-bagel-34b-v0.4-iq2_xxs.gguf
9.31 GB
LFS
Upload ggml-bagel-34b-v0.4-iq2_xxs.gguf
11 months ago
ggml-bagel-34b-v0.4-iq3_xxs.gguf
13.7 GB
LFS
Upload ggml-bagel-34b-v0.4-iq3_xxs.gguf
11 months ago
ggml-bagel-34b-v0.4-q4_k_m.gguf
20.7 GB
LFS
Upload ggml-bagel-34b-v0.4-q4_k_m.gguf
11 months ago
ggml-bagel-34b-v0.4-q8_0-imatrix.dat
15.3 MB
LFS
Upload ggml-bagel-34b-v0.4-q8_0-imatrix.dat
11 months ago
ggml-bagel-34b-v0.4-q8_0.gguf
36.5 GB
LFS
Upload ggml-bagel-34b-v0.4-q8_0.gguf
11 months ago
