Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
TheBloke
/
nontoxic-bagel-34b-v0.2-GGUF
like
3
Transformers
GGUF
29 datasets
yi
License:
yi-license
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
nontoxic-bagel-34b-v0.2-GGUF
1 contributor
History:
17 commits
TheBloke
Upload README.md
af620f6
10 months ago
.gitattributes
Safe
2.37 kB
GGUF model commit (made with llama.cpp commit 26f3071)
10 months ago
README.md
Safe
28 kB
Upload README.md
10 months ago
config.json
Safe
26 Bytes
GGUF model commit (made with llama.cpp commit 26f3071)
10 months ago
nontoxic-bagel-34b-v0.2.Q2_K.gguf
Safe
14.6 GB
LFS
GGUF model commit (made with llama.cpp commit 26f3071)
10 months ago
nontoxic-bagel-34b-v0.2.Q3_K_L.gguf
Safe
18.1 GB
LFS
GGUF model commit (made with llama.cpp commit 26f3071)
10 months ago
nontoxic-bagel-34b-v0.2.Q3_K_M.gguf
Safe
16.6 GB
LFS
GGUF model commit (made with llama.cpp commit 26f3071)
10 months ago
nontoxic-bagel-34b-v0.2.Q3_K_S.gguf
Safe
15 GB
LFS
GGUF model commit (made with llama.cpp commit 26f3071)
10 months ago
nontoxic-bagel-34b-v0.2.Q4_0.gguf
Safe
19.5 GB
LFS
GGUF model commit (made with llama.cpp commit 26f3071)
10 months ago
nontoxic-bagel-34b-v0.2.Q4_K_M.gguf
Safe
20.7 GB
LFS
GGUF model commit (made with llama.cpp commit 26f3071)
10 months ago
nontoxic-bagel-34b-v0.2.Q4_K_S.gguf
Safe
19.5 GB
LFS
GGUF model commit (made with llama.cpp commit 26f3071)
10 months ago
nontoxic-bagel-34b-v0.2.Q5_0.gguf
Safe
23.7 GB
LFS
GGUF model commit (made with llama.cpp commit 26f3071)
10 months ago
nontoxic-bagel-34b-v0.2.Q5_K_M.gguf
Safe
24.3 GB
LFS
GGUF model commit (made with llama.cpp commit 26f3071)
10 months ago
nontoxic-bagel-34b-v0.2.Q5_K_S.gguf
Safe
23.7 GB
LFS
GGUF model commit (made with llama.cpp commit 26f3071)
10 months ago
nontoxic-bagel-34b-v0.2.Q6_K.gguf
Safe
28.2 GB
LFS
GGUF model commit (made with llama.cpp commit 26f3071)
10 months ago
nontoxic-bagel-34b-v0.2.Q8_0.gguf
Safe
36.5 GB
LFS
GGUF model commit (made with llama.cpp commit 26f3071)
10 months ago