dranger003
/

bagel-dpo-34b-v0.5-iMat.GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

bagel-dpo-34b-v0.5-iMat.GGUF

2 contributors

History: 10 commits

dranger003's picture

Upload ggml-bagel-dpo-34b-v0.5-iq3_xs.gguf with huggingface_hub

28cc820 verified 7 months ago

.gitattributes

2.02 kB

Upload ggml-bagel-dpo-34b-v0.5-iq3_xs.gguf with huggingface_hub 7 months ago
README.md

843 Bytes

Update README.md 7 months ago
ggml-bagel-dpo-34b-v0.5-f16-imatrix.dat

15.3 MB
LFS

Upload ggml-bagel-dpo-34b-v0.5-f16-imatrix.dat with huggingface_hub 7 months ago
ggml-bagel-dpo-34b-v0.5-iq2_xs.gguf

10.3 GB
LFS

Upload ggml-bagel-dpo-34b-v0.5-iq2_xs.gguf with huggingface_hub 7 months ago
ggml-bagel-dpo-34b-v0.5-iq3_xs.gguf

14.2 GB
LFS

Upload ggml-bagel-dpo-34b-v0.5-iq3_xs.gguf with huggingface_hub 7 months ago
ggml-bagel-dpo-34b-v0.5-iq4_xs.gguf

18.5 GB
LFS

Upload ggml-bagel-dpo-34b-v0.5-iq4_xs.gguf with huggingface_hub 7 months ago
ggml-bagel-dpo-34b-v0.5-q5_k.gguf

24.3 GB
LFS

Upload ggml-bagel-dpo-34b-v0.5-q5_k.gguf with huggingface_hub 7 months ago
ggml-bagel-dpo-34b-v0.5-q6_k.gguf

28.2 GB
LFS

Upload ggml-bagel-dpo-34b-v0.5-q6_k.gguf with huggingface_hub 7 months ago
ggml-bagel-dpo-34b-v0.5-q8_0.gguf

36.5 GB
LFS

Upload ggml-bagel-dpo-34b-v0.5-q8_0.gguf with huggingface_hub 7 months ago