PrunaAI
/

dolphin-2.9-llama3-70b-GGUF-smashed

Inference Endpoints

Model card Files Files and versions Community

dolphin-2.9-llama3-70b-GGUF-smashed

2 contributors

History: 10 commits

johnrachwanpruna's picture

johnrachwanpruna

Upload dolphin-2.9-llama3-70b.Q3_K_M.gguf with huggingface_hub

95c7e69 verified 7 months ago

.gitattributes

2.24 kB

Upload dolphin-2.9-llama3-70b.Q3_K_M.gguf with huggingface_hub 7 months ago
dolphin-2.9-llama3-70b.IQ3_XS.gguf

29.3 GB
LFS

Upload dolphin-2.9-llama3-70b.IQ3_XS.gguf with huggingface_hub 7 months ago
dolphin-2.9-llama3-70b.Q3_K_L.gguf

37.1 GB
LFS

Upload dolphin-2.9-llama3-70b.Q3_K_L.gguf with huggingface_hub 7 months ago
dolphin-2.9-llama3-70b.Q3_K_M.gguf

34.3 GB
LFS

Upload dolphin-2.9-llama3-70b.Q3_K_M.gguf with huggingface_hub 7 months ago
dolphin-2.9-llama3-70b.Q4_1.gguf

44.3 GB
LFS

Upload dolphin-2.9-llama3-70b.Q4_1.gguf with huggingface_hub 7 months ago
dolphin-2.9-llama3-70b.Q5_1.gguf-00005-of-00006.gguf

9.04 GB
LFS

Upload dolphin-2.9-llama3-70b.Q5_1.gguf-00005-of-00006.gguf with huggingface_hub 7 months ago
dolphin-2.9-llama3-70b.Q6_K.gguf-00002-of-00006.gguf

10.2 GB
LFS

Upload dolphin-2.9-llama3-70b.Q6_K.gguf-00002-of-00006.gguf with huggingface_hub 7 months ago
dolphin-2.9-llama3-70b.Q8_0.gguf-00004-of-00006.gguf

12.8 GB
LFS

Upload dolphin-2.9-llama3-70b.Q8_0.gguf-00004-of-00006.gguf with huggingface_hub 7 months ago
dolphin-2.9-llama3-70b.fp16.bin-00003-of-00006.gguf

24.4 GB
LFS

Upload dolphin-2.9-llama3-70b.fp16.bin-00003-of-00006.gguf with huggingface_hub 7 months ago
dolphin-2.9-llama3-70b.fp16.bin-00004-of-00006.gguf

24.1 GB
LFS

Upload dolphin-2.9-llama3-70b.fp16.bin-00004-of-00006.gguf with huggingface_hub 7 months ago