Not-For-All-Audiences

nsfw

text-generation-inference

Model card Files Files and versions Community

BigPlap-8x20B-GGUF

1 contributor

History: 13 commits

TheBloke

Upload README.md

57efc9f 7 months ago

.gitattributes

2.61 kB

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit 919c406) 7 months ago
README.md

15.9 kB

Upload README.md 7 months ago
bigplap-8x20b.Q2_K.gguf

39.4 GB
LFS

GGUF model commit (made with llama.cpp commit 919c406) 7 months ago
bigplap-8x20b.Q3_K_M.gguf-split-a

25.3 GB
LFS

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit 919c406) 7 months ago
bigplap-8x20b.Q3_K_M.gguf-split-b

25.3 GB
LFS

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit 919c406) 7 months ago
bigplap-8x20b.Q4_0.gguf-split-a

32.4 GB
LFS

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit 919c406) 7 months ago
bigplap-8x20b.Q4_0.gguf-split-b

32.4 GB
LFS

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit 919c406) 7 months ago
bigplap-8x20b.Q4_K_M.gguf-split-a

32.4 GB
LFS

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit 919c406) 7 months ago
bigplap-8x20b.Q4_K_M.gguf-split-b

32.4 GB
LFS

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit 919c406) 7 months ago
bigplap-8x20b.Q5_0.gguf-split-a

39.2 GB
LFS

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit 919c406) 7 months ago
bigplap-8x20b.Q5_0.gguf-split-b

39.2 GB
LFS

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit 919c406) 7 months ago
bigplap-8x20b.Q5_K_M.gguf-split-a

39.2 GB
LFS

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit 919c406) 7 months ago
bigplap-8x20b.Q5_K_M.gguf-split-b

39.2 GB
LFS

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit 919c406) 7 months ago
bigplap-8x20b.Q6_K.gguf-split-a

46.4 GB
LFS

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit 919c406) 7 months ago
bigplap-8x20b.Q6_K.gguf-split-b

46.4 GB
LFS

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit 919c406) 7 months ago
bigplap-8x20b.Q8_0.gguf-split-a

39.7 GB
LFS

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit 919c406) 7 months ago
bigplap-8x20b.Q8_0.gguf-split-b

39.7 GB
LFS

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit 919c406) 7 months ago
bigplap-8x20b.Q8_0.gguf-split-c

39.7 GB
LFS

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit 919c406) 7 months ago
config.json

31 Bytes

GGUF model commit (made with llama.cpp commit 919c406) 7 months ago