Not-For-All-Audiences

text-generation-inference

Model card Files Files and versions Community

Spicyboros-70B-2.2-GGUF

1 contributor

History: 23 commits

TheBloke

GGUF model commit (made with llama.cpp commit 71ca2fa)

5a95e0a 12 months ago

.gitattributes

2.48 kB

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit d54a402) 12 months ago
LICENSE.txt

7.02 kB

Add Llama 2 license files 12 months ago
Notice

112 Bytes

Add Llama 2 license files 12 months ago
README.md

35.5 kB

Upload README.md 12 months ago
USE_POLICY.md

4.77 kB

Add Llama 2 license files 12 months ago
config.json

29 Bytes

GGUF model commit (made with llama.cpp commit d54a402) 12 months ago
spicyboros-70b-2.2.Q2_K.gguf

29.3 GB
LFS

GGUF model commit (made with llama.cpp commit 71ca2fa) 12 months ago
spicyboros-70b-2.2.Q3_K_L.gguf

36.1 GB
LFS

GGUF model commit (made with llama.cpp commit 71ca2fa) 12 months ago
spicyboros-70b-2.2.Q3_K_M.gguf

33.2 GB
LFS

GGUF model commit (made with llama.cpp commit 71ca2fa) 12 months ago
spicyboros-70b-2.2.Q3_K_S.gguf

29.9 GB
LFS

GGUF model commit (made with llama.cpp commit 71ca2fa) 12 months ago
spicyboros-70b-2.2.Q4_0.gguf

38.9 GB
LFS

GGUF model commit (made with llama.cpp commit 71ca2fa) 12 months ago
spicyboros-70b-2.2.Q4_K_M.gguf

41.4 GB
LFS

GGUF model commit (made with llama.cpp commit d54a402) 12 months ago
spicyboros-70b-2.2.Q4_K_S.gguf

39.1 GB
LFS

GGUF model commit (made with llama.cpp commit 71ca2fa) 12 months ago
spicyboros-70b-2.2.Q5_0.gguf

47.5 GB
LFS

GGUF model commit (made with llama.cpp commit d54a402) 12 months ago
spicyboros-70b-2.2.Q5_K_M.gguf

48.8 GB
LFS

GGUF model commit (made with llama.cpp commit d54a402) 12 months ago
spicyboros-70b-2.2.Q5_K_S.gguf

47.5 GB
LFS

GGUF model commit (made with llama.cpp commit d54a402) 12 months ago
spicyboros-70b-2.2.Q6_K.gguf-split-a

28.3 GB
LFS

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit d54a402) 12 months ago
spicyboros-70b-2.2.Q6_K.gguf-split-b

28.3 GB
LFS

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit d54a402) 12 months ago
spicyboros-70b-2.2.Q8_0.gguf-split-a

36.6 GB
LFS

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit d54a402) 12 months ago
spicyboros-70b-2.2.Q8_0.gguf-split-b

36.6 GB
LFS

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit d54a402) 12 months ago