Not-For-All-Audiences

Model card Files Files and versions Community

Spicyboros-70B-2.2-GGUF

1 contributor

History: 20 commits

TheBloke

GGUF model commit (made with llama.cpp commit 71ca2fa)

98e1ace about 1 year ago

.gitattributes

2.48 kB

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit d54a402) about 1 year ago
LICENSE.txt

7.02 kB

Add Llama 2 license files about 1 year ago
Notice

112 Bytes

Add Llama 2 license files about 1 year ago
README.md

35.5 kB

Upload README.md about 1 year ago
USE_POLICY.md

4.77 kB

Add Llama 2 license files about 1 year ago
config.json

29 Bytes

GGUF model commit (made with llama.cpp commit d54a402) about 1 year ago
spicyboros-70b-2.2.Q2_K.gguf

29.3 GB
LFS

GGUF model commit (made with llama.cpp commit 71ca2fa) about 1 year ago
spicyboros-70b-2.2.Q3_K_L.gguf

36.1 GB
LFS

GGUF model commit (made with llama.cpp commit d54a402) about 1 year ago
spicyboros-70b-2.2.Q3_K_M.gguf

33.2 GB
LFS

GGUF model commit (made with llama.cpp commit 71ca2fa) about 1 year ago
spicyboros-70b-2.2.Q3_K_S.gguf

29.9 GB
LFS

GGUF model commit (made with llama.cpp commit 71ca2fa) about 1 year ago
spicyboros-70b-2.2.Q4_0.gguf

38.9 GB
LFS

GGUF model commit (made with llama.cpp commit d54a402) about 1 year ago
spicyboros-70b-2.2.Q4_K_M.gguf

41.4 GB
LFS

GGUF model commit (made with llama.cpp commit d54a402) about 1 year ago
spicyboros-70b-2.2.Q4_K_S.gguf

39.1 GB
LFS

GGUF model commit (made with llama.cpp commit d54a402) about 1 year ago
spicyboros-70b-2.2.Q5_0.gguf

47.5 GB
LFS

GGUF model commit (made with llama.cpp commit d54a402) about 1 year ago
spicyboros-70b-2.2.Q5_K_M.gguf

48.8 GB
LFS

GGUF model commit (made with llama.cpp commit d54a402) about 1 year ago
spicyboros-70b-2.2.Q5_K_S.gguf

47.5 GB
LFS

GGUF model commit (made with llama.cpp commit d54a402) about 1 year ago
spicyboros-70b-2.2.Q6_K.gguf-split-a

28.3 GB
LFS

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit d54a402) about 1 year ago
spicyboros-70b-2.2.Q6_K.gguf-split-b

28.3 GB
LFS

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit d54a402) about 1 year ago
spicyboros-70b-2.2.Q8_0.gguf-split-a

36.6 GB
LFS

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit d54a402) about 1 year ago
spicyboros-70b-2.2.Q8_0.gguf-split-b

36.6 GB
LFS

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit d54a402) about 1 year ago