1 contributor

History: 10 commits

ikawrakow

Adding 2.31-bpw base quantized models

6b581ce 7 months ago

.gitattributes

1.56 kB

Adding first set of models 7 months ago
README.md

156 Bytes

Update README.md 7 months ago
llama-v2-13b-2.17bpw.gguf

3.54 GB
LFS

Adding first set of models 7 months ago
llama-v2-13b-2.39bpw.gguf

3.89 GB
LFS

Adding 2.31-bpw base quantized models 7 months ago
llama-v2-70b-2.12bpw.gguf

18.3 GB
LFS

Adding more 7 months ago
llama-v2-70b-2.36bpw.gguf

20.3 GB
LFS

Adding 2.31-bpw base quantized models 7 months ago
llama-v2-7b-2.20bpw.gguf

1.85 GB
LFS

Adding first set of models 7 months ago
llama-v2-7b-2.42bpw.gguf

2.03 GB
LFS

Adding 2.31-bpw base quantized models 7 months ago
mistral-7b-2.20bpw.gguf

1.99 GB
LFS

Adding first set of models 7 months ago
mistral-7b-2.43bpw.gguf

2.2 GB
LFS

Adding 2.31-bpw base quantized models 7 months ago
mixtral-8x7b-2.10bpw.gguf

12.3 GB
LFS

Adding Mixtral-8x7b 7 months ago
mixtral-8x7b-2.34bpw.gguf

13.7 GB
LFS

Adding 2.31-bpw base quantized models 7 months ago
mixtral-instruct-8x7b-2.10bpw.gguf

12.3 GB
LFS

Adding Mixtral-instruct-8x7b 7 months ago
nous-hermes-2-10.7b-2.18bpw.gguf

2.92 GB
LFS

Adding Nous-Hermes-2-SOLAR-10.7B 2-bit quants 7 months ago
nous-hermes-2-10.7b-2.70bpw.gguf

3.62 GB
LFS

Adding Nous-Hermes-2-SOLAR-10.7B 2-bit quants 7 months ago
nous-hermes-2-34b-2.16bpw.gguf

9.31 GB
LFS

Adding Nous-Hermes-2-Yi-34B 2-bit quants 7 months ago
nous-hermes-2-34b-2.69bpw.gguf

11.6 GB
LFS

Adding Nous-Hermes-2-Yi-34B 2-bit quants 7 months ago
rocket-3b-2.31bpw.gguf

808 MB
LFS

Adding Rocket-3b 2-bit quants 7 months ago
rocket-3b-2.76bpw.gguf

967 MB
LFS

Adding Rocket-3b 2-bit quants 7 months ago