TheBloke
/

Yarn-Llama-2-13B-128K-GGUF

text-generation-inference

Model card Files Files and versions Community

Yarn-Llama-2-13B-128K-GGUF

1 contributor

History: 19 commits

TheBloke's picture

Initial GGUF model commit (model made with llama.cpp commit 9217721)

dbf3479 10 months ago

.gitattributes

2.35 kB

Initial GGUF model commit 10 months ago
LICENSE.txt

7.02 kB

Add Llama 2 license files 10 months ago
Notice

112 Bytes

Add Llama 2 license files 10 months ago
README.md

15.5 kB

Initial GGUF model commit 10 months ago
USE_POLICY.md

4.77 kB

Add Llama 2 license files 10 months ago
config.json

29 Bytes

Initial GGUF model commit 10 months ago
yarn-llama-2-13b-128k.Q2_K.gguf

5.43 GB
LFS

Initial GGUF model commit (model made with llama.cpp commit 9217721) 10 months ago
yarn-llama-2-13b-128k.Q3_K_L.gguf

6.93 GB
LFS

Initial GGUF model commit 10 months ago
yarn-llama-2-13b-128k.Q3_K_M.gguf

6.34 GB
LFS

Initial GGUF model commit 10 months ago
yarn-llama-2-13b-128k.Q3_K_S.gguf

5.66 GB
LFS

Initial GGUF model commit 10 months ago
yarn-llama-2-13b-128k.Q4_0.gguf

7.37 GB
LFS

Initial GGUF model commit 10 months ago
yarn-llama-2-13b-128k.Q4_K_M.gguf

7.87 GB
LFS

Initial GGUF model commit 10 months ago
yarn-llama-2-13b-128k.Q4_K_S.gguf

7.41 GB
LFS

Initial GGUF model commit 10 months ago
yarn-llama-2-13b-128k.Q5_0.gguf

8.97 GB
LFS

Initial GGUF model commit 10 months ago
yarn-llama-2-13b-128k.Q5_K_M.gguf

9.23 GB
LFS

Initial GGUF model commit 10 months ago
yarn-llama-2-13b-128k.Q5_K_S.gguf

8.97 GB
LFS

Initial GGUF model commit 10 months ago
yarn-llama-2-13b-128k.Q6_K.gguf

10.7 GB
LFS

Initial GGUF model commit 10 months ago
yarn-llama-2-13b-128k.Q8_0.gguf

13.8 GB
LFS

Initial GGUF model commit 10 months ago