Hugging Face's logo

second-state
/
CodeLlama-13B-Instruct-GGUF

Text Generation
Transformers
GGUF
code
llama
llama-2
text-generation-inference
Model card Files Community
Xin Liu commited on
Commit
d428853
•
1 Parent(s): 5d48cf3

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (12) hide show
  1. CodeLlama-13b-Instruct-hf-Q2_K.gguf +3 -0
  2. CodeLlama-13b-Instruct-hf-Q3_K_L.gguf +3 -0
  3. CodeLlama-13b-Instruct-hf-Q3_K_M.gguf +3 -0
  4. CodeLlama-13b-Instruct-hf-Q3_K_S.gguf +3 -0
  5. CodeLlama-13b-Instruct-hf-Q4_0.gguf +3 -0
  6. CodeLlama-13b-Instruct-hf-Q4_K_M.gguf +3 -0
  7. CodeLlama-13b-Instruct-hf-Q4_K_S.gguf +3 -0
  8. CodeLlama-13b-Instruct-hf-Q5_0.gguf +3 -0
  9. CodeLlama-13b-Instruct-hf-Q5_K_M.gguf +3 -0
  10. CodeLlama-13b-Instruct-hf-Q5_K_S.gguf +3 -0
  11. CodeLlama-13b-Instruct-hf-Q6_K.gguf +3 -0
  12. CodeLlama-13b-Instruct-hf-Q8_0.gguf +3 -0
CodeLlama-13b-Instruct-hf-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6dfc9309d48fffd2ecbdc0571f96a99da7d7bf094208a713e9a4cb8205546f29
3
+ size 5429442880
CodeLlama-13b-Instruct-hf-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52a7dd56e80f0d362635be72bfc5dc76eda5f4317ab55d6a04f824b1a7b5e798
3
+ size 6929662400
CodeLlama-13b-Instruct-hf-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d62f4656f12c2cc6763c9ea47fc1474dbaa5ab6adee4f3452f91da979fdbbabf
3
+ size 6337872320
CodeLlama-13b-Instruct-hf-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8dbe16cb1b2046faac05e8803822309deb9e1bfc74a4d05c2eefff813e4ae44f
3
+ size 5659083200
CodeLlama-13b-Instruct-hf-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd4e71c660c8d04ec0c12806a69a05651c1882308323714a8e7bf61e94102830
3
+ size 7365948480
CodeLlama-13b-Instruct-hf-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e2ad727d4893bc44add809e992c8f584e4fb1e986163a5b7510e2cc1f34b3c55
3
+ size 7866070080
CodeLlama-13b-Instruct-hf-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:611b17920328206a9c0ae7928c66bb52d6d986ce35a7fd82d9036b0bc9ef1718
3
+ size 7414445120
CodeLlama-13b-Instruct-hf-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aff52f07419e1bfbb452644960b0fa63907f40689f9a85f580e3813ffb54fa3c
3
+ size 8972409920
CodeLlama-13b-Instruct-hf-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b30d01b5a22f2b3dc6cd01084b50114dde5e63cbc240ee7ad20ebbd6c63eab95
3
+ size 9230048320
CodeLlama-13b-Instruct-hf-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5bdcb03bada3c3fa7138752df6c8f804d8fad511e72d97ecdef5bea1adc785b3
3
+ size 8972409920
CodeLlama-13b-Instruct-hf-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b86d1658be2bf2b03d764d3e97e6a19ce6367a301192945a8358d7d51a9c67ed
3
+ size 10679275200
CodeLlama-13b-Instruct-hf-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:44a69ac2d210548b1edc0f0b622a2c196e364d5923f695327c3b506f8581eb95
3
+ size 13831494080