Hugging Face's logo

second-state
/
Llama-2-13B-Chat-GGUF

Text Generation
Transformers
GGUF
PyTorch
English
facebook
meta
llama
llama-2
Model card Files Community
Xin Liu commited on
Commit
c1674a8
•
1 Parent(s): 6d29cb2

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (12) hide show
  1. Llama-2-13b-chat-hf-Q2_K.gguf +3 -0
  2. Llama-2-13b-chat-hf-Q3_K_L.gguf +3 -0
  3. Llama-2-13b-chat-hf-Q3_K_M.gguf +3 -0
  4. Llama-2-13b-chat-hf-Q3_K_S.gguf +3 -0
  5. Llama-2-13b-chat-hf-Q4_0.gguf +3 -0
  6. Llama-2-13b-chat-hf-Q4_K_M.gguf +3 -0
  7. Llama-2-13b-chat-hf-Q4_K_S.gguf +3 -0
  8. Llama-2-13b-chat-hf-Q5_0.gguf +3 -0
  9. Llama-2-13b-chat-hf-Q5_K_M.gguf +3 -0
  10. Llama-2-13b-chat-hf-Q5_K_S.gguf +3 -0
  11. Llama-2-13b-chat-hf-Q6_K.gguf +3 -0
  12. Llama-2-13b-chat-hf-Q8_0.gguf +3 -0
Llama-2-13b-chat-hf-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0816715dba97ecd645265f3fbdb86e4e07f50c5546a28b1e1fbf9da80ae12e6d
3
+ size 5429349184
Llama-2-13b-chat-hf-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:23a875c6622c43b1bda40928efbd9052e90f5e1ebec5759f445b4eada8ced1ee
3
+ size 6929560384
Llama-2-13b-chat-hf-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83c027d6379debd8431d64fbf94b2756b7034e59b98cd21b9659b1cbbdcdbeb3
3
+ size 6337770304
Llama-2-13b-chat-hf-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:680d1688a2ec54aeaf83c66ac9e892890ba339be695e7407ac2491435704953d
3
+ size 5658981184
Llama-2-13b-chat-hf-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4a1405908d71ad9167436b6d5d41bf239957201e621ef528851882a3a72472fa
3
+ size 7365835584
Llama-2-13b-chat-hf-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9b3831fb445fc73ac258b7ceae3c8ef56ba7e2c555dc1bb778f6db683136a09e
3
+ size 7865957184
Llama-2-13b-chat-hf-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:39337b505435ab694020399911e0d88260c499e6cf86385b028c34c6f6f1a6a7
3
+ size 7414332224
Llama-2-13b-chat-hf-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b4774182ce45e02c924ed6a63c5c54bed7688965e23e69f2e4b3a00951f04c3
3
+ size 8972286784
Llama-2-13b-chat-hf-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:67c08278e8ed7ae96e25e8968e77ba8fc4ae8b974a8b47a105880756f8f82f3e
3
+ size 9229925184
Llama-2-13b-chat-hf-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73d796e7f61ac5be78d48e32a78cb9e027f9a4951ff5294780c0a84091eac6e9
3
+ size 8972286784
Llama-2-13b-chat-hf-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b8f699dc60156be802237b592762f371821cc39ba04c189b7a5b4e9fdaa70910
3
+ size 10679141184
Llama-2-13b-chat-hf-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68adfad7667e333ef169e43f6be11197120a4e773dc456a6fca183defcf5c0b3
3
+ size 13831320384