Hugging Face's logo

second-state
/
Llama-2-7B-Chat-GGUF

Text Generation
Transformers
GGUF
PyTorch
English
facebook
meta
llama
llama-2
Model card Files Community
Xin Liu commited on
Commit
617ee58
•
1 Parent(s): 578910d

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (12) hide show
  1. Llama-2-7b-chat-hf-Q2_K.gguf +3 -0
  2. Llama-2-7b-chat-hf-Q3_K_L.gguf +3 -0
  3. Llama-2-7b-chat-hf-Q3_K_M.gguf +3 -0
  4. Llama-2-7b-chat-hf-Q3_K_S.gguf +3 -0
  5. Llama-2-7b-chat-hf-Q4_0.gguf +3 -0
  6. Llama-2-7b-chat-hf-Q4_K_M.gguf +3 -0
  7. Llama-2-7b-chat-hf-Q4_K_S.gguf +3 -0
  8. Llama-2-7b-chat-hf-Q5_0.gguf +3 -0
  9. Llama-2-7b-chat-hf-Q5_K_M.gguf +3 -0
  10. Llama-2-7b-chat-hf-Q5_K_S.gguf +3 -0
  11. Llama-2-7b-chat-hf-Q6_K.gguf +3 -0
  12. Llama-2-7b-chat-hf-Q8_0.gguf +3 -0
Llama-2-7b-chat-hf-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:705421d1cb35629acb40d7f214cffdba5885ce3166c0df4c2663c7fbbebdbb4b
3
+ size 2825941600
Llama-2-7b-chat-hf-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f0aaff8e9bddcc0bb7222eaeed960ec897d565a65eb7f1b6b1cd479da0ab97f
3
+ size 3597111904
Llama-2-7b-chat-hf-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3b8c03671a35e22a7bc118f5fbe0502226d96c60c86dfa0b0ebccbb211fe8b51
3
+ size 3298005600
Llama-2-7b-chat-hf-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee1dd1e86097d8074cc4cf7b36596daca1dd4df312e62bb468ef27cde2e14e16
3
+ size 2948305504
Llama-2-7b-chat-hf-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:23a66af3672c603077b86510bee04cac74fa4da675b4318fc649624fce8c13b3
3
+ size 3825807968
Llama-2-7b-chat-hf-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f475bcb77959f5721548bcc5122f4d5a0eb9d94ddb5b7fdce826bc1410ae0a8b
3
+ size 4081005152
Llama-2-7b-chat-hf-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d51f515b9a8da317c94163e26596baeb57da3a4cc0e6f422c75bfb9ea126a041
3
+ size 3856740960
Llama-2-7b-chat-hf-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:459aedfd356c4842be1b1571b920779c9fbd8e8f7c7d4c9218305ffaa4f29b3e
3
+ size 4651692640
Llama-2-7b-chat-hf-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:39fdaca41ef03de1e9b709602557faaf2e8490c830622823cb6f8dc9ac14db04
3
+ size 4783157856
Llama-2-7b-chat-hf-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:77cca6e9ae183339c9d1b23daca3d8678f303ea1da78cac47fc06cf3bc03cc5d
3
+ size 4651692640
Llama-2-7b-chat-hf-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f226786216f352b8f1bac735fec0483b1ddac06c7fb9033ed9b48f9eccf89a4
3
+ size 5529195104
Llama-2-7b-chat-hf-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:edc144a62dbf51a0d7e806b5bea17f621af2a508dfe84fb115c7dbf0c31e2838
3
+ size 7161090656