Hugging Face's logo

second-state
/
Baichuan2-7B-Chat-GGUF

Text Generation
Transformers
GGUF
English
Chinese
baichuan
custom_code
Model card Files Community
Xin Liu commited on
Commit
fc197de
•
1 Parent(s): 2fa9f4e

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (12) hide show
  1. Baichuan2-7B-Chat-Q2_K.gguf +3 -0
  2. Baichuan2-7B-Chat-Q3_K_L.gguf +3 -0
  3. Baichuan2-7B-Chat-Q3_K_M.gguf +3 -0
  4. Baichuan2-7B-Chat-Q3_K_S.gguf +3 -0
  5. Baichuan2-7B-Chat-Q4_0.gguf +3 -0
  6. Baichuan2-7B-Chat-Q4_K_M.gguf +3 -0
  7. Baichuan2-7B-Chat-Q4_K_S.gguf +3 -0
  8. Baichuan2-7B-Chat-Q5_0.gguf +3 -0
  9. Baichuan2-7B-Chat-Q5_K_M.gguf +3 -0
  10. Baichuan2-7B-Chat-Q5_K_S.gguf +3 -0
  11. Baichuan2-7B-Chat-Q6_K.gguf +3 -0
  12. Baichuan2-7B-Chat-Q8_0.gguf +3 -0
Baichuan2-7B-Chat-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c92fb1fe647d34a43e189f874b18f12c51b7a47164df6fdd5c251beb0388d06a
3
+ size 3268824608
Baichuan2-7B-Chat-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83f6988c9259788d3a57e9023c46f69057a6f5c4f84e125ad8ee15c8aabc64c4
3
+ size 4078972448
Baichuan2-7B-Chat-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee0fdfc492fa3b8c7416fc4866975f434584bb4d221b97d617af7589af8d506b
3
+ size 3779866144
Baichuan2-7B-Chat-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc03e4160009139daa9a238c41880062ee400c57dcc2a44ef18cae8e9c8f6f3c
3
+ size 3430166048
Baichuan2-7B-Chat-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b9f374d47fcb357dbb105c3ede2878736dc01a3844040493675ccfdffeef33a
3
+ size 4358639136
Baichuan2-7B-Chat-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5943dca13c486852e9a794f6ecb31adc032ebca9ad49770fd74e5e338df45e73
3
+ size 4613836320
Baichuan2-7B-Chat-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:277eea791cd42419348c882b4da61f1066cd2dab5f8864a65562c49380de7964
3
+ size 4389572128
Baichuan2-7B-Chat-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c2d3c9caa7eb3374e541823a21730d8b3c5fa9a3d33ce93da6bd0be2a504e57e
3
+ size 5232496160
Baichuan2-7B-Chat-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed065827a411420c073abfe0adb160c472e263935c8a3d889691f8d602dd4991
3
+ size 5363961376
Baichuan2-7B-Chat-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7158bf235e9b89837d958573d74c2034070e2942d69104a9ce3248696db2b65a
3
+ size 5232496160
Baichuan2-7B-Chat-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c68c933350b37a2314f3b77705d7d7381662d36bbdc72f7e40bf1719b42136c5
3
+ size 6160969248
Baichuan2-7B-Chat-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d0541e505e0d16641efa7202e5428de7d652f9d80f85243ce2fe21cce6a54253
3
+ size 7978757664