Hugging Face's logo

second-state
/
Neural-Chat-7B-v3-1-GGUF

Text Generation
Transformers
GGUF
mistral
text-generation-inference
Model card Files Community
Xin Liu commited on
Commit
0335ed3
•
1 Parent(s): dada183

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (12) hide show
  1. neural-chat-7b-v3-1-Q2_K.gguf +3 -0
  2. neural-chat-7b-v3-1-Q3_K_L.gguf +3 -0
  3. neural-chat-7b-v3-1-Q3_K_M.gguf +3 -0
  4. neural-chat-7b-v3-1-Q3_K_S.gguf +3 -0
  5. neural-chat-7b-v3-1-Q4_0.gguf +3 -0
  6. neural-chat-7b-v3-1-Q4_K_M.gguf +3 -0
  7. neural-chat-7b-v3-1-Q4_K_S.gguf +3 -0
  8. neural-chat-7b-v3-1-Q5_0.gguf +3 -0
  9. neural-chat-7b-v3-1-Q5_K_M.gguf +3 -0
  10. neural-chat-7b-v3-1-Q5_K_S.gguf +3 -0
  11. neural-chat-7b-v3-1-Q6_K.gguf +3 -0
  12. neural-chat-7b-v3-1-Q8_0.gguf +3 -0
neural-chat-7b-v3-1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:278dd290e70615e79483f6589a0b6c3dd8236298c3ebc85d3068d393c15bfa90
3
+ size 2701416064
neural-chat-7b-v3-1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c089607e11a02988f1e92ff0682b24cbecac5c9adcf4d332a3d82055f29133c
3
+ size 3822024320
neural-chat-7b-v3-1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7eface5d2e09a4725f0b5e03cf10a89e11dc79d2c15db7d78b3d37c93989659b
3
+ size 3518985856
neural-chat-7b-v3-1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f5b43b2827bfb65d4124420824054b738437d255316931795dbe687b974ef7e
3
+ size 3164567168
neural-chat-7b-v3-1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0f6244f19c311193bd6dc796ca475df01dd38ff391e8f4788731739bbb4a3a69
3
+ size 4108916352
neural-chat-7b-v3-1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b007dbc5da4dca421374e38cf8cc8e7ae4e30d46040b7e8623717ce89c980969
3
+ size 4368438912
neural-chat-7b-v3-1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b5266a8fc9911399e79a2accaeae5070bcf7b9c6e4b341c3012345d4ddc4286
3
+ size 4140373632
neural-chat-7b-v3-1-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae9f7d9663126aa21c99c9dbd6c90c182d39612141d3a0b84b4ab9a3011959e8
3
+ size 4997715584
neural-chat-7b-v3-1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c754cefc47842167b229fc78bff511f96c173c00962e5dbb44ea11d206492370
3
+ size 5131409024
neural-chat-7b-v3-1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:577ed1bee22495cf992124d11f761f3ca2be70c8b1b20ebaf95f5994ff2af782
3
+ size 4997715584
neural-chat-7b-v3-1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e17615beb960c3c32292f5cfbf7b24d5d470df334aa9bec128903af243426f4
3
+ size 5942064768
neural-chat-7b-v3-1-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5273dd0f966af0a55f66b4fdb379b587010f2d4d25eb51af21a8e69889c4b977
3
+ size 7695857280