Hugging Face's logo

second-state
/
Neural-Chat-7B-v3-3-GGUF

Text Generation
Transformers
GGUF
mistral
text-generation-inference
Model card Files Community
Xin Liu commited on
Commit
c477e70
•
1 Parent(s): b355c82

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (13) hide show
  1. .gitattributes +1 -0
  2. neural-chat-7b-v3-3-Q2_K.gguf +3 -0
  3. neural-chat-7b-v3-3-Q3_K_L.gguf +3 -0
  4. neural-chat-7b-v3-3-Q3_K_M.gguf +3 -0
  5. neural-chat-7b-v3-3-Q3_K_S.gguf +3 -0
  6. neural-chat-7b-v3-3-Q4_0.gguf +3 -0
  7. neural-chat-7b-v3-3-Q4_K_M.gguf +3 -0
  8. neural-chat-7b-v3-3-Q4_K_S.gguf +3 -0
  9. neural-chat-7b-v3-3-Q5_0.gguf +3 -0
  10. neural-chat-7b-v3-3-Q5_K_M.gguf +3 -0
  11. neural-chat-7b-v3-3-Q5_K_S.gguf +3 -0
  12. neural-chat-7b-v3-3-Q6_K.gguf +3 -0
  13. neural-chat-7b-v3-3-Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.gguf filter=lfs diff=lfs merge=lfs -text
neural-chat-7b-v3-3-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:afde5451600c7bdc945d82849dc6548de9b127e5a8a37d56e648ba07257dd19e
3
+ size 3083097728
neural-chat-7b-v3-3-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:21fd76f2767adf0c3cbcd3aa134c7a0749c3f5436dc49eadf0862b2b02aeb80c
3
+ size 3822024320
neural-chat-7b-v3-3-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2ec2ed98c94dff4d6ed25d12291708c8e00548047d2093cf953cb4a08e47df7
3
+ size 3518985856
neural-chat-7b-v3-3-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df6ac63956bf0a1444613905040b15f2cfc7f994d560ca09acce22df13a5c3f5
3
+ size 3164567168
neural-chat-7b-v3-3-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f60d1585a0142d84362a0b5634dfd2905b32fe27c5bd9e4093837ccd8b34b6b8
3
+ size 4108916352
neural-chat-7b-v3-3-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:842915499a32e9f127af70e5a77d11148808c7b685d527059eaa1b29733c7003
3
+ size 4368438912
neural-chat-7b-v3-3-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e0dd86fdd8ad8a6529ab43cbdf42d8925367046bf2e32731d4e6f66ff05ebcab
3
+ size 4140373632
neural-chat-7b-v3-3-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:53e87af91a20956c1fe622d970f1feabad00f1836e9300ab3a6708f981455aa8
3
+ size 4997715584
neural-chat-7b-v3-3-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:89685b06e8214329359bd36f69c8799b232077b3b86bf337435bcce3cb21e292
3
+ size 5131409024
neural-chat-7b-v3-3-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e37b14b5365f1eff691c83360f1a85a4e3a8c3cef47798d6574166a3dcbaae9
3
+ size 4997715584
neural-chat-7b-v3-3-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c4743d3f496fd7748c5348a54619b03b1e188923ecab23bfbed5d30d56883d9d
3
+ size 5942064768
neural-chat-7b-v3-3-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:645c0e8c0ee0454984ee9de58b6f6341b69270c017102144d7e4dc10b7ee5952
3
+ size 7695857280