Transformers
English
code
Inference Endpoints
Sergey Kostyaev commited on
Commit
3d1da7a
1 Parent(s): 8166853

Requantize models

Browse files

Requantize models after last changes in ggml repo

starchat-alpha-ggml-q4_0.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:019fd252efb55eebad34b3a7bbf9d809ef647bc0b430c0fc6c5c00c9c5587714
3
- size 11916805062
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b5f176495935f72ada95d859317eaab8f990641b5fd15ffb6787ca2a2a46752b
3
+ size 10746591174
starchat-alpha-ggml-q4_1.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8e83cb78767cab6a1e1a83730a10ab9ba6842f313cb46a7db54a42e1bb61c55e
3
- size 14257232838
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5ed34d565a4fa7cb91f3cf1235d81e48770d8052bc926471abbf6645edf0af81
3
+ size 11916805062
starchat-alpha-ggml-q5_0.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a7496f629f53a3cefbe14376477e62e62198c196bcf79223155d6dd290e721f5
3
  size 13087018950
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d7f6c1493cd66e607a2acf56a764e7ef3605727cecfc01a60b65e35e85a367e9
3
  size 13087018950
starchat-alpha-ggml-q5_1.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:64004142d45dac92679bff7e53f726205786cbf27191623f0fef2c1c1fde5e29
3
  size 14257232838
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed907298603afd6852bc734af11ecab784a39b7f531db0f52172c3fad0f0ccf5
3
  size 14257232838
starchat-alpha-ggml-q8_0.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:16ccf0d47c5ad3118407210775c3105005f3ebaf3e165c22690e46fd1f94369f
3
- size 21278516166
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:406f1eddfe746ef6cba41a934f25c2cec8713a0c6870e81ce869588c2a3fead9
3
+ size 20108302278