Upload model-small.gguf
Browse files`RUST_BACKTRACE=1 cargo run --example tensor-tools --release -- quantize --quantization q6k ~/Downloads/model.safetensors --out-file model-small.gguf`
- model-small.gguf +3 -0
model-small.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:603e9bd35821ffafe40cc2a25fe50ed3b3771d213dd55ee7c1d5cd023c35ec9f
|
| 3 |
+
size 78221472
|