Upload folder using huggingface_hub
Browse files- .gitattributes +6 -0
- README.md +17 -0
- shieldgemma-2b.f16.gguf +3 -0
- shieldgemma-2b.q5_k.gguf +3 -0
- shieldgemma-2b.q6_k.gguf +3 -0
- shieldgemma-2b.q8_0.gguf +3 -0
- shieldgemma-2b.q8_p.gguf +3 -0
- shieldgemma-2b.q8q4.gguf +3 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
shieldgemma-2b.f16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
shieldgemma-2b.q5_k.gguf filter=lfs diff=lfs merge=lfs -text
|
| 38 |
+
shieldgemma-2b.q6_k.gguf filter=lfs diff=lfs merge=lfs -text
|
| 39 |
+
shieldgemma-2b.q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 40 |
+
shieldgemma-2b.q8_p.gguf filter=lfs diff=lfs merge=lfs -text
|
| 41 |
+
shieldgemma-2b.q8q4.gguf filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
|
@@ -0,0 +1,17 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
|
| 2 |
+
---
|
| 3 |
+
license: mit
|
| 4 |
+
language:
|
| 5 |
+
- en
|
| 6 |
+
pipeline_tag: text-generation
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
My own (ZeroWw) quantizations.
|
| 10 |
+
output and embed tensors quantized to f16.
|
| 11 |
+
all other tensors quantized to q5_k or q6_k.
|
| 12 |
+
|
| 13 |
+
Result:
|
| 14 |
+
both f16.q6 and f16.q5 are smaller than q8_0 standard quantization
|
| 15 |
+
and they perform as well as the pure f16.
|
| 16 |
+
|
| 17 |
+
Updated on: Sat Aug 03, 23:42:16
|
shieldgemma-2b.f16.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c86ab523eaab7047e4b0ce40abc632fb162b5b8785d2f407bef8f9faca349878
|
| 3 |
+
size 5235214592
|
shieldgemma-2b.q5_k.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:17c64477be1ecc2e4186da049211e75937aea031483eeaffcaa423234ef3a4f3
|
| 3 |
+
size 2619087104
|
shieldgemma-2b.q6_k.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d7522812eedbd5ad1b734ef16c18e98d73bac7e4c55bca7a0d82189d5c1bbc35
|
| 3 |
+
size 2847201536
|
shieldgemma-2b.q8_0.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5da7ab1a20a5fd6ed7cec0e5a3bbf84dfb23150c8e0b54891a92ab2bfbe8c1d1
|
| 3 |
+
size 3337455872
|
shieldgemma-2b.q8_p.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d8d2f6ba53ea4eb24fc0b740c25fc607fb49f76cf86c7ab8d9fa22a6c37213e8
|
| 3 |
+
size 2784495872
|
shieldgemma-2b.q8q4.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:418d2eec637d4f339a2a4b08438700abf14614f3903b14d2a12fc8e26ce213f9
|
| 3 |
+
size 1851431168
|