File size: 436 Bytes
617b0dc e45771e 97ae83c 617b0dc |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
---
license: gemma
---
WARNING: `gemma-2-27b` models don't run well in `float16` precision.<br>
This FLUTE-quantized model is released in `bfloat16`.
| | Wiki | C4 |
| ----- | ---- | ----- |
| W4G64 | 5.91 | 9.71 |
| W3G64 | TBD | TBD |
Evaluations are provided for models with learned scales.<br>
Check the base [`gemma-2-27b-FLUTE`](https://huggingface.co/radi-cho/gemma-2-27b-FLUTE) for `lm-eval-harness` benchmarks. |