---
license: llama3
---

|       | Wiki | C4    |
| ----- | ---- | ----- |
| W4G64 | 3.67 | 7.95  |
| W3G64 | 4.90 | 10.86 |


Revisions available in this repository:
- `main` (W4G64, scales learned);
- `nfl_w3g64` (W3G64, scales learned);

Evaluations are provided for models with learned scales.<br>
Check the base [`Meta-Llama-3-70B-FLUTE`](https://huggingface.co/radi-cho/Meta-Llama-3-70B-FLUTE) for `lm-eval-harness` benchmarks.