| base_model: Steelskull/L3.3-Nevoria-R1-70b | |
| library_name: transformers | |
| tags: | |
| - exl2 | |
| - mergekit | |
| - merge | |
| license: other | |
| language: | |
| - en | |
| # L3.3-Nevoria-R1-70b - EXL2 4.5bpw | |
| This is a 4.5bpw EXL2 quant of [Steelskull/L3.3-Nevoria-R1-70b](https://huggingface.co/Steelskull/L3.3-Nevoria-R1-70b) | |
| Details about the model can be found at the above model page. | |
| ## Perplexity Scoring | |
| Below are the perplexity scores for the EXL2 models. A lower score is better. | |
| | Quant Level | Perplexity Score | | |
| |-------------|------------------| | |
| | 5.0 | 4.5874 | | |
| | 4.5 | 4.6888 | | |
| | 4.0 | 4.8087 | | |
| | 3.5 | 5.1801 | | |
| | 3.0 | 6.9957 | | |
| | 2.75 | 11.5577 | | |
| | 2.5 | 7.5404 | | |
| | 2.25 | 7.4924 | | |