YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Training Plots
Evaluation Results
Perplexity
| Metric | Value |
|---|---|
| Perplexity (ppl) | 11.585 |
Benchmark Results
| Dataset | Accuracy | Accuracy StdErr | Normalized Accuracy | Normalized Accuracy StdErr |
|---|---|---|---|---|
| ARC Challenge | 0.3669 | ± 0.0141 | 0.4019 | ± 0.0143 |
| ARC Easy | 0.6923 | ± 0.0095 | 0.6793 | ± 0.0096 |
| HellaSwag | 0.4945 | ± 0.0050 | 0.6565 | ± 0.0047 |
| PIQA | 0.7492 | ± 0.0101 | 0.7601 | ± 0.0100 |
| Winogrande | 0.6511 | ± 0.0134 | N/A | N/A |
QA Average
| Metric | Value |
|---|---|
| QA Avg | 0.5908 |
- Downloads last month
- 4
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support