Update README.md
Browse files
README.md
CHANGED
|
@@ -33,6 +33,14 @@ base_model: abacusai/Llama-3-Smaug-8B
|
|
| 33 |
dtype: bfloat16
|
| 34 |
```
|
| 35 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 36 |
## 💻 Usage
|
| 37 |
|
| 38 |
```python
|
|
|
|
| 33 |
dtype: bfloat16
|
| 34 |
```
|
| 35 |
|
| 36 |
+
## Eval Results
|
| 37 |
+
|
| 38 |
+
|Benchmark| Model |winogrande| arc |gsm8k|mmlu|truthfulqa|hellaswag|Average|
|
| 39 |
+
|---------|--------------------------------------------------------------------|---------:|----:|----:|---:|---------:|--------:|------:|
|
| 40 |
+
|openllm |[aqua-smaug-0.3-8B](https://huggingface.co/saucam/aqua-smaug-0.3-8B)| 77.11|62.37|76.19| 66| 53.7| 83.02| 69.73|
|
| 41 |
+
|
| 42 |
+
Detailed Results: https://github.com/saucam/model_evals/tree/main/saucam/aqua-smaug-0.3-8B
|
| 43 |
+
|
| 44 |
## 💻 Usage
|
| 45 |
|
| 46 |
```python
|