Update README.md
Browse files
README.md
CHANGED
|
@@ -19,8 +19,7 @@ language:
|
|
| 19 |
|
| 20 |
|
| 21 |
|
| 22 |
-
|
| 23 |
-
Calibrated with 30 samples of `mmlu_philosophy`, got eval accuracy of 76.85, while gemma-3-27b-it-INT4 is 75.56, and bfloat16 baseline is 79.10
|
| 24 |
|
| 25 |
|
| 26 |
# Inference with vLLM
|
|
|
|
| 19 |
|
| 20 |
|
| 21 |
|
| 22 |
+
Calibrated with 30 samples of `mmlu_philosophy`, got eval accuracy of 81.35, while gemma-3-27b-it-INT4 is 77.17, and bfloat16 baseline is 79.42
|
|
|
|
| 23 |
|
| 24 |
|
| 25 |
# Inference with vLLM
|