Update README.md
Browse files
README.md
CHANGED
|
@@ -102,7 +102,7 @@ https://github.com/EleutherAI/lm-evaluation-harness#install
|
|
| 102 |
lm_eval --model hf --model_args pretrained=microsoft/Phi-4-mini-instruct --tasks hellaswag --device cuda:0 --batch_size 8
|
| 103 |
```
|
| 104 |
|
| 105 |
-
## float8dq
|
| 106 |
```
|
| 107 |
lm_eval --model hf --model_args pretrained=pytorch/Phi-4-mini-instruct-float8dq --tasks hellaswag --device cuda:0 --batch_size 8
|
| 108 |
```
|
|
|
|
| 102 |
lm_eval --model hf --model_args pretrained=microsoft/Phi-4-mini-instruct --tasks hellaswag --device cuda:0 --batch_size 8
|
| 103 |
```
|
| 104 |
|
| 105 |
+
## float8 dynamic activation and float8 weight quantization (float8dq)
|
| 106 |
```
|
| 107 |
lm_eval --model hf --model_args pretrained=pytorch/Phi-4-mini-instruct-float8dq --tasks hellaswag --device cuda:0 --batch_size 8
|
| 108 |
```
|