Update README.md
Browse files
README.md
CHANGED
@@ -166,6 +166,7 @@ Accuracy-norm score*
|
|
166 |
| Infery LLM | 2,029.6 |
|
167 |
|
168 |
- Throughput (tokens/sec) - Measured with optimal batch - PyTorch BS 64, Infery LLM BS 128
|
|
|
169 |
|
170 |
## Disclaimer
|
171 |
|
|
|
166 |
| Infery LLM | 2,029.6 |
|
167 |
|
168 |
- Throughput (tokens/sec) - Measured with optimal batch - PyTorch BS 64, Infery LLM BS 128
|
169 |
+
- In order to replicate the results of the PyTorch benchmark, use this [code example](https://huggingface.co/Deci/DeciLM-6b-instruct/blob/main/hf_benchmark_example.py)
|
170 |
|
171 |
## Disclaimer
|
172 |
|