Update README.md
Browse files
README.md
CHANGED
@@ -155,7 +155,6 @@ Below are DeciCoder's pass@1 on MultiPL HumanEval scores
|
|
155 |
| HF Inference Endpoints | 1,364.2 | 3,244.4 |
|
156 |
| Infery LLM | 3,889.3 | 11,676.8 |
|
157 |
|
158 |
-
- Latency - Total generation time of batch size 1 (prefill+generate)
|
159 |
- Throughput (tokens/sec) - Measured with optimal batch size per hardware - A10 on BS 128, A100 on BS 512
|
160 |
|
161 |
## Documentation
|
|
|
155 |
| HF Inference Endpoints | 1,364.2 | 3,244.4 |
|
156 |
| Infery LLM | 3,889.3 | 11,676.8 |
|
157 |
|
|
|
158 |
- Throughput (tokens/sec) - Measured with optimal batch size per hardware - A10 on BS 128, A100 on BS 512
|
159 |
|
160 |
## Documentation
|