Deci
/

DeciLM-6b-instruct

Text Generation

Model card Files Files and versions Community

itay-levy commited on Sep 14, 2023

Commit

e17464f

•

1 Parent(s): 8d0d953

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -162,10 +162,10 @@ Accuracy-norm score*
 |Inference Tool/Hardware | A10 (tokens/sec) |
 |:----------|:----------|
-| HF   | 652.49 |
 | Infery LLM | 2,029.6  |
-- Throughput (tokens/sec) - Measured with optimal batch - BS 64, Infery LLM BS 128
 ## Disclaimer

 |Inference Tool/Hardware | A10 (tokens/sec) |
 |:----------|:----------|
+| PyTorch   | 652.49 |
 | Infery LLM | 2,029.6  |
+- Throughput (tokens/sec) - Measured with optimal batch - PyTorch BS 64, Infery LLM BS 128
 ## Disclaimer