togethercomputer
/

Llama-2-7B-32K-Instruct

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

yuchenglu commited on Aug 18, 2023

Commit

35696b9

•

1 Parent(s): 4d80166

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -135,7 +135,7 @@ We summarize the results below:
 * Accuracy over MQA
 | Model | 20 docs (Avg 2.9K tokens) | 30 docs (Avg 4.4K tokens) | 50 docs (Avg 7.4K tokens) |
 | -------- | ------- | ------- | ------- |
-| Llama-2-7B-Chat-hf | 0.384 | 0.375 | 0.313 |
 | Longchat-7b-16k | 0.510 | 0.473 | 0.428 |
 | Longchat-7b-v1.5-32k | 0.534 | 0.516 | 0.479 |
 | GPT-3.5-Turbo-16K | 0.622 | 0.609 | 0.577 |

 * Accuracy over MQA
 | Model | 20 docs (Avg 2.9K tokens) | 30 docs (Avg 4.4K tokens) | 50 docs (Avg 7.4K tokens) |
 | -------- | ------- | ------- | ------- |
+| Llama-2-7B-Chat-hf | 0.448 | 0.421 | 0.354 |
 | Longchat-7b-16k | 0.510 | 0.473 | 0.428 |
 | Longchat-7b-v1.5-32k | 0.534 | 0.516 | 0.479 |
 | GPT-3.5-Turbo-16K | 0.622 | 0.609 | 0.577 |