cllatMTK commited on
Commit
16b091e
1 Parent(s): 2164897

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -86,7 +86,7 @@ and is comparable with Mistral-7B-Instruct-v0.1 on MMLU and MT-Bench in English.
86
 
87
  ## Inference Performance
88
  In this test, we use the first 700 characters of the [web article](https://health.udn.com/health/story/5976/7699252?from=udn_ch1005_main_index) as the input and ask the model to write the same article again.
89
- All models were inferenced with `vllm` on 2 A6000 (TP=2).
90
 
91
  | Models | Inference Time (sec)|Estimated Max Input Length (TC Char)|
92
  |--------------------------------------------------------------------|-------------------|--------------------------|
 
86
 
87
  ## Inference Performance
88
  In this test, we use the first 700 characters of the [web article](https://health.udn.com/health/story/5976/7699252?from=udn_ch1005_main_index) as the input and ask the model to write the same article again.
89
+ All models were inferenced with `vllm` on 2 NVIDIA RTX A6000 (TP=2).
90
 
91
  | Models | Inference Time (sec)|Estimated Max Input Length (TC Char)|
92
  |--------------------------------------------------------------------|-------------------|--------------------------|