MTSAIR
/

Cotype-Nano-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

AlanRobotics commited on 18 days ago

Commit

5e44b29

•

1 Parent(s): 0bdfe95

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -98,7 +98,7 @@ print(res[0]['generated_text'][1])
 | Model                                      | Score  | 95% CI | Avg. #Tokens |
 |---------------------------------------------|-------|-------------------------|---------------|
-| **Cotype-Nano-4bit**                           | **22.5**  | **+2.1 / -1.4**               | **587**           |
 | storm-7b                                    | 20.62 | +1.4 / -1.6             | 419.32        |
 | neural-chat-7b-v3-3                         | 19.04 | +1.8 / -1.5             | 927.21        |
 | Vikhrmodels-Vikhr-Llama-3.2-1B-instruct     | 19.04 | +1.2 / -1.5             | 958.63        |

 | Model                                      | Score  | 95% CI | Avg. #Tokens |
 |---------------------------------------------|-------|-------------------------|---------------|
+| **Cotype-Nano-4bit**                           | **22.5**  | **+2.1 / -1.4**               | **582**           |
 | storm-7b                                    | 20.62 | +1.4 / -1.6             | 419.32        |
 | neural-chat-7b-v3-3                         | 19.04 | +1.8 / -1.5             | 927.21        |
 | Vikhrmodels-Vikhr-Llama-3.2-1B-instruct     | 19.04 | +1.2 / -1.5             | 958.63        |