Update README.md
#2
by
ndurkee
- opened
README.md
CHANGED
|
@@ -35,11 +35,11 @@ model-index:
|
|
| 35 |
|
| 36 |
## News
|
| 37 |
|
| 38 |
-
[
|
| 39 |
|
| 40 |
-
[
|
| 41 |
|
| 42 |
-
[
|
| 43 |
|
| 44 |
| Model | Checkpoint | Paper | HumanEval | HumanEval+ | MBPP | MBPP+ | License |
|
| 45 |
| ----- |------| ---- |------|-------| ----- | ----- |----- |
|
|
|
|
| 35 |
|
| 36 |
## News
|
| 37 |
|
| 38 |
+
[2024/01/04] 🔥 We released **WizardCoder-33B-V1.1** trained from deepseek-coder-33b-base, the **SOTA OSS Code LLM** on [EvalPlus Leaderboard](https://evalplus.github.io/leaderboard.html), achieves **79.9 pass@1** on HumanEval, **73.2 pass@1** on HumanEval-Plus, **78.9 pass@1** on MBPP, and **66.9 pass@1** on MBPP-Plus.
|
| 39 |
|
| 40 |
+
[2024/01/04] 🔥 **WizardCoder-33B-V1.1** outperforms **ChatGPT 3.5**, **Gemini Pro**, and **DeepSeek-Coder-33B-instruct** on HumanEval and HumanEval-Plus pass@1.
|
| 41 |
|
| 42 |
+
[2024/01/04] 🔥 **WizardCoder-33B-V1.1** is comparable with **ChatGPT 3.5**, and surpasses **Gemini Pro** on MBPP and MBPP-Plus pass@1.
|
| 43 |
|
| 44 |
| Model | Checkpoint | Paper | HumanEval | HumanEval+ | MBPP | MBPP+ | License |
|
| 45 |
| ----- |------| ---- |------|-------| ----- | ----- |----- |
|