patched-codes
/

patched-coder-34b

Text Generation

text-generation-inference

Model card Files Files and versions Community

codelion commited on Oct 2, 2023

Commit

507ff2d

•

1 Parent(s): 93590d0

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -122,9 +122,9 @@ To evaluate the model for vulnerability remediation we used the `Static Analysis
 | Model | HumanEval | HumanEval Fix Python| Static Analysis Eval |
 | ----- | ----------| ------------------- | -------------------- |
-| GPT-4 | 86.6 | 47 | 55.26 |
 | patched-coder-34b | 53.57 | 41.34 | 51.32 |
 | CodeLlama-34b-Python | 53.29 | 33.14 | 27.63 |
 Based on the results on these benchmarks, patched-coder-34b is the SOTA open code LLM. Other code LLMs (e.g. from WizardCoder and Phind) are trained on
 either unknown proprietary datasets or used OpenAI's APIs for training, thus making them unviable for commercial use.

 | Model | HumanEval | HumanEval Fix Python| Static Analysis Eval |
 | ----- | ----------| ------------------- | -------------------- |
 | patched-coder-34b | 53.57 | 41.34 | 51.32 |
 | CodeLlama-34b-Python | 53.29 | 33.14 | 27.63 |
+| GPT-4 | 86.6 | 47 | 55.26 |
 Based on the results on these benchmarks, patched-coder-34b is the SOTA open code LLM. Other code LLMs (e.g. from WizardCoder and Phind) are trained on
 either unknown proprietary datasets or used OpenAI's APIs for training, thus making them unviable for commercial use.