loubnabnl HF staff commited on
Commit
28f951a
β€’
1 Parent(s): 2616726
Files changed (1) hide show
  1. evaluation/intro.txt +1 -0
evaluation/intro.txt CHANGED
@@ -5,6 +5,7 @@ For most models, we sample 200 candidate program completions, and compute pass@1
5
  |-------|--------|---------|---------|
6
  |CodeParrot 🦜 (110M) | 3.80% | 6.57% | 12.78% |
7
  |CodeParrot 🦜 (1.5B) | 3.58% | 8.03% | 14.96% |
 
8
  |InCoder 🦜 (6.7B) | 15.2% | 27.8% | 47.00% |
9
  |||||
10
  |Codex (25M)| 3.21% | 7.1% | 12.89%|
 
5
  |-------|--------|---------|---------|
6
  |CodeParrot 🦜 (110M) | 3.80% | 6.57% | 12.78% |
7
  |CodeParrot 🦜 (1.5B) | 3.58% | 8.03% | 14.96% |
8
+ |||||
9
  |InCoder 🦜 (6.7B) | 15.2% | 27.8% | 47.00% |
10
  |||||
11
  |Codex (25M)| 3.21% | 7.1% | 12.89%|