codeparrot-small-multi / eval_results.txt
loubnabnl's picture
loubnabnl HF staff
update results
a37e2b4
temperature 0.2: {'pass@1': 0.027439024390243896, 'pass@10': 0.041979293327556816, 'pass@100': 0.04268292682926801}
temperature 0.8: {'pass@1': 0.013262195121951224, 'pass@10': 0.04670902438514701, 'pass@100': 0.0899080946922357}
best: {'pass@1': 2.74% , 'pass@10': 4.67 , 'pass@100': 8.99%}