metadata
datasets:
- theblackcat102/evol-codealpaca-v1
model-index:
- name: Redpajama-3b-evol-coder
results:
- task:
type: text-generation
dataset:
type: openai_humaneval
name: HumanEval
metrics:
- name: pass@1
type: pass@1
value: 20.73
verified: false
- task:
type: text-generation
dataset:
type: mbpp
name: MBPP
metrics:
- name: pass@1
type: pass@1
value: 6.4
verified: false
Redpajama 3B finetuned on evol-codealpaca-v1
Follows the OpenAssistant chat format:
<|prompter|>{user_prompt}<|endoftext|><|assistant|>