Model: syzymon/long_llama_code_7b
Author: syzymon
Pipeline: text-generation
Library: transformers
Tags: transformers, pytorch, longllama, text-generation, code, text-generation-inference, custom_code, dataset:bigcode/starcoderdata, dataset:togethercomputer/RedPajama-Data-1T, dataset:tiiuae/falcon-refinedweb, arxiv:2307.03170, license:llama2, model-index, region:us
Card metadata: license: llama2
datasets: bigcode/starcoderdata, togethercomputer/RedPajama-Data-1T, tiiuae/falcon-refinedweb
metrics: code_eval, accuracy
pipeline_tag: text-generation
tags: code, text-generation-inference
model-index: name: long_llama_code_7b
results: task: name: Code Generation
type: code-generation
dataset: name: HumanEval
type: openai_humaneval
metrics: name: pass@1
type: pass@1
value: 0.286
verified: no, task: name: Math Reasoning
type: reasoning
dataset: name: GSM8K-Python
type: gsm8k
metrics: name: pass@1
type: pass@1
value: 0.249
verified: no, task: name: Math Reasoning
type: reasoning
dataset: name: GSM8K
type: gsm8k
metrics: name: pass@1
type: pass@1
value: 0.174
verified: no, task: name: Knowledge
type: knowledge
dataset: name: MMLU
type: mmlu
metrics: name: accuracy
type: accuracy
value: 0.399
verified: no
Likes: 31 | All-time downloads: 2530
Created: 2023-09-21 19:05:20