Model: DevQuasar/coma-7B-v0.1
Author: DevQuasar
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, llama, text-generation, mergekit, merge, arxiv:2203.05482, base_model:meta-llama/CodeLlama-7b-hf, base_model:merge:meta-llama/CodeLlama-7b-hf, base_model:meta-llama/Llama-2-7b-hf, base_model:merge:meta-llama/Llama-2-7b-hf, license:llama2, model-index, text-generation-inference, endpoints_compatible, region:us
Base models (merge): id: meta-llama/CodeLlama-7b-hf, id: meta-llama/Llama-2-7b-hf
Card metadata: base_model: meta-llama/Llama-2-7b-hf, meta-llama/CodeLlama-7b-hf
library_name: transformers
tags: mergekit, merge
license: llama2
model-index: name: coma-7B-v0.1
results: task: type: text-generation
dataset: type: lm-evaluation-harness
name: bbh
metrics: name: acc_norm
type: acc_norm
value: 0.3355
verified: no, task: type: text-generation
dataset: type: lm-evaluation-harness
name: gpqa
metrics: name: acc_norm
type: acc_norm
value: 0.2587
verified: no, task: type: text-generation
dataset: type: lm-evaluation-harness
name: math
metrics: name: exact_match
type: exact_match
value: 0.0104
verified: no, task: type: text-generation
dataset: type: lm-evaluation-harness
name: mmlu
metrics: name: acc_norm
type: acc_norm
value: 0.1433
verified: no, task: type: text-generation
dataset: type: lm-evaluation-harness
name: musr
metrics: name: acc_norm
type: acc_norm
value: 0.3844
verified: no, task: type: text-generation
dataset: type: lm-evaluation-harness
name: hellaswag
metrics: name: acc
type: acc
value: 0.5182234614618602
verified: no, name: acc_norm
type: acc_norm
value: 0.6834295956980682
verified: no
Likes: 0 | All-time downloads: 362
Created: 2024-06-11 01:19:32