Model: utkmst/chimera-beta-test2-lora-merged
Author: utkmst
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, llama, text-generation, llama-3.1, instruction-tuned, conversational, en, dataset:OpenAssistant/oasst1, dataset:databricks/databricks-dolly-15k, dataset:Open-Orca/OpenOrca, dataset:mlabonne/open-perfectblend, dataset:tatsu-lab/alpaca, base_model:meta-llama/Llama-3.1-8B-Instruct, base_model:finetune:meta-llama/Llama-3.1-8B-Instruct, license:llama3.1, model-index, text-generation-inference, endpoints_compatible, region:us
Base models (finetune): id: meta-llama/Llama-3.1-8B-Instruct
Card metadata: language: en
library_name: transformers
license: llama3.1
base_model: meta-llama/Llama-3.1-8B-Instruct
pipeline_tag: text-generation
tags: llama-3.1, instruction-tuned
datasets: OpenAssistant/oasst1, databricks/databricks-dolly-15k, Open-Orca/OpenOrca, mlabonne/open-perfectblend, tatsu-lab/alpaca
model-index: name: utkmst/chimera-beta-test2-lora-merged
results: task: type: text-generation
dataset: type: leaderboard
name: Overall Leaderboard
metrics: name: acc_norm
type: acc_norm
value: 0.444
verified: no, name: acc
type: acc
value: 0.2992
verified: no, name: exact_match
type: exact_match
value: 0.0951
verified: no, task: type: text-generation
dataset: type: bbh
name: BBH (Big Bench Hard)
metrics: name: acc_norm
type: acc_norm
value: 0.4773
verified: no, task: type: text-generation
dataset: type: gpqa
name: GPQA (Google-Patched Question Answering)
metrics: name: acc_norm
type: acc_norm
value: 0.3036
verified: no, task: type: text-generation
dataset: type: math
name: Math
metrics: name: exact_match
type: exact_match
value: 0.0951
verified: no, task: type: text-generation
dataset: type: mmlu_pro
name: MMLU-Pro
metrics: name: acc
type: acc
value: 0.2992
verified: no, task: type: text-generation
dataset: type: musr
name: MUSR (Multi-Step Reasoning)
metrics: name: acc_norm
type: acc_norm
value: 0.4113
verified: no
Likes: 1 | All-time downloads: 242
Created: 2025-03-08 08:08:45