Model: solidrust/flammen-mistral-7B-AWQ
Author: solidrust
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, mistral, text-generation, 4-bit, AWQ, autotrain_compatible, endpoints_compatible, mergekit, merge, base_model:flammenai/flammen-mistral-7B, base_model:quantized:flammenai/flammen-mistral-7B, license:apache-2.0, model-index, text-generation-inference, awq, region:us
Base models (quantized): id: flammenai/flammen-mistral-7B
Card metadata: base_model: flammenai/flammen-mistral-7B
inference: no
library_name: transformers
license: apache-2.0
merged_models: bardsai/jaskier-7b-dpo-v5.6, nbeerbower/bruphin-zeta, Gille/StrangeMerges_16-7B-slerp
model-index: name: flammen
results: dataset: args: num_few_shot: 25
config: ARC-Challenge
name: AI2 Reasoning Challenge (25-Shot)
split: test
type: ai2_arc
metrics: name: normalized accuracy
type: acc_norm
value: 68.17
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=nbeerbower/flammen
task: name: Text Generation
type: text-generation, dataset: args: num_few_shot: 10
name: HellaSwag (10-Shot)
split: validation
type: hellaswag
metrics: name: normalized accuracy
type: acc_norm
value: 87.06
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=nbeerbower/flammen
task: name: Text Generation
type: text-generation, dataset: args: num_few_shot: 5
config: all
name: MMLU (5-Shot)
split: test
type: cais/mmlu
metrics: name: accuracy
type: acc
value: 64.68
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=nbeerbower/flammen
task: name: Text Generation
type: text-generation, dataset: args: num_few_shot: 0
config: multiple_choice
name: TruthfulQA (0-shot)
split: validation
type: truthful_qa
metrics: type: mc2
value: 63.02
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=nbeerbower/flammen
task: name: Text Generation
type: text-generation, dataset: args: num_few_shot: 5
config: winogrande_xl
name: Winogrande (5-shot)
split: validation
type: winogrande
metrics: name: accuracy
type: acc
value: 81.45
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=nbeerbower/flammen
task: name: Text Generation
type: text-generation, dataset: args: num_few_shot: 5
config: main
name: GSM8k (5-shot)
split: test
type: gsm8k
metrics: name: accuracy
type: acc
value: 66.03
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=nbeerbower/flammen
task: name: Text Generation
type: text-generation
pipeline_tag: text-generation
quantized_by: Suparious
tags: 4-bit, AWQ, text-generation, autotrain_compatible, endpoints_compatible, mergekit, merge
Likes: 0 | All-time downloads: 275
Created: 2024-05-03 16:00:19