Model: solidrust/MixtureofMerges-MoE-2x7b-SLERPv0.9-AWQ
Author: solidrust
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, mixtral, text-generation, 4-bit, AWQ, autotrain_compatible, endpoints_compatible, merge, mergekit, lazymergekit, jsfs11/MixtureofMerges-MoE-2x7b-v7, jsfs11/MixtureofMerges-MoE-2x7bRP-v8, base_model:jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9, base_model:quantized:jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9, license:apache-2.0, model-index, text-generation-inference, awq, region:us
Base models (quantized): id: jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9
Card metadata: base_model: jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9
inference: no
library_name: transformers
license: apache-2.0
merged_models: jsfs11/MixtureofMerges-MoE-2x7b-v7, jsfs11/MixtureofMerges-MoE-2x7bRP-v8
model-index: name: MixtureofMerges-MoE-2x7b-SLERPv0.9
results: dataset: args: num_few_shot: 25
config: ARC-Challenge
name: AI2 Reasoning Challenge (25-Shot)
split: test
type: ai2_arc
metrics: name: normalized accuracy
type: acc_norm
value: 73.12
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9
task: name: Text Generation
type: text-generation, dataset: args: num_few_shot: 10
name: HellaSwag (10-Shot)
split: validation
type: hellaswag
metrics: name: normalized accuracy
type: acc_norm
value: 88.76
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9
task: name: Text Generation
type: text-generation, dataset: args: num_few_shot: 5
config: all
name: MMLU (5-Shot)
split: test
type: cais/mmlu
metrics: name: accuracy
type: acc
value: 65
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9
task: name: Text Generation
type: text-generation, dataset: args: num_few_shot: 0
config: multiple_choice
name: TruthfulQA (0-shot)
split: validation
type: truthful_qa
metrics: type: mc2
value: 74.83
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9
task: name: Text Generation
type: text-generation, dataset: args: num_few_shot: 5
config: winogrande_xl
name: Winogrande (5-shot)
split: validation
type: winogrande
metrics: name: accuracy
type: acc
value: 83.58
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9
task: name: Text Generation
type: text-generation, dataset: args: num_few_shot: 5
config: main
name: GSM8k (5-shot)
split: test
type: gsm8k
metrics: name: accuracy
type: acc
value: 69.22
verified: no
source: name: Open LLM Leaderboard
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9
task: name: Text Generation
type: text-generation
pipeline_tag: text-generation
quantized_by: Suparious
tags: 4-bit, AWQ, text-generation, autotrain_compatible, endpoints_compatible, merge, mergekit, lazymergekit, jsfs11/MixtureofMerges-MoE-2x7b-v7, jsfs11/MixtureofMerges-MoE-2x7bRP-v8
Likes: 0 | All-time downloads: 223
Created: 2024-04-18 04:23:33