Model: LemiSt/SmolLM-135M-instruct-de-merged
Author: LemiSt
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, llama, text-generation, axolotl, generated_from_trainer, conversational, de, base_model:LemiSt/SmolLM-135M-de, base_model:finetune:LemiSt/SmolLM-135M-de, license:apache-2.0, model-index, text-generation-inference, endpoints_compatible, region:us
Base models (finetune): id: LemiSt/SmolLM-135M-de
Card metadata: base_model: LemiSt/SmolLM-135M-de
library_name: transformers
license: apache-2.0
tags: axolotl, generated_from_trainer
model-index: name: SmolLM-135M-instruct-de-merged
results: task: type: text-generation
dataset: name: openai/MMMLU
type: mmlu
metrics: name: MMMLU(DE_DE) (0-Shot)
type: accuracy
value: 25.57
verified: no, task: type: text-generation
dataset: name: openai/MMMLU
type: mmlu
metrics: name: MMMLU(DE_DE) (5-Shot)
type: accuracy
value: 24.88
verified: no, task: type: text-generation
dataset: name: alexandrainst/m_arc
type: arc
metrics: name: ARC Challenge (DE) (0-Shot)
type: accuracy
value: 24.29
verified: no, task: type: text-generation
dataset: name: alexandrainst/m_arc
type: arc
metrics: name: ARC Challenge (DE) (5-Shot)
type: accuracy
value: 24.38
verified: no, task: type: text-generation
dataset: name: deutsche-telekom/Ger-RAG-eval
type: Ger-RAG-eval
metrics: name: Task 1
type: accuracy
value: 25.2
verified: no, name: Task 2
type: accuracy
value: 27.1
verified: no, name: Task 3
type: accuracy
value: 50.9
verified: no, name: Task 4
type: accuracy
value: 50
verified: no
language: de
pipeline_tag: text-generation
Likes: 0 | All-time downloads: 448
Created: 2024-10-10 11:07:01