Model: NikolayKozloff/latxa-7b-v1.2-Q8_0-GGUF
Author: NikolayKozloff
Pipeline: text-generation
Tags: gguf, llama-cpp, gguf-my-repo, text-generation, eu, en, dataset:HiTZ/latxa-corpus-v1.1, base_model:HiTZ/latxa-7b-v1.2, base_model:quantized:HiTZ/latxa-7b-v1.2, license:llama2, model-index, endpoints_compatible, region:us
Base models (quantized): id: HiTZ/latxa-7b-v1.2
Card metadata: base_model: HiTZ/latxa-7b-v1.2
datasets: HiTZ/latxa-corpus-v1.1
language: eu, en
license: llama2
metrics: accuracy, f1, perplexity
pipeline_tag: text-generation
tags: llama-cpp, gguf-my-repo
model-index: name: Latxa-7b-v1.2
results: task: type: multiple-choice
dataset: name: xstory_cloze
type: XStory
metrics: type: Accuracy (0-shot)
value: 65.72
name: Accuracy (0-shot)
verified: no
source: url: https://arxiv.org/abs/2403.20266
name: Paper, task: type: multiple-choice
dataset: name: belebele
type: Belebele
metrics: type: Accuracy (5-shot)
value: 36.89
name: Accuracy (5-shot)
verified: no
source: url: https://arxiv.org/abs/2403.20266
name: Paper, task: type: mix
dataset: name: basque_glue
type: BasqueGLUE
metrics: type: Average scores (5-shot)
value: 51.78
name: Average scores (5-shot)
verified: no
source: url: https://arxiv.org/abs/2403.20266
name: Paper, task: type: multiple_choice
dataset: name: eus_proficiency
type: EusProficiency
metrics: type: Accuracy (5-shot)
value: 32.44
name: Accuracy (5-shot)
verified: no
source: url: https://arxiv.org/abs/2403.20266
name: Paper, task: type: multiple_choice
dataset: name: eus_reading
type: EusReading
metrics: type: Accuracy (5-shot)
value: 30.4
name: Accuracy (5-shot)
verified: no
source: url: https://arxiv.org/abs/2403.20266
name: Paper, task: type: multiple_choice
dataset: name: eus_trivia
type: EusTrivia
metrics: type: Accuracy (5-shot)
value: 44.37
name: Accuracy (5-shot)
verified: no
source: url: https://arxiv.org/abs/2403.20266
name: Paper, task: type: multiple_choice
dataset: name: eus_exams
type: EusExams
metrics: type: Accuracy (5-shot)
value: 34.2
name: Accuracy (5-shot)
verified: no
source: url: https://arxiv.org/abs/2403.20266
name: Paper
Likes: 1 | All-time downloads: 22
Created: 2024-06-24 15:25:12