Model: fredericowieser/TinyLlama_v1.1_mix_wikitext_alpaca_1bit_BitDistiller_baseline
Author: fredericowieser
Tags: safetensors, llama, en, dataset:mindchain/wikitext2, dataset:yahma/alpaca-cleaned, base_model:TinyLlama/TinyLlama_v1.1, base_model:finetune:TinyLlama/TinyLlama_v1.1, model-index, region:us
Base models (finetune): id: TinyLlama/TinyLlama_v1.1
Card metadata: language: en
datasets: mindchain/wikitext2, yahma/alpaca-cleaned
metrics: perplexity, accuracy
base_model: TinyLlama/TinyLlama_v1.1
model-index: name: TinyLlama_v1.1_mix_wikitext_alpaca_1bit_BitDistiller_baseline
results: task: type: multiple-choice
name: QA Benchmarking
dataset: type: allenai/arc
name: ARC-Challenge
config: challenge
split: test
metrics: type: accuracy
name: Accuracy
value: 0.2150170648464164
verified: no, type: accuracy
name: Normalized Accuracy
value: 0.24744027303754265
verified: no, task: type: multiple-choice
name: QA Benchmarking
dataset: type: hellaswag
name: HellaSwag
split: test
metrics: type: accuracy
name: Accuracy
value: 0.2568213503286198
verified: no, type: accuracy
name: Normalized Accuracy
value: 0.253359888468433
verified: no, task: type: multiple-choice
name: QA Benchmarking
dataset: type: piqa
name: PIQA
split: validation
metrics: type: accuracy
name: Accuracy
value: 0.5282916213275299
verified: no, type: accuracy
name: Normalized Accuracy
value: 0.5027203482845702
verified: no, task: type: multiple-choice
name: QA Benchmarking
dataset: type: winogrande
name: Winogrande
split: test
metrics: type: accuracy
name: Accuracy
value: 0.5122336227308603
verified: no, task: type: multiple-choice
name: QA Benchmarking
dataset: type: aggregated
name: QA-Avg
metrics: type: accuracy
name: QA Average
value: 0.3780991480835666
verified: no
Likes: 0 | All-time downloads: 69
Created: 2025-03-11 23:50:26