Hugging Face model: BEE-spoke-data/smol_llama-220M-GQA-fineweb_edu
Author: BEE-spoke-data
Created: 2024-06-08 06:21:44
Last modified: 2025-12-29 04:35:07
Pipeline: text-generation
Library: transformers
Likes: 1 | Downloads: 14
Tags: transformers, safetensors, llama, text-generation, edu, continual pretraining, en, dataset:HuggingFaceFW/fineweb-edu, base_model:BEE-spoke-data/smol_llama-220M-GQA, base_model:finetune:BEE-spoke-data/smol_llama-220M-GQA, license:apache-2.0, model-index, text-generation-inference, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: BEE-spoke-data/smol_llama-220M-GQA
Card metadata:
language: en
license: apache-2.0
tags: edu, continual pretraining
base_model: BEE-spoke-data/smol_llama-220M-GQA
datasets: HuggingFaceFW/fineweb-edu
metrics: accuracy
inference: parameters: max_new_tokens: 64
do_sample: yes
temperature: 0.8
repetition_penalty: 1.05
no_repeat_ngram_size: 4
eta_cutoff: 0.0006
renormalize_logits: yes
pipeline_tag: text-generation