Hugging Face model: BEE-spoke-data/smol_llama-101M-GQA
Author: BEE-spoke-data
Created: 2023-10-26 07:32:37
Last modified: 2025-12-29 04:33:29
Pipeline: text-generation
Library: transformers
Likes: 33 | Downloads: 528
Tags: transformers, safetensors, llama, text-generation, smol_llama, llama2, en, dataset:JeanKaddour/minipile, dataset:pszemraj/simple_wikipedia_LM, dataset:BEE-spoke-data/wikipedia-20230901.en-deduped, dataset:mattymchen/refinedweb-3m, doi:10.57967/hf/1440, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Card metadata:
license: apache-2.0
language: en
inference: parameters: max_new_tokens: 64
do_sample: yes
temperature: 0.8
repetition_penalty: 1.15
no_repeat_ngram_size: 4
eta_cutoff: 0.0006
renormalize_logits: yes
pipeline_tag: text-generation
tags: smol_llama, llama2
datasets: JeanKaddour/minipile, pszemraj/simple_wikipedia_LM, BEE-spoke-data/wikipedia-20230901.en-deduped, mattymchen/refinedweb-3m