Hugging Face model: BEE-spoke-data/smol_llama-220M-GQA
Author: BEE-spoke-data
Created: 2023-12-22 10:48:33
Last modified: 2025-12-29 04:33:48
Pipeline: text-generation
Library: transformers
Likes: 13 | Downloads: 326
Tags: transformers, safetensors, llama, text-generation, smol_llama, llama2, en, dataset:JeanKaddour/minipile, dataset:pszemraj/simple_wikipedia_LM, dataset:mattymchen/refinedweb-3m, dataset:BEE-spoke-data/knowledge-inoc-concat-v1, license:apache-2.0, model-index, text-generation-inference, endpoints_compatible, region:us
Card metadata:
language: en
license: apache-2.0
tags: smol_llama, llama2
datasets: JeanKaddour/minipile, pszemraj/simple_wikipedia_LM, mattymchen/refinedweb-3m, BEE-spoke-data/knowledge-inoc-concat-v1
inference: parameters: max_new_tokens: 64
do_sample: yes
temperature: 0.8
repetition_penalty: 1.05
no_repeat_ngram_size: 4
eta_cutoff: 0.0006
renormalize_logits: yes
pipeline_tag: text-generation