Hugging Face model: blockblockblock/smol_llama-220M-GQA-bpw5.5
Author: blockblockblock
Created: 2024-03-12 17:28:35
Last modified: 2024-03-12 17:28:48
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 6
Tags: transformers, llama, text-generation, smol_llama, llama2, en, dataset:JeanKaddour/minipile, dataset:pszemraj/simple_wikipedia_LM, dataset:mattymchen/refinedweb-3m, dataset:BEE-spoke-data/knowledge-inoc-concat-v1, license:apache-2.0, model-index, endpoints_compatible, region:us
Card metadata:
language: en
license: apache-2.0
tags: smol_llama, llama2
datasets: JeanKaddour/minipile, pszemraj/simple_wikipedia_LM, mattymchen/refinedweb-3m, BEE-spoke-data/knowledge-inoc-concat-v1
inference: parameters: max_new_tokens: 64
do_sample: yes
temperature: 0.8
repetition_penalty: 1.05
no_repeat_ngram_size: 4
eta_cutoff: 0.0006
renormalize_logits: yes
pipeline_tag: text-generation