Hugging Face model: mattritchey/smol_llama-220M-GQA-fineweb_edu-Q4_K_M-GGUF
Author: mattritchey
Created: 2024-11-06 16:14:50
Last modified: 2024-11-06 16:14:52
Pipeline: text-generation
Likes: 0 | Downloads: 12
Tags: gguf, edu, continual pretraining, llama-cpp, gguf-my-repo, text-generation, en, dataset:HuggingFaceFW/fineweb-edu, base_model:BEE-spoke-data/smol_llama-220M-GQA-fineweb_edu, base_model:quantized:BEE-spoke-data/smol_llama-220M-GQA-fineweb_edu, license:apache-2.0, model-index, endpoints_compatible, region:us
Base model relation: quantized
Base models: id: BEE-spoke-data/smol_llama-220M-GQA-fineweb_edu
Card metadata:
language: en
license: apache-2.0
tags: edu, continual pretraining, llama-cpp, gguf-my-repo
base_model: BEE-spoke-data/smol_llama-220M-GQA-fineweb_edu
datasets: HuggingFaceFW/fineweb-edu
metrics: accuracy
inference: parameters: max_new_tokens: 64
do_sample: yes
temperature: 0.8
repetition_penalty: 1.05
no_repeat_ngram_size: 4
eta_cutoff: 0.0006
renormalize_logits: yes
pipeline_tag: text-generation