Hugging Face model: BEE-spoke-data/mega-ar-126m-4k
Author: BEE-spoke-data
Created: 2023-12-26 12:34:04
Last modified: 2026-05-12 05:49:41
Pipeline: text-generation
Library: transformers
Likes: 5 | Downloads: 93
Tags: transformers, safetensors, mega, text-generation, en, dataset:JeanKaddour/minipile, dataset:BEE-spoke-data/wikipedia-20230901.en-deduped, dataset:BEE-spoke-data/knowledge-inoc-concat-v1, arxiv:2209.10655, license:apache-2.0, endpoints_compatible, region:us
Card metadata:
license: apache-2.0
datasets: JeanKaddour/minipile, BEE-spoke-data/wikipedia-20230901.en-deduped, BEE-spoke-data/knowledge-inoc-concat-v1
language: en
inference: parameters: max_new_tokens: 64
do_sample: yes
temperature: 0.8
repetition_penalty: 1.05
no_repeat_ngram_size: 4
epsilon_cutoff: 0.0006
renormalize_logits: yes
pipeline_tag: text-generation