Hugging Face model: Lyon28/caca-500M-untrained
Author: Lyon28
Created: 2026-07-19 13:21:50
Last modified: 2026-07-19 15:16:40
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 74
Tags: transformers, safetensors, caca, text-generation, pytorch, causal-lm, transformer, untrained, gqa, rope, swiglu, rmsnorm, flash-attention, indonesian, bilingual, custom_code, id, en, arxiv:2302.13971, arxiv:2307.08691, arxiv:2305.13245, arxiv:2104.09864, arxiv:2108.12409, arxiv:2309.00071, arxiv:2310.06825, arxiv:2309.17453, arxiv:2403.08295, arxiv:2401.04088, arxiv:2101.03961, arxiv:2103.17239, arxiv:1603.09382, arxiv:2404.02258, arxiv:2208.07339, arxiv:2305.14314, arxiv:2010.11929, arxiv:2204.14198, arxiv:2301.12597, arxiv:1910.07467, arxiv:2002.05202, license:apache-2.0, region:us
Card metadata:
license: apache-2.0
language: id, en
tags: text-generation, pytorch, causal-lm, transformer, untrained, gqa, rope, swiglu, rmsnorm, flash-attention, indonesian, bilingual
library_name: transformers
pipeline_tag: text-generation
inference: parameters: max_new_tokens: 100
temperature: 0.7
top_p: 0.9
top_k: 50
do_sample: yes
repetition_penalty: 1.1
num_beams: 1
metrics: perplexity, accuracy