Hugging Face model: Lyon28/caca-650M-untrained
Author: Lyon28
Created: 2026-07-20 19:48:18
Last modified: 2026-07-20 19:49:16
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 46
Tags: transformers, safetensors, caca, text-generation, pytorch, causal-lm, transformer, untrained, mla, multi-token-prediction, qk-norm, rope, yarn, swiglu, rmsnorm, sliding-window-attention, indonesian, bilingual, custom_code, id, en, license:apache-2.0, region:us
Card metadata:
license: apache-2.0
language: id, en
tags: text-generation, pytorch, causal-lm, transformer, untrained, mla, multi-token-prediction, qk-norm, rope, yarn, swiglu, rmsnorm, sliding-window-attention, indonesian, bilingual
library_name: transformers
pipeline_tag: text-generation
inference: parameters: max_new_tokens: 100
temperature: 0.7
top_p: 0.9
top_k: 50
do_sample: yes
repetition_penalty: 1.1
metrics: perplexity