Hugging Face model: Ethangou/attention-residuals-0.6B-block
Author: Ethangou
Created: 2026-04-26 10:03:10
Last modified: 2026-04-26 10:10:09
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 21
Tags: transformers, safetensors, qwen3_attnres, text-generation, pytorch, causal-lm, qwen3, chinese, from-scratch, attention-residuals, block, block-attention-residuals, conversational, zh, dataset:opencsg/Fineweb-Edu-Chinese-V2.2, license:mit, endpoints_compatible, region:us
Card metadata:
license: mit
language: zh
library_name: transformers
pipeline_tag: text-generation
datasets: opencsg/Fineweb-Edu-Chinese-V2.2
metrics: perplexity, accuracy
tags: pytorch, transformers, causal-lm, qwen3, chinese, from-scratch, attention-residuals, block, block-attention-residuals