---
license: openrail
datasets:
- wikipedia
language:
- zh
metrics:
- perplexity
library_name: transformers
pipeline_tag: text-generation
tags:
- code
---

参数：vocab_size=12829,num_hidden_layers=8,num_attention_heads=8,intermediate_size=1024,max_position_embeddings=512,hidden_size=512