Zimix commited on
Commit
19d6f53
1 Parent(s): 858cdc3

add readme

Browse files
Files changed (1) hide show
  1. README.md +27 -0
README.md ADDED
@@ -0,0 +1,27 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - zh
4
+ license: apache-2.0
5
+ widget:
6
+ - text: "生活的真谛是[MASK]。"
7
+ ---
8
+ # Yuyuan-3.5B model (chinese),one model of [Fengshenbang-LM](https://github.com/IDEA-CCNL/Fengshenbang-LM).
9
+ As we all know, the single direction language model based on decoder structure has strong generation ability, such as GPT model. **The 3.5 billion parameter Wenzhong-3.5B large model, using 100G chinese common data, 32 A100 training for 28 hours,** is the largest open source **GPT2 large model of chinese**. **Our model performs well in Chinese continuation generation.**
10
+
11
+ ## Usage
12
+ ```python
13
+ from transformers import pipeline, set_seed
14
+
15
+ set_seed(55)
16
+
17
+ generator = pipeline('text-generation', model='IDEA-CCNL/Wenzhong-3.5B')
18
+
19
+ generator("北京位于", max_length=30, num_return_sequences=1)
20
+
21
+ ```
22
+
23
+ ## Citation
24
+ If you find the resource is useful, please cite the following website in your paper.
25
+ ```
26
+ https://github.com/IDEA-CCNL/Fengshenbang-LM
27
+ ```