wangyulong commited on
Commit
799151a
•
1 Parent(s): b9359a9

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -0
README.md ADDED
@@ -0,0 +1,20 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - zh
4
+ license: apache-2.0
5
+ ---
6
+ # Mengzi-BERT base fin model (Chinese)
7
+ Continue trained based on mengzi-bert-base with 20G financial news and research reports. Masked language modeling(MLM), part-of-speech(POS) tagging and sentence order prediction(SOP) are used as training task.
8
+ [Mengzi: A lightweight yet Powerful Chinese Pre-trained Language Model](www.example.com)
9
+ ## Usage
10
+ ```python
11
+ from transformers import BertTokenizer, BertModel
12
+ tokenizer = BertTokenizer.from_pretrained("Langboat/mengzi-bert-base-fin")
13
+ model = BertModel.from_pretrained("Langboat/mengzi-bert-base-fin")
14
+ ```
15
+
16
+ ## Citation
17
+ If you find the technical report or resource is useful, please cite the following technical report in your paper.
18
+ ```
19
+ example
20
+ ```