File size: 568 Bytes
c1d0724
 
daef7e3
c1d0724
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
## Usage
Please use BertTokenizerFast as tokenizer instead of AutoTokenizer.

請使用 BertTokenizerFast 而非 AutoTokenizer。
```
from transformers import (
  BertTokenizerFast,
  AutoModelForCausalLM,
)

tokenizer = BertTokenizerFast.from_pretrained('bert-base-chinese')
model = AutoModelForCausalLM.from_pretrained('ckiplab/gpt2-base-chinese')
```
### Input Format
```
C' = [c1, c2, ..., [HL], a1, ..., a|A|, [HL], ..., c|C|]
```
### Input Example
```
哈利·波特是英國作家[HL]羅琳[HL]撰寫的七部幻想小說系列。
```
> 誰撰寫哈利·波特?