thu-coai
/

LongLM-large

Text2Text Generation Transformers PyTorch Safetensors Chinese t5 lm-head Inference Endpoints text-generation-inference

Model card Files Files and versions Community

Jiann commited on Sep 25, 2022

Commit

b7df389

•

1 Parent(s): 461383e

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -47,6 +47,7 @@ We collect 120G novels as the pretraining data for LongLM.
    ```python\
    from transformers import T5Tokenizer, T5ForConditionalGeneration
    tokenizer = T5Tokenizer.from_pretrained('LongLM-large')
    model = T5ForConditionalGeneration.from_pretrained('LongLM-large')
    ```

    ```python\
    from transformers import T5Tokenizer, T5ForConditionalGeneration
    tokenizer = T5Tokenizer.from_pretrained('LongLM-large')
+   tokenizer.add_special_tokens({"additional_special_tokens": ["<extra_id_%d>"%d for d in range(100)]})
    model = T5ForConditionalGeneration.from_pretrained('LongLM-large')
    ```