cameltech
/

japanese-gpt-1b-PII-masking

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

ksuzuki01 commited on Apr 11

Commit

8303f9f

•

1 Parent(s): 58c9c9c

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -11,7 +11,7 @@ widget:
     # 入力文
-    渡邉亮です。現在の住所は東京都世田谷区代沢1-2-3です。</s>
     '
 inference:
@@ -68,7 +68,7 @@ def preprocess(text):
 def postprocess(text):
     return text.replace("<LB>", "\n")
-input_text += tokenizer.eos_token
 input_text = preprocess(input_text)
 with torch.no_grad():

     # 入力文
+    渡邉亮です。現在の住所は東京都世田谷区代沢1-2-3です。<SEP>
     '
 inference:
 def postprocess(text):
     return text.replace("<LB>", "\n")
+input_text += "<SEP>"
 input_text = preprocess(input_text)
 with torch.no_grad():