ai-forever
/

sage-fredt5-distilled-95m

Text2Text Generation

natural language generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

ai-forever commited on Apr 18

Commit

ed51b4a

•

1 Parent(s): 24341af

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -163,7 +163,9 @@ We compare our solution with both open automatic spell checkers and the ChatGPT
 from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
 tokenizer = AutoTokenizer.from_pretrained("ai-forever/sage-fredt5-distilled-95m")
-model = AutoModelForSeq2SeqLM.from_pretrained("ai-forever/sage-fredt5-distilled-95m", device_map='cuda')
 sentence = "И не чсно прохожим в этот день непогожйи почему я веселый такйо"
 inputs = tokenizer(sentence, max_length=None, padding="longest", truncation=False, return_tensors="pt")

 from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
 tokenizer = AutoTokenizer.from_pretrained("ai-forever/sage-fredt5-distilled-95m")
+model = AutoModelForSeq2SeqLM.from_pretrained("ai-forever/sage-fredt5-distilled-95m")
+model.to("cuda")
 sentence = "И не чсно прохожим в этот день непогожйи почему я веселый такйо"
 inputs = tokenizer(sentence, max_length=None, padding="longest", truncation=False, return_tensors="pt")