savasy
/

mt0-large-Turkish-qa

Question Answering

text-generation

Model card Files Files and versions Community

savasy commited on Jun 21, 2023

Commit

f8fe556

•

1 Parent(s): 85307d8

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -65,7 +65,7 @@ from tqdm import tqdm
 with torch.no_grad():
   for batch in tqdm(data_loader):
     inputs = tokenizer(batch, return_tensors="pt", padding=True).to("cuda")
-    generated_ids = model.generate(**inputs)
     outputs = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)
     preds+=outputs
 ```

 with torch.no_grad():
   for batch in tqdm(data_loader):
     inputs = tokenizer(batch, return_tensors="pt", padding=True).to("cuda")
+    generated_ids = inference_model.generate(**inputs)
     outputs = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)
     preds+=outputs
 ```