Deep1994/t5-paraphrase-quora

Model description

​T5 Model for generating paraphrases of english sentences. Trained on the Quora Paraphrase dataset.

Online demo website

Click https://huggingface.co/spaces/Deep1994/t5-paraphrase to have a try online.

How to use

from transformers import T5ForConditionalGeneration, T5Tokenizer
import torch

def set_seed(seed):
    torch.manual_seed(seed)
    if torch.cuda.is_available():
        torch.cuda.manual_seed_all(seed)

set_seed(1234)

model = T5ForConditionalGeneration.from_pretrained('Deep1994/t5-paraphrase-quora')
tokenizer = T5Tokenizer.from_pretrained('Deep1994/t5-paraphrase-quora')

device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
model = model.to(device)

sentence = "What is the best comedy TV serial/series?"

text =  "paraphrase: " + sentence

encoding = tokenizer.encode_plus(text, pad_to_max_length=True, return_tensors="pt")
input_ids, attention_masks = encoding["input_ids"].to(device), encoding["attention_mask"].to(device)

# top k/ top p sampling
beam_outputs = model.generate(
    input_ids=input_ids, 
    attention_mask=attention_masks,
    do_sample=True,
    max_length=20,
    top_k=50,
    top_p=0.95,
    early_stopping=True,
    num_return_sequences=5
)

# beam search
# beam_outputs = model.generate(
#     input_ids=input_ids, 
#     attention_mask=attention_masks, 
#     max_length=20, 
#     num_beams=5, 
#     no_repeat_ngram_size=2, 
#     num_return_sequences=5, 
#     early_stopping=True
# )

print ("\nOriginal Question: ")
print (sentence)
print ("\n")
print ("Paraphrased Questions: ")
final_outputs = []
for beam_output in beam_outputs:
    sent = tokenizer.decode(beam_output, skip_special_tokens=True, clean_up_tokenization_spaces=True)
    if sent.lower() != sentence.lower() and sent not in final_outputs:
        final_outputs.append(sent)

for i, final_output in enumerate(final_outputs):
    print("{}: {}".format(i, final_output))

Original Question:
What is the best comedy TV serial/series?

Beam search: 
0: What is the best comedy TV series?
1: What are some of the best comedy TV series?
2: Which is the best comedy TV series?
3: What are the best comedy TV series?
4: What are some of the best comedy TV shows?

Top k/ Top p sampling:
0: What are some of the best comedy TV dramas?
1: What are the best comedy TV series or series?
2: What are the best comedy television serials?
3: What is the best comedy series?
4: Which are some best comedy TV series series?

For more reference on training your own T5 model, do check out t5-paraphrase-generation.