SJ-Ray/Re-Punctuate

Re-Punctuate:

Re-Punctuate is a T5 model that attempts to correct Capitalization and Punctuations in the sentences.

DataSet:

DialogSum dataset (115056 Records) was used to fine-tune the model for Punctuation and Capitalization correction.

Usage:

from transformers import T5Tokenizer, TFT5ForConditionalGeneration

tokenizer = T5Tokenizer.from_pretrained('SJ-Ray/Re-Punctuate')
model = TFT5ForConditionalGeneration.from_pretrained('SJ-Ray/Re-Punctuate')

input_text = 'the story of this brave brilliant athlete whose very being was questioned so publicly is one that still captures the imagination'
inputs = tokenizer.encode("punctuate: " + input_text, return_tensors="tf") 
result = model.generate(inputs)

decoded_output = tokenizer.decode(result[0], skip_special_tokens=True)
print(decoded_output)

Example:

Input: the story of this brave brilliant athlete whose very being was questioned so publicly is one that still captures the imagination
Output: The story of this brave, brilliant athlete, whose very being was questioned so publicly, is one that still captures the imagination.

Connect on: LinkedIn : Suraj Kumar