T5-large for Word Sense Disambiguation

This is the checkpoint for T5-large after being trained on the SemCor 3.0 dataset.

Additional information about this model:

The model can be loaded to perform a few-shot classification like so:

from transformers import AutoModelForSeq2SeqLM, AutoTokenizer


input = 'question: which description describes the word " java " best in the following context? \
descriptions:[  " A drink consisting of an infusion of ground coffee beans " , 
                " a platform-independent programming lanugage "
                ,  or " an island in Indonesia to the south of Borneo " ] 
context: I like to drink " java " in the morning .'

example = tokenizer.tokenize(input, add_special_tokens=True)

answer = model.generate(input_ids=example['input_ids'], 
# "a distinguishing trait"
Downloads last month
Hosted inference API
Text2Text Generation
This model can be loaded on the Inference API on-demand.