Learning a distinct representation for each sense of an ambiguous word could lead to more powerful and fine-grained models of vector-space representations. Yet while 'multi-sense' methods have been proposed and tested on artificial wordsimilarity tasks, we don't know if they improve real natural language understanding tasks. In this paper we introduce a pipelined architecture for incorporating multi-sense embeddings into language understanding, and test the performance of a state-of-the-art multi-sense embedding model (based on Chinese Restaurant Processes). We apply the model to part-of-speech tagging, named entity recognition, sentiment analysis, semantic relation identification and semantic relatedness. We find thatif we carefully control for the number of dimensions-sense-specific embeddings, whether alone or concatenated with standard (one vector for all senses) embeddings, introduce slight performance boost in semantic-related tasks, but is of little in others that depend on correctly identifying a few key words such as sentiment analysis.
Multi-sense embeddings dynamically allocate further vectors to represent new senses of a word REF .
Do Multi-Sense Embeddings Improve Natural Language Understanding?
ArXiv
ArXiv
Computer Science