title: PolyLM: Learning about polysemy through language modeling

authors: Ansell, Alan

abstract: To avoid the “meaning conflation deficiency” of word embeddings, a number of models have aimed to embed individual word senses. These methods at one time performed well on tasks such as word sense induction (WSI), but they have since been overtaken by task-specific techniques which exploit contextualized embeddings. However, sense embeddings and contextualization need not be mutually exclusive. We introduce PolyLM, a method which formulates the task of learning sense embeddings as a language modeling problem, allowing contextualization techniques to be applied. PolyLM is based on two underlying assumptions about word senses: firstly, that the probability of a word occurring in a given context is equal to the sum of the probabilities of its individual senses occurring; and secondly, that for a given occurrence of a word, one of its senses tends to be much more plausible in the context than the others. We evaluate PolyLM on WSI, showing that it performs considerably better than previous sense embedding techniques, and matches the current state-of-the-art specialized WSI method despite having six times fewer parameters. Code and pre-trained models are available at https://github.com/AlanAnsell/PolyLM.

text: PolyLM: Learning about polysemy through language modeling To avoid the “meaning conflation deficiency” of word embeddings, a number of models have aimed to embed individual word senses. These methods at one time performed well on tasks such as word sense induction (WSI), but they have since been overtaken by task-specific techniques which exploit contextualized embeddings. However, sense embeddings and contextualization need not be mutually exclusive. We introduce PolyLM, a method which formulates the task of learning sense embeddings as a language modeling problem, allowing contextualization techniques to be applied. PolyLM is based on two underlying assumptions about word senses: firstly, that the probability of a word occurring in a given context is equal to the sum of the probabilities of its individual senses occurring; and secondly, that for a given occurrence of a word, one of its senses tends to be much more plausible in the context than the others. We evaluate PolyLM on WSI, showing that it performs considerably better than previous sense embedding techniques, and matches the current state-of-the-art specialized WSI method despite having six times fewer parameters. Code and pre-trained models are available at https://github.com/AlanAnsell/PolyLM.

year: 2021

title: Contract cheating: What educators can do when their students are getting third parties to undertake their assessment

authors: Williamson, Myra Elsie Jane Bell

subjects: contract cheating

abstract: This is the Powerpoint presentation (28 slides) which supported my oral presentation at LearnFest19, organised by the Centre for Tertiary Teaching and Learning (CeTTL) on 6 November 2019.

text: Contract cheating: What educators can do when their students are getting third parties to undertake their assessment This is the Powerpoint presentation (28 slides) which supported my oral presentation at LearnFest19, organised by the Centre for Tertiary Teaching and Learning (CeTTL) on 6 November 2019.

year: 2019

title: Māori Goddesses in Literature Part 1: pre 1880 - 1900

authors: Yates-Smith, Aroha

subjects: Atua wāhine

abstract: Many contemporary Māori are familiar with atua wāhine, Māori goddesses, through accounts that have been passed on to them by word of mouth. Few, however, have had an opportunity to consult accounts of atua wāhine that date from the early period of Māori-Pākehā contact. Those who wish to do so may have considerable difficulty in sifting through all of the written materials for the information they seek. For this reason, this paper provides a review of the literature pertaining to atua wāhine from pre-1880 to 1900, together with a commentary on the sources to which reference is made. A review of literature on atua wāhine which appeared after 1900 will appear in the second volume of this journal.

text: Māori Goddesses in Literature Part 1: pre 1880 - 1900 Many contemporary Māori are familiar with atua wāhine, Māori goddesses, through accounts that have been passed on to them by word of mouth. Few, however, have had an opportunity to consult accounts of atua wāhine that date from the early period of Māori-Pākehā contact. Those who wish to do so may have considerable difficulty in sifting through all of the written materials for the information they seek. For this reason, this paper provides a review of the literature pertaining to atua wāhine from pre-1880 to 1900, together with a commentary on the sources to which reference is made. A review of literature on atua wāhine which appeared after 1900 will appear in the second volume of this journal.

year: 2000-10