Question: What dataset is used when creating the statistics?
Evidence: Princeton WordNet BIBREF0 is one of the most important resources used in many different tasks across linguistics and natural language processing, however the resource is only available for English and is limited in its coverage of real world concepts. To cross the language barrier, huge efforts have been made to extend the Princeton WordNet with multilingual information in projects, such as EuroWordNet BIBREF1 , BalkaNet BIBREF2 and MultiWordNet BIBREF3 , mostly following the extend approach, where the structure of the Princeton WordNet is preserved and only the words in each synset are translated and new synsets are added for concepts. Furthermore, the Princeton WordNet has many fewer concepts than large scale encyclopedias such as Wikipedia and resources derived from it such as DBpedia BIBREF4 and BabelNet BIBREF5 . This problem is even worse for many non-English wordnets, due to the extend approach, as these resources have even fewer synsets than Princeton WordNet. Furthermore, there are still many languages for which a wordnet does not exist or is not available to all potential users due to licensing restrictions.
To address these deficiencies we propose two approaches. Firstly, we apply high-quality statistical machine translation (SMT) to automatically translate the WordNet entries into several different European languages. While an SMT system can only return the most frequent translation when given a term by itself, we propose a novel method to provide strong word sense disambiguation when translating wordnet entries. In addition, our method can handle fundamental complexities such as the need to translate all senses of a word including low-frequency senses, which is very challenging for current SMT approaches. For these reasons, we leverage existing translations of Princeton WordNet entries in other languages to identify contextual information for wordnet senses from a large set of generic parallel corpora. The goal is to identify sentences that share the same semantic information in respect to the synset of the Princeton WordNet entry that we want to translate. Secondly, we describe a novel system based on state-of-the-art semantic textual similarity and ontology alignment to establish a new linking between Princeton WordNet and DBpedia. This method uses a multi-feature approach to establish similarities between synsets and DBpedia entities based on analysis of the definitions using a variety of methods from simple string statistics, to methods based on explicit semantic analysis as well as deep learning methods including long short-term memory (LSTM) networks. These statistics are created based on the Princeton WordNet synset gloss as well as the neighbouring words in the WordNet graph. These are combined using a constraint-based solver that considers not only the semantic similarity of the synsets but also the overall structure of the alignment and its consistency, following the best practices in ontology alignment.
This work has led to the development of a large multilingual WordNet in more than 20 European languages, which we call Polylingual WordNet BIBREF6 , which is available under an open (CC-BY) license. Finally, we describe how this resource is published, firstly as linked data in the linguistic linked open data cloud, as well as published in all the formats of the Global WordNet Association Interlingual Index.
These statistics are created based on the Princeton WordNet synset gloss as well as the neighbouring words in the WordNet graph.
Answer: The Princeton WordNet synset.