B hojpuri W ord N et: Problems in Translating H indi Synsets into B hojpuri (2023)

Abstract: Today, artificial intelligence systems are incredibly intelligent, however they lack the human like capacity for understanding. In this context, sense-based lexical resources become a requirement for artificially intelligent machines. Lexical resources like Wordnets have received scholarly attention because they are considered as the crucial sense-based resources in the field of natural language understanding. They can help in knowing the intended meaning of the communicated texts, as they are focused on the concept rather than the words. Wordnets are available only for 18 Indian languages. Keeping this in mind, we have initiated the development of a comprehensive wordnet for Bhojpuri. The present paper describes the creation of the synsets of Bhojpuri and discusses the problems that we faced while translating Hindi synsets into Bhojpuri. They are lexical anomalies, lexical mismatch words, synthesized forms, lack of technical words etc. Nearly 4000 Hindi synsets were mapped for their equivalent synsets in Bhojpuri following the expansion approach. We have also worked on the language-specific synsets, which are unique to Bhojpuri. This resource is useful in machine translation, sentiment analysis, word sense disambiguation, cross-lingual references among Indian languages, and Bhojpuri language teaching and learning.

## introduction today's era is one of science and technology. people have been communicating using the internet and social media and enjoying different forms of media and entertainment. for this, they require accessible resources in their own languages; however, we indians are forced to depend on the tools that are available, either in english or only in a few major indian languages. the creation of linguistic resources in a language, particularly in a low-resourced language, is a very challenging task. to understand the intended meaning of a communicated text, one needs knowledge of the world along with competency in the language, which cannot be captured with any traditional resources as meaning resides not in the words but in the minds of the people using them @xcite . we need a very comprehensive and intelligent tool to understand a text like a human. in recent years, wordnets have been considered a very crucial tool in the field of natural language processing. wordnet is an online lexical resource and a semantic network @xcite . it is constituted of synsets. each synset expresses a distinct concept. so synsets are the basic building blocks of wordnet @xcite ). wordnet's design is inspired by the current psycholinguistic theories of human lexical memory @xcite . wordnet stores lexical items in ontological that are used to represent is-a-kind-of, is-a-part-of and other relations such as the hypernymy-hyponymy and holonymy-meronymy. wordnets have been developed for more than 200 languages @xcite because wordnets are considered to be the most important lexical resource available for natural language processing tasks like word sense disambiguation, information retrieval, machine translation, sentiment analysis, and as well as for language learning and teaching. wordnets have been developed for 18 indian languages @xcite . except hindi, all indian language wordnets have been developed following the expansion approach, and hindi has been considered as their source language @xcite . bhojpuri is a spoken by millions of people in india, as well as in several countries such as mauritius, nepal, and others throughout the world. there are fewer efforts have been made in the realm of digitization and the development of lexical resources for this language. this is the motivation behind the creation of bhojpuri wordnet. the main goal of this paper is to create synsets for bhojpuri. we have discussed the creation of bhojpuri synsets, considering hindi synsets as its source language. we followed the expansion approach to create bhojpuri synsets. the paper is divided into six sections. section 2 discusses the related research on wordnets, particularly in the indian context. section 3 briefly explains the bhojpuri wordnet, its methodology, and the statistics of the bhojpuri synsets. section 4 covers the problems and difficulties encountered while translating hindi synsets into bhojpuri. section 5 explores bhojpuri language-specific synsets, and we conclude the paper in the last section. ## review of literature the first wordnet was developed for the english language at princeton university in 1985 by g. a. miller. it contains only content words. it doesn't give pronunciation, etymology, usage notes, or pictorial illustrations. the current structure of word-net was inspired by levin's works english verb classes and alternations @xcite . levin tried to organize more than 3,000 english verbs into categories based on their common behavior and meaning @xcite . wordnet is structured in lexical hierarchies in the form of synsets. synsets are a set of synonyms. minimality, coverage, and replaceability (mcr) principles govern the creation of the synsets @xcite . minimality means the synonyms must have minimal differences from other synonyms, coverage is that the synonyms must cover the concept, and replaceability is the synonyms that could be substituted in most cases without changing the meaning of a concept. here, in wordnet, the focus shifts from words to concepts @xcite . later wordnets for european languages were developed under an umbrella project for 8 european languages like dutch, spanish, italian, german, french, czech, and estonian @xcite . it was named euro wordnet and developed under the headship of p. @xcite @xcite . each concept was linked to the closest synset in princeton's wordnet. so it allows crosslanguage information retrieval from one language to another. in recent, there were efforts to develop lexical resources for low resource languages like kangleiwordnet. it was developed at iiit, manipur. for its development, both the linkage approach and the expansion approach were applied to @xcite . it is an integrated wordnet of 5 major local languages of manipur, viz., manipuri, tankhul, thadou, mao, and kabui wordnets. for khagleiwordnet, the linked language is manipuri instead of hindi and english is used as the sec-ondary language. apart from it, (m, 2017) worked for tirukkural wordnet. he used the expansion approach, but tamil as the pivot language. ## the bhojpuri wordnet (bwn) the bhojpuri wordnet is a sense-based lexical resource for the bhojpuri. it has been developed following the expansion approach and has used hindi as its source language. bhojpuri wordnet interface enlists synset id, synonyms, gloss, examples, and word categories and represents the concepts in mcr principles of wordnet. since the bhojpuri wordnet uses hindi as its pivot language, many indigenous concepts practiced by the bhojpuri community are not listed in the hindi wordnet. so this wordnet also includes the bhojpuri languagespecific synsets (blss) for total inclusion of the indigenous knowledge of the community on the technical front. ## issues and challenges since we are using hindi synsets to create bhojpuri synsets following the expansion approach, we have to translate the hindi synsets into bhojpuri. while translating from one language to another, we encountered many lexical and semantic gaps due to the socio-cultural differences, morphological richness of the languages, and so on. therefore, we also faced many difficulties while creating synsets for bhojpuri. in this section, we are going to disfigure 2: architecture of bhojpuri synset creation ## bhojpuri language-specific synsets language specific synsets refers to unique concepts which are available only in the particular language and no conceptual match is find in other languages @xcite . every language has some concepts or ideas which are unique to only that language. since bhojpuri wordnet is being developed by using hindi synsets so here, there is potential that many indigenous concepts specific to bhojpuri might have not been listed in the hindi synsets. so there is a need of language specific synsets for bhojpuri. these language specific words are called thethee (desee). sometimes, it is better to call it regional specific synsets instead of language specific synsets @xcite . to create bhojpuri language-specific synsets, we first collect and assemble a list of lss for bhojpuri and provide a complete description of the lss and examples of its usage in sentences, with a pictorial depiction if possible. we do comparison and validation across languages. we study these lsss carefully to determine whether they are really monolingual in nature, or originated in the language, and fit the lss principles (dash, 2017a). if the concept appears unique to bhojpuri, we consider it as bhojpuri language-specific synsets (blss) otherwise the lss is dropped. following confirmations, we approve and augment them in the bhojpuri lss database (in blss.accdb). till now, we have recorded 100 language specific synsets for bhojpuri. some of those have been listed in the