# Developing a Hybrid Morphological Analyzer for Low-Resource Languages
## 3 Methodology
### Dataset Creation
#### 3.1.3 Paradigm Generation
The dataset provided by _Kannada Vishwa Vidyaluya, Hampi_ covers major words of the modern Kannada language to which the rule-based morphological analyzer has been built for all POS categories. The morphological analyzer generates inflectional analysis for nouns, pronouns, verbs, indeclinables, and adjectives present in the dictionary based on predefined rules. As most Kannada nouns could be categorized into paradigms defined in the paper, the Transformer training was focused on inflectional morphology for nouns. Further, this work can be expanded onto verbal inflections by curating an extensive dataset capturing the inflectional rule of verbs as carried out for nouns. The morphological analyzer covers the majority of the common words in Kannada, and the analysis is helpful in developing language-related tools like chunker, POS tagger, stemmer, Named Entity Recognition (NER) and machine translation systems in Kannada. The scope of this work is limited to inflectional morphology, so compound words and derivational morphology are not included. At present, nouns ending with consonants and borrowed foreign words from English, Hindi, Arabic, Oriya, Gujarati, Tamil, Tulu, Telugu, Punjabi, Parsi, Marathi, Malayalam, Sindhi and Sanskrit are not handled. The proposed research is challenging due to the complex structure of the Kannada language. A total of 9879 words have been mapped onto 85 paradigms and 205,659 word inflections have been analyzed. Any new nominal inflection can be analyzed using the proposed model, which contributes additionally in extracting the linguistic information. We observe that the rule-based model retrieves morphological analysis more quickly for words present in the corpus, while the Transformer-based model excels at generating analyses for new words not found in the dictionary. The precision, recall and F1-score obtained are 0.924, 0.925 and 0.925, respectively, on the test set for inflections in Kannada. The inflections tested had no overlap with data seen during the training, and the results are promising. This study can be extended to a wider dictionary for further enhancements. The proposed technique is suitable for low-resource languages to create their own unique dataset, which is beneficial in developing language-specific NLP tools. Better results can be expected with a larger dictionary of root words, and the data/paradigms can be widely extended. It will be interesting to pursue word analysis in derivational morphology and consonant ending nouns of the ancient Kannada language in a future work. Conceptualization, A.S.R. and M.S. ; methodology, A.S.R. and M.S. ; software, M.S. ; validation, D.A.U., A.N. and M.S. ; investigation, M.S. ; resources, M.S. ; data curation, M.S. ; writing--original draft preparation, M.S. and A.S.R. ; writing--review and editing, D.A.U., A.N. and A.S.R. ; visualization, M.S. ; supervision, D.A.U. and A.N. ; project administration, D.A.U. and A.N. All authors have read and agreed to the published version of the manuscript. This research received no external funding. Not applicable. The raw data supporting the conclusions of this article will be made available by the authors on request. We acknowledge the support extended by the director and authors of _Saujanya Prasaranga Kamada Vishra Vidyaluya, Hampi_ for granting permission to use their dictionary _Sankshipta_Adhunika Kamada Nishantu_, which is used in developing this morphological analyzer tool. We are thankful for the support extended by [PERSON], Department of Sanskrit Studies, University of Hyderabad, for guiding us during the initial steps of morphological analyzer development using Apertium. We are thankful to [PERSON], Secretary, Kannada Ganaka Parishat, Bengaluru, for providing guidelines to utilize the existing dataset and [PERSON], Director of Studies (Prachya Sanchaya Samshodhana Kendra, A Unit of NTCAMO), co-editor and technical expert of Folk Lexicon, Karnataka Janapada Vishwavidyalaya, Gotagodi, Karnataka, and technical expert to the Kannada Pradhikara for verifying the results.