Sentiment Analysis of E nglish- P unjabi Code-Mixed Social Media Content (2020)

Abstract: Sentiment analysis is a field of study for analyzing people’s emotions, such as Nice, Happy, ਦੁਖੀ (sad), changa (Good), etc. towards the entities and attributes expressed in written text. It noticed that, on microblogging websites (Facebook, YouTube, Twitter ), most people used more than one language to express their emotions. The change of one language to another language within the same written text is called code-mixing. In this research, we gathered the English-Punjabi code-mixed corpus from micro-blogging websites. We have performed language identification of code-mix text, which includes Phonetic Typing, Abbreviation, Wordplay, Intentionally misspelled words and Slang words. Then we performed tokenization of English and Punjabi language words consisting of different spellings. Then we performed sentiment analysis based on the above text based on the lexicon approach. The dictionary created for English Punjabi code mixed consists of opinionated words. The opinionated words are then categorized into three categories i.e. positive words list, negative words list, and neutral words list. The rest of the words are being stored in an unsorted word list. By using the N-gram approach, a statistical technique is applied at sentence level sentiment polarity of the English-Punjabi code-mixed dataset. Our results show an accuracy of 83% with an F-1 measure of 77%.

## introduction in the last decade, the social media platform has been become the medium of communication such as facebook, twitter, linkedin, etc. @xcite . on social media platform, everybody has a short time and the information to be analyzed is huge. sentiment analysis helps us to whether the message or sentence follows positive or negative. sentiment analysis is also known as opinion mining or opinion analysis. by using, the web forums there are so many sources to express their views to track and analyze opinions and attitudes about and product. in india, there are 22 official languages, and many more regions languages used for communication (w. @xcite . there are lots of social media communication, which people use more than one languages to convey their opinion or sentiments @xcite . so, necessary to analyze the data to find appropriate sentiments. ngrams are one of the most commonly used features (g. rodrigues @xcite . we used the n-gram approach up to fivegram and found that the results of fivegram are similar to trigram approach for english-punjabi code mixed text. the type of ngram also depends on the type of domain used as some domains are more popular in phrases to express the sentiment. accordingly, our tool gives the power to the users to choose one of two approaches: trigrams and fivegram. ## methodology the main target of current research is sentiment analysis of english-punjabi code mixed language at sentence level. the foremost task for developing the system is collection of social media code-mixed text using api twitter threads for twitter, selecting some prolific users comments for facebook as data and some student community prolific users chat for whatsapp followed by cleaning of extracted data. the dataset used in the current research consists of 10 lakh sentences (tafter preprocessing) which have been tagged as en (english), pb (punjabi), univ (universal) and both (mixing of two languages inside a word), the features used are contextual features, capitalization features, special character features, character n gram features and lexicon features. in social media text people use creativity in spellings rather than traditional words. the deviation of text can be categorized as acronyms, slangs, misspellings, use of phonetic spellings etc. contractions like hasn't-has not, ma'am-madam etc. which are handled by mapping. plenty of common english words e.g. nyt -night, jan-january, gm-gud morning have changed their existence on social media. a dictionary of such out of vocabulary has been maintained in order to normalize them.