Before revision: Social media provides an unfiltered stream of user-generated input, leading to creative languageuse and many interesting linguistic phenomena, which were previously not available so abundantly. However, this language is harder to process automatically. One particularly challenging phenomenon is the use of multiple languages within one utterance, also called Code-Switching (CS) . Whereas monolingual social media data already provides many problems for natural language processing, CS adds another challenging dimension.
After revision: Lexical normalization, the translation of non-canonical data to standard language, has shown to improve the performance of manynatural language processing tasks on social media. Yet, using multiple languages in one utterance, also called Code-Switching (CS) . Whereas monolingual social media data already provides many problems for natural language processing, CS adds another challenging dimension.