XLM-R pre-pretrained with MLM on GLUECoS, CMU DoG and EN-HI codemixed corpus. Further pretrained with NLI on MNLI corpus and finetuned on GLUECoS
XLM-R pre-pretrained with MLM on GLUECoS, CMU DoG and EN-HI codemixed corpus. Further pretrained with NLI on MNLI corpus and finetuned on GLUECoS