msislam commited on
Commit
3633d78
1 Parent(s): bd200de

Update readme

Browse files
Files changed (1) hide show
  1. README.md +7 -0
README.md CHANGED
@@ -70,3 +70,10 @@ labels_predicted = logits.argmax(-1)
70
  lang_tag_predicted = [model_best.config.id2label[t.item()] for t in labels_predicted[0]]
71
  lang_tag_predicted
72
  ```
 
 
 
 
 
 
 
 
70
  lang_tag_predicted = [model_best.config.id2label[t.item()] for t in labels_predicted[0]]
71
  lang_tag_predicted
72
  ```
73
+
74
+ ## Limitations
75
+ The model might show some contradictory or conflicting behavior sometimes. Some of the known (till now) issues are:
76
+ * The model might not be able to predict a small number (typically 1 or 2) of tokens from another language if they are found in the sequence of one language.
77
+ * The model might consider the language of the tokens in a noun phrase the same as the other tokens, even if the language of the tokens (noun phrase) is different.
78
+ * Proper nouns, and some cross-lingual tokens (in, me, etc.) might be wrongly predicted.
79
+ * The prediction also depends on punctuation.