julien-c HF staff commited on
Commit
0266da4
1 Parent(s): d89b7fa

Initial import from https://fasttext.cc/docs/en/language-identification.html

Browse files
Files changed (4) hide show
  1. .gitattributes +1 -0
  2. README.md +36 -0
  3. lid.176.bin +3 -0
  4. lid.176.ftz +3 -0
.gitattributes CHANGED
@@ -6,3 +6,4 @@
6
  *.tar.gz filter=lfs diff=lfs merge=lfs -text
7
  *.ot filter=lfs diff=lfs merge=lfs -text
8
  *.onnx filter=lfs diff=lfs merge=lfs -text
 
6
  *.tar.gz filter=lfs diff=lfs merge=lfs -text
7
  *.ot filter=lfs diff=lfs merge=lfs -text
8
  *.onnx filter=lfs diff=lfs merge=lfs -text
9
+ *.ftz filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,36 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: multilingual
3
+ tags:
4
+ - fasttext
5
+ datasets:
6
+ - wikipedia
7
+ - tatoeba
8
+ - setimes
9
+ license: cc-by-sa-3.0
10
+ ---
11
+
12
+ ## FastText model for language identification
13
+
14
+ #### ♻️ Imported from https://fasttext.cc/docs/en/language-identification.html
15
+
16
+ > [1] A. Joulin, E. Grave, P. Bojanowski, T. Mikolov, Bag of Tricks for Efficient Text Classification
17
+
18
+ ```bibtex
19
+ @article{joulin2016bag,
20
+ title={Bag of Tricks for Efficient Text Classification},
21
+ author={Joulin, Armand and Grave, Edouard and Bojanowski, Piotr and Mikolov, Tomas},
22
+ journal={arXiv preprint arXiv:1607.01759},
23
+ year={2016}
24
+ }
25
+ ```
26
+
27
+ > [2] A. Joulin, E. Grave, P. Bojanowski, M. Douze, H. Jégou, T. Mikolov, FastText.zip: Compressing text classification models
28
+
29
+ ```bibtex
30
+ @article{joulin2016fasttext,
31
+ title={FastText.zip: Compressing text classification models},
32
+ author={Joulin, Armand and Grave, Edouard and Bojanowski, Piotr and Douze, Matthijs and J{\'e}gou, H{\'e}rve and Mikolov, Tomas},
33
+ journal={arXiv preprint arXiv:1612.03651},
34
+ year={2016}
35
+ }
36
+ ```
lid.176.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7e69ec5451bc261cc7844e49e4792a85d7f09c06789ec800fc4a44aec362764e
3
+ size 131266198
lid.176.ftz ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f3472cfe8738a7b6099e8e999c3cbfae0dcd15696aac7d7738a8039db603e83
3
+ size 938013