Hugging Face's logo

edugp
/
kenlm

kenlm
perplexity
n-gram
kneser-ney
bigscience
Model card Files Community
7
edugp commited on
Commit
4b67bb4
•
1 Parent(s): ebcee4c

Replace remaining KenLM models by binary versions

Browse files
Files changed (22) hide show
  1. wikipedia/{ar.arpa → ar.arpa.bin} +2 -2
  2. wikipedia/{sw.arpa → bn.arpa.bin} +2 -2
  3. wikipedia/{bn.arpa → ca.arpa.bin} +2 -2
  4. wikipedia/en.arpa +0 -3
  5. wikipedia/{ca.arpa → en.arpa.bin} +2 -2
  6. wikipedia/eu.arpa +0 -3
  7. wikipedia/{es.arpa → eu.arpa.bin} +2 -2
  8. wikipedia/fr.arpa +0 -3
  9. wikipedia/fr.arpa.bin +3 -0
  10. wikipedia/hi.arpa +0 -3
  11. wikipedia/hi.arpa.bin +3 -0
  12. wikipedia/id.arpa +0 -3
  13. wikipedia/id.arpa.bin +3 -0
  14. wikipedia/pt.arpa +0 -3
  15. wikipedia/pt.arpa.bin +3 -0
  16. wikipedia/sw.arpa.bin +3 -0
  17. wikipedia/ur.arpa +0 -3
  18. wikipedia/ur.arpa.bin +3 -0
  19. wikipedia/vi.arpa +0 -3
  20. wikipedia/vi.arpa.bin +3 -0
  21. wikipedia/zh.arpa +0 -3
  22. wikipedia/zh.arpa.bin +3 -0
wikipedia/{ar.arpa → ar.arpa.bin} RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a3f0a9b67836fe5ae69ca0367e89c1273935999c39a435aded7a8e100d4edcdd
3
- size 7680022403
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e5ad5fe3355e9775d0045ac38ee24ef585b373c99350bc612e5bda9cbdd701fe
3
+ size 2824717990
wikipedia/{sw.arpa → bn.arpa.bin} RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fe2dc413863f8214860e6e4ae4d8ba5beafb1a09c18cb8401ff94993245d350e
3
- size 307732025
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9d2148db7af960f9468adc5c0b2c39f75d969b816014098c45de93517ac1c555
3
+ size 612069451
wikipedia/{bn.arpa → ca.arpa.bin} RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a8b2ec77a0559205f449d2dd121f842db61cf6a6fe65e95eba2709c67d0d9ecd
3
- size 2251703016
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ece1e503d4b44409069ea9c5c5125b74792b575143169e08cf9a27248f9a78e
3
+ size 2809368958
wikipedia/en.arpa DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:7baf89a4317efcab1bf1d375d8478c67c747dc00283cc34cd09ac2f93822b510
3
- size 10016911144
 
 
 
 
wikipedia/{ca.arpa → en.arpa.bin} RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b8c9565e9ff7fddbe8986d36ac331a0cefefadb9d90ed552eb3a6f10815192b4
3
- size 6220843011
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:04923fccbb4e63005c40f01d66112659416de01accd80d16e366a592289ee07a
3
+ size 4444690658
wikipedia/eu.arpa DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:1a2c36a5606cfa48b008ac7b4da90804c76ec5210e660912df8a080416683445
3
- size 1698633297
 
 
 
 
wikipedia/{es.arpa → eu.arpa.bin} RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:13b23660e4d86b632e0190889a0d611518926dff5d5c2a87f19cb3a4ccf6a64b
3
- size 8806767985
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2d04c4d1233b40044e2facc978987ecd4a6d4f84032f2af3f85f7079676fa08b
3
+ size 774011873
wikipedia/fr.arpa DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:0e466207258e018f539fbc7c83e8c80e4dbb50ec48bd37e452198cd2f6ee47fd
3
- size 6284503199
 
 
 
 
wikipedia/fr.arpa.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:301c82d52a8e34f63937afc12970794c8783244c8c0b085a8bbfb0d54dcb9374
3
+ size 2829042764
wikipedia/hi.arpa DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:61124c3253e0ba1bd9cace230b7c574512c8de55ebcd0fab19ed2c157c307212
3
- size 1807306872
 
 
 
 
wikipedia/hi.arpa.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f76e9238ccab63fc175ed40786888c0078cc7bb1de9519536a89473a60a17f8d
3
+ size 547247715
wikipedia/id.arpa DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:40405ae95644ccce692a420767c4d3b99134782f834a510f4b29292847680af6
3
- size 4251126924
 
 
 
 
wikipedia/id.arpa.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e099b6216a558d6c6f6108895e2e13fbc6ffd00b59791d16d6a5f85103ac0be
3
+ size 1847280248
wikipedia/pt.arpa DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:89a5c7aa69d9a1f989e4ffeeab70ec5d290082d16f46d890c32ec4f3c8ece9ab
3
- size 7297394170
 
 
 
 
wikipedia/pt.arpa.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad7241c4b11d902fa092506b731f61e5f67177897c2598b750d1a2e519be87ad
3
+ size 3220168756
wikipedia/sw.arpa.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5245f3df623fad2d6299b3f825b0b4c95f4ca74048827b532991a2381cbafb53
3
+ size 145248567
wikipedia/ur.arpa DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:557d6834560fa59d8df368c3ac07c0ce883f54b8874fcab85e441f6443b999b2
3
- size 1025230663
 
 
 
 
wikipedia/ur.arpa.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cda435e6d899daa71aba3cffccd0558ef9eb8a00f2b9ae8ba7b69326dc535511
3
+ size 396138774
wikipedia/vi.arpa DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:fbea99b2562d6e6dd452b8cce236069a8b29d5707fe0e1b8a017dbf10c03952e
3
- size 3224983995
 
 
 
 
wikipedia/vi.arpa.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:983460dc00aaaec7325139cd87e89e937fcf5ac0cba4b16f23241fcc52d3c0ca
3
+ size 1414396214
wikipedia/zh.arpa DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:154758d1db41a568885b6234f87e813509709722c55296377ec9d8eaf8cc8320
3
- size 6648530859
 
 
 
 
wikipedia/zh.arpa.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:240f156d70a4b04cb078b4f127ae0103378454143a77442c18e5e24b93404e56
3
+ size 3635106545