Hugging Face's logo

edugp
/
kenlm

24 languages kenlm perplexity n-gram kneser-ney bigscience
Model card Files Community
7
edugp commited on
Commit
8d9b5a9
•
1 Parent(s): 0c75ed6

Add wikipedia models for additional low resource languages

Browse files
Files changed (30) hide show
  1. wikipedia/af.arpa.bin +3 -0
  2. wikipedia/af.sp.model +3 -0
  3. wikipedia/af.sp.vocab +3 -0
  4. wikipedia/arz.arpa.bin +3 -0
  5. wikipedia/arz.sp.model +3 -0
  6. wikipedia/arz.sp.vocab +3 -0
  7. wikipedia/as.arpa.bin +3 -0
  8. wikipedia/as.sp.model +3 -0
  9. wikipedia/as.sp.vocab +3 -0
  10. wikipedia/gu.arpa.bin +3 -0
  11. wikipedia/gu.sp.model +3 -0
  12. wikipedia/gu.sp.vocab +3 -0
  13. wikipedia/kn.arpa.bin +3 -0
  14. wikipedia/kn.sp.model +3 -0
  15. wikipedia/kn.sp.vocab +3 -0
  16. wikipedia/ml.arpa.bin +3 -0
  17. wikipedia/ml.sp.model +3 -0
  18. wikipedia/ml.sp.vocab +3 -0
  19. wikipedia/mr.arpa.bin +3 -0
  20. wikipedia/mr.sp.model +3 -0
  21. wikipedia/mr.sp.vocab +3 -0
  22. wikipedia/ta.arpa.bin +3 -0
  23. wikipedia/ta.sp.model +3 -0
  24. wikipedia/ta.sp.vocab +3 -0
  25. wikipedia/te.arpa.bin +3 -0
  26. wikipedia/te.sp.model +3 -0
  27. wikipedia/te.sp.vocab +3 -0
  28. wikipedia/yo.arpa.bin +3 -0
  29. wikipedia/yo.sp.model +3 -0
  30. wikipedia/yo.sp.vocab +3 -0
wikipedia/af.arpa.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:59a052343c45c83892b62bb49229b4a3c282386c6e33c225bd566a1692d55ffe
3
+ size 425344923
wikipedia/af.sp.model ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ea0c0a9c656190eebc9a75618dda128044480ed596a9586e119705793bf0c288
3
+ size 963253
wikipedia/af.sp.vocab ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a076a1df43cc9cd2c16df17c5199913a3f4f96314650087081bc3f86c3ace125
3
+ size 761249
wikipedia/arz.arpa.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:37eead92ad7aae94e6e6ba0652073e19dc6c052e314364eeeed059c7b20ed1b6
3
+ size 358578027
wikipedia/arz.sp.model ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a88f8508bc163b055dd36e2efb660ca527887009522ef075bef816bc8309267d
3
+ size 1024148
wikipedia/arz.sp.vocab ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f6b2788a17e037da07f7368179da97bae1a2f9fd9226e6ecda02df308a11bfcf
3
+ size 822247
wikipedia/as.arpa.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2bd609abe5f749d6afc6be4bfff497546fa9cd62dc97c7cc3cc04cca4d3e003f
3
+ size 82081501
wikipedia/as.sp.model ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6594e4bf5a52244f97725148e9e2fc509c7209d43c6434a1089954b33d9abc5f
3
+ size 1253635
wikipedia/as.sp.vocab ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:30eca87f359b9fc5656927f99e81b3bc76c6df26ed75103d3c5b415df160e7c0
3
+ size 1051292
wikipedia/gu.arpa.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:014a37ee3a33b292c6adaca1b215805d3e01f16a3a805744a5734c4d64226a42
3
+ size 73964184
wikipedia/gu.sp.model ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:14ed9cacbf0af4de675008bb91e092f87000ce4da695d4ab746b5e2791a3b0b4
3
+ size 1239566
wikipedia/gu.sp.vocab ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0def0145c6f6fd6f4ddab6ad220372c380591f2a1460ebb9d8d9dfc8b4baa35c
3
+ size 1037538
wikipedia/kn.arpa.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83b27c4e22da4ec1e8750eb20a68e06db6edb793d2f8af66b7e0177b07f36f7b
3
+ size 190340463
wikipedia/kn.sp.model ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac335a4fa39266be5e116db3d93a1f650237e310bd5056144d8def2cd86f8512
3
+ size 1481373
wikipedia/kn.sp.vocab ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:46fcfb39272b4d831a97cc137525458394a808819cf1453a7838ff08aed6ba17
3
+ size 1279698
wikipedia/ml.arpa.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f36870e83f406ebfb0431100cdc00bab4ea07a6f46ee75e7f213877af6d81c8
3
+ size 494747731
wikipedia/ml.sp.model ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f4c4d8a67471b2bf0cb02cabb6fb3fedea0ee8e1df4b7ce0fd45f639e48d39cc
3
+ size 1468485
wikipedia/ml.sp.vocab ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:35bd1fe3528eb34e4022ae7b76e42245d7555a80234687986193f56b9f265ad5
3
+ size 1266139
wikipedia/mr.arpa.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d4e28d84af8bf9d47670ba153d951db6c61af06194485cb4f354ef7cf39d3a0f
3
+ size 213245201
wikipedia/mr.sp.model ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b299918fd297d7ee8330bf43dae3d55bdf62c321d43e775f8f111dea325b34ae
3
+ size 1282288
wikipedia/mr.sp.vocab ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a056b935c9f7976b2f74617795d8e6d01f2d6392569e7f2292b3ebd23c12bb47
3
+ size 1078130
wikipedia/ta.arpa.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1e749160961748c6db53ff28af3e5effcb7a6f5e8aa9d36b97761dee0a2bb54f
3
+ size 646855589
wikipedia/ta.sp.model ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d98497fc2ddabad9df591ac4ace4fbed5e2c39c68760020c2e1ffa151bad6cea
3
+ size 1493561
wikipedia/ta.sp.vocab ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:87ede7e88cad486355b7058a6f95173df825cbeadf3f88fae8048de1b5562fe2
3
+ size 1291326
wikipedia/te.arpa.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:56f58f1871ca160d51ef1a6384811d52d84de66ac257cec552981cbf01387df3
3
+ size 243049387
wikipedia/te.sp.model ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:423cb3a352e79011c29f050706fa5ef89291245537dbadb8e669e1dd46de6477
3
+ size 1461816
wikipedia/te.sp.vocab ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b1f23a34067398e923c0c3da9143920ba7ad26d0176050345ddcb57f49def05
3
+ size 1260131
wikipedia/yo.arpa.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f270e49fd8ac5b84c8bfbbec7a76d8dd37bd24e655ee0e24f055bb20dc93a4b4
3
+ size 42746747
wikipedia/yo.sp.model ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ead51e5cad5bd7d27b7292d86054a85ec26d36172d3109bd4177176ac768ce4
3
+ size 872629
wikipedia/yo.sp.vocab ADDED
@@ -0,0 +1,3 @@
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:204c6cde6e263592a8c10d76ef4c912e2bf830887bd0d4a66828a78245591e41
3
+ size 667494