Hugging Face's logo

alasdairforsythe
/
tokenmonster

Model card Files Community
alasdairforsythe commited on
Commit
7dadf99
•
1 Parent(s): d0485c7

Upload 12 files

Browse files
Files changed (13) hide show
  1. .gitattributes +1 -0
  2. vocabs/code-1024-balanced-v1.vocab +0 -0
  3. vocabs/code-16000-consistent-v1.vocab +0 -0
  4. vocabs/code-2048-balanced-v1.vocab +0 -0
  5. vocabs/code-2048-clean-v1.vocab +0 -0
  6. vocabs/code-24000-balanced-v1.vocab +0 -0
  7. vocabs/code-32000-balanced-v1.vocab +0 -0
  8. vocabs/code-4096-consistent-v1.vocab +0 -0
  9. vocabs/english-16000-consistent-v1.vocab +0 -0
  10. vocabs/englishcode-4096-consistent-v1.vocab +0 -0
  11. vocabs/englishcode-8000-strict-v1.vocab +0 -0
  12. vocabs/fiction-40000-consistent-v1.vocab +3 -0
  13. vocabs/fiction-8000-clean-v1.vocab +0 -0
.gitattributes CHANGED
@@ -108,3 +108,4 @@ vocabs/english-50256-balanced-v1.vocab filter=lfs diff=lfs merge=lfs -text
108
  vocabs/english-50256-strict-v1.vocab filter=lfs diff=lfs merge=lfs -text
109
  vocabs/englishcode-65536-strict-v1.vocab filter=lfs diff=lfs merge=lfs -text
110
  vocabs/fiction-65536-balanced-v1.vocab filter=lfs diff=lfs merge=lfs -text
 
 
108
  vocabs/english-50256-strict-v1.vocab filter=lfs diff=lfs merge=lfs -text
109
  vocabs/englishcode-65536-strict-v1.vocab filter=lfs diff=lfs merge=lfs -text
110
  vocabs/fiction-65536-balanced-v1.vocab filter=lfs diff=lfs merge=lfs -text
111
+ vocabs/fiction-40000-consistent-v1.vocab filter=lfs diff=lfs merge=lfs -text
vocabs/code-1024-balanced-v1.vocab ADDED
Binary file (25.5 kB). View file
 
vocabs/code-16000-consistent-v1.vocab ADDED
Binary file (435 kB). View file
 
vocabs/code-2048-balanced-v1.vocab ADDED
Binary file (51 kB). View file
 
vocabs/code-2048-clean-v1.vocab ADDED
Binary file (51.2 kB). View file
 
vocabs/code-24000-balanced-v1.vocab ADDED
Binary file (659 kB). View file
 
vocabs/code-32000-balanced-v1.vocab ADDED
Binary file (890 kB). View file
 
vocabs/code-4096-consistent-v1.vocab ADDED
Binary file (105 kB). View file
 
vocabs/english-16000-consistent-v1.vocab ADDED
Binary file (408 kB). View file
 
vocabs/englishcode-4096-consistent-v1.vocab ADDED
Binary file (102 kB). View file
 
vocabs/englishcode-8000-strict-v1.vocab ADDED
Binary file (199 kB). View file
 
vocabs/fiction-40000-consistent-v1.vocab ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0aa3d83d2bc9b54a32a4218075d5418cbd2a62a69620c1a56c9c13b78619026c
3
+ size 1056084
vocabs/fiction-8000-clean-v1.vocab ADDED
Binary file (202 kB). View file