Hemantrao commited on
Commit
7899497
1 Parent(s): c44dd1f

Upload tokenizer

Browse files
Files changed (1) hide show
  1. vocab.json +17 -17
vocab.json CHANGED
@@ -37,23 +37,23 @@
37
  "ु": 33,
38
  "ू": 34,
39
  "े": 35,
40
- "": 36,
41
- "": 37,
42
- "": 38,
43
- "": 39,
44
- "": 40,
45
- "": 41,
46
- "": 42,
47
- "": 43,
48
- "": 44,
49
- "": 45,
50
- "": 46,
51
- "": 47,
52
- "": 48,
53
- "": 49,
54
- "": 50,
55
- "": 51,
56
- "": 52,
57
  "ర": 53,
58
  "ల": 54,
59
  "వ": 55,
 
37
  "ु": 33,
38
  "ू": 34,
39
  "े": 35,
40
+ "": 36,
41
+ "": 37,
42
+ "": 38,
43
+ "": 39,
44
+ "": 40,
45
+ "": 41,
46
+ "": 42,
47
+ "": 43,
48
+ "": 44,
49
+ "": 45,
50
+ "": 46,
51
+ "": 47,
52
+ "": 48,
53
+ "": 49,
54
+ "": 50,
55
+ "": 51,
56
+ "": 52,
57
  "ర": 53,
58
  "ల": 54,
59
  "వ": 55,