Update README.md
Browse files
README.md
CHANGED
@@ -31,7 +31,7 @@ That's 65 characters.
|
|
31 |
|
32 |
#### Tokenizer
|
33 |
|
34 |
-
For training
|
35 |
for multiple characters in the attention.
|
36 |
|
37 |
```
|
|
|
31 |
|
32 |
#### Tokenizer
|
33 |
|
34 |
+
For training a very basic tokenizer was used. Basically it renders the ascii value to each character without accounting
|
35 |
for multiple characters in the attention.
|
36 |
|
37 |
```
|