roberta-base-thai / tokenizer.json

Commit History

use proper tokenizer.json and change to batch_size=256
de940b9

sakares commited on

remove old tokenizer.json. it's not trained properly
a615d86

sakares commited on

add pre-generated config.json and trained Thai tokenizer.json
09ad806

sakares commited on