col-minilm / tokenizer_config.json

Commit History

Create tokenizer_config.json
0c1c03b
verified

bergum commited on

clean up tokenizer and add [unused0] and [unused1] as special tokens
85b42e5

Jo Kristian Bergum commited on

Import vespa-engine/col-minilm
18e6702

Jo Kristian Bergum commited on