Load tokenizer associated to the model checkpoint, if possible. a77c0d4 Pedro Cuenca commited on Jan 16, 2022
Use model configuration unless a specific one is supplied. 5ec61cc Pedro Cuenca commited on Jan 16, 2022