Hello. Thank you for this model. Could you explain, please: what is pad_token_id and what is generator?
#1
by
NikolayKozloff
- opened
I want to make a ggml version of your model. Where should i set pad_token_id to 18610? Do i need to edit convert.py from llama.cpp repo or tokenizer_config.json?