ValueError: If `eos_token_id` is defined, make sure that `pad_token_id` is defined.
#2
by
mike-ravkine
- opened
Thanks for the model!
I am having some trouble figuring out how EOS is supposed to work here, neither token_id=2 nor token_id=11 seem to work. When I try to use the GenerationConfig class to load the generation_config.json from this model as per the model card it complains that pad_token_id isn't set.
Has anyone got this model to properly output a single function/class at a time and then emit some kind of EOS?