Changing "eos_token" to eot-id fix the issue of overflow of model response - at least using the Messages API.
#73
by
myonlyeye
- opened
Changing "eos_token" to eot-id fix the issue of overflow of model response - at least using the Messages API.