Getting '<|endoftext|>' token in response

#12
by iam-sud - opened

I am getting '<|endoftext|>' at the end of every response , even after adding eos_token_id=50256. Any way to remove this from the response?

Sign up or log in to comment