Change BOS token from 0 to 2 as BOS token is equal to EOS for OPT. See: https://github.com/huggingface/transformers/issues/17431 7e8d05f patrickvonplaten commited on May 26, 2022