Model is using the EoS of llama 3 base, not llama 3 instruct. This results in <|eot_id|> leakage on some UI and engine combinations.
Corrected
Β· Sign up or log in to comment