No Chat Template
I am getting this warning
No chat template is set for this processor, falling back to a default class-level template. This is very error-prone, because models are often trained with templates different from the class default! Default chat templates are a legacy feature and will be removed in Transformers v4.43, at which point any code depending on them will stop working. We recommend setting a valid chat template before then to ensure that this model continues working without issues.
Is it intentional?
I think it's a warning due to the new features of transformers. It's not intentional by us. The code to run Mantis-8B-Idefics2 shall be the same as the original Idefics2. If you can get this warning running Mantis-8B-Idefics2, then I guess you can also get this warning running the original Idefics2.
Not actually, there is no warning on the HuggingFaceM4/idefics2-8b model.
When I print the processor of mantis model, the chat template is null.
For immediate solution, I just loaded both of the processor and assigned the mantis one to the idefics2 one.