Error while finetuning the model for ConditionalGeneration
Hi,
I am getting the following error when I'm trying to finetune the model in the forward call:
final_labels[batch_indices, text_to_overwrite] = labels[batch_indices, non_image_indices]
IndexError: index 8 is out of bounds for dimension 1 with size 8
The same code works fine if I just change the model to another VLLM like InstructBlip.
Thank you and kind regards,
Alexandros Xenos
Hi,
Could you try when installing Transformers from source?
pip install git+https://github.com/huggingface/transformers.git
Cause we have recently included a bug fix which fixed LLaVa fine-tuning.
Hi nielsr,
Thank you so much for the fast reply! I am still getting the same error even though I noted that the bug fix regards the same bug...
When I am installing Transformers from source via "pip install git+https://github.com/huggingface/transformers.git" the transformers-4.38.0.dev0 version is installed. Is this correct?