shauray/Llava-Llama-2-13B-hf · About LlavaProcessor

Oct 5, 2023

•

edited Oct 5, 2023

Thanks for sharing this repo! I have a question about importing LlavaProcessor from transformers. I get cannot import name 'LlavaProcessor' from 'transformers' . What is right version of transformers library you use? Thx a lot.

shauray

Owner Oct 7, 2023

Hi @kiaia due to some delay The PR isn't merged yet If you want you can use my local branch for now https://github.com/shauray8/transformers/tree/llava

kiaia

Oct 10, 2023

Hi @shauray ！ Thank you so much for providing your local branch. But I got this in prepare_inputs_labels_for_multimodal cur_new_input_embeds = torch.cat(cur_new_input_embeds, dim=0) RuntimeError: Sizes of tensors must match except in dimension 0. Expected size 5120 but got size 4096 for tensor number 1 in the list. instead when trying to load the model in this repo. Size 4096 seems like a 7B model's dimension while the expected size for a 13B model is 5120. Is there something I missed in loading the correct model? Thx a lot.