Finetuning Vision Encoder

by SinanAkkoyun - opened Mar 13

Discussion

SinanAkkoyun

Mar 13

Hi, thank you very much for the model. I need to finetune the vision encoder, how can I do that?

marcusinthesky

Apr 4

for name, parameter in model.named_parameters():
    if 'vision' in name:
        parameter.requires_grad = True
    else:
        parameter.requires_grad = False

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment