missing config.json

#1
by vaclavkosar - opened

Hello , I tried to use the model but config seems to be missing.
Specifically this does not work:

checkpoint = 'hf-hub:laion/CLIP-ViT-B-32-xlm-roberta-base-laion5B-s13B-b90k'


import open_clip


model, preprocess_train, preprocess_val = open_clip.create_model_and_transforms(checkpoint)
tokenizer = open_clip.get_tokenizer(checkpoint)

How to use the model?
Is the config missing and if yes can you upload it?

LAION eV org

Hi,

Currently hf transformers doesn't support clip models using hf transformers as text encoder (see https://github.com/mlfoundations/open_clip/issues/250)

You can use this in openclip instead

I see that's surprising, but no problem. Thanks!

I see that's surprising, but no problem. Thanks!

I have met the same problem but do not know how to fix it. Could you please tell me more details?

LAION eV org

Use https://github.com/mlfoundations/open_clip instead of transformers

Use https://github.com/mlfoundations/open_clip instead of transformers

Thank you very much! I'll take a look :)

Hello,
I have used open_clip to load and use the model. But how to get [CLS] output using open_clip? Could you please give me more details about it?
Thank you very much! :)

Sign up or log in to comment