AI4Chem

/

ChemVLM-26B-1-2

like 6

Follow

AI4Chem 64

We have uploaded it to our repo. Try again! Also, to load the model, you may simply try AutoModelForCausalLM.from_pretrained('xxx', trust_remote_code=True)

Thanks. Please upload the below file as well.

Entry Not Found for url: https://huggingface.co/AI4Chem/ChemVLM-26B-1-2/resolve/main/configuration_intern_vit.py.
In the ChemVLM-26B repo, there are 3 configuration files

1. configuration_intern_vit.py
2. configuration_internlm2.py
3. configuration_internvl_chat.py
   Should this repo also need to have 3 files?

I'll share the updates.

I'm using the below code to load the model.

model = AutoModelForCausalLM.from_pretrained(
"AI4Chem/ChemVLM-26B-1-2",
torch_dtype=torch.bfloat16,
low_cpu_mem_usage=True,
trust_remote_code=True
).to(device).eval().cuda()

Sorry for missing some files. We have uploaded them and try it again!
Best regards!

Thanks and sorry to bother you again.

This file is missing
https://huggingface.co/AI4Chem/ChemVLM-26B-1-2/resolve/main/conversation.py.

Never mind! We have uploaded this file yet.
Thank you for your efforts. This will help us keep the reproducibility of our repo.

Thanks. It worked now!!
Can you also please add these files for the 8B model?

I did below pip installs in addition to the transformer version mentioned.
pip install sentencepiece
pip install einops
pip install timm
pip install accelerate>=0.26.0

Sure. We will add that on the Readme page.
Also, can you share some examples you use with our model?
If finding that useful, please kindly star our repo and cite our paper. That will be of great help to us.

I'm trying to see if the model can give a description of chemical synthesis, compounds given a picture of it.
There are few members who will work on this for a week. I'll give an update once it is done.
This is a tremendous effort from your side. Really appreciate it!!!