Use the model with code

#4
by zidanehammouda - opened

Hi, I managed to run the Gradio Web UI of this model on a server using the LLAVA repository. Is there any way to experiment with the model using code? like a predict function or something. I tried the eval_model function but I keep getting an error "Cannot copy out of meta tensor; no data!"

@zidanehammouda I am getting that error when the VRAM is not enough to fit the model if that can help

Sign up or log in to comment