Spaces:
Runtime error
Is an A100 GPU available for this Space?
Hi,
@chris-rannou
I'd like to ask if it's possible to use an A100 GPU instance for this Space.
I think we need a GPU with 40GB memory to run the second stage model for this Space. (Currently, only the first stage model is enabled.)
Hi
@hysts
CogView2 was assigned an A10G GPU (with 24GB GPU memory). We do not currently handle A100 instances.
Would 2 A10G GPUs (increasing the available memory to 48GB) be enough ?
@chris-rannou
Sorry, I just noticed your reply. Thank you for the reply.
I'm not sure if it will work with 2 A10G GPUs. Code changes are definitely needed, though.
Now I'm starting to think it may be sufficient to have only the first stage model for this Space, as it will probably need some tweaks to run it on 2 GPUs and people can use the linked repo to try the gradio demo app with the second stage model on their own A100 instances if they really want.
Thanks anyway.