Spaces:
Sleeping
Apply for community grant: Academic project (gpu)
I would like to request a GPU grant to run this small but efficient LLM for Dutch
Hi @BramVanroy , we have assigned t4-small as it was the hardware you were using. BTW, I'm wondering if this Space can run on ZeroGPU. As you are in the ZeroGPU explorers org, I think you can assign ZeroGPU yourself. Didn't ZeroGPU work for this Space?
@hysts Ah, I can enable it, yes. For testing the model out it was not ideal, though, since it kicked me out for over-using it a lot :D
@hysts I have enabled zero in the settings and then did a factory rebuild, but it seems to be still suck on a T4. Any idea why?
Got it working, I think it was a torch version mismatch.
@hysts As reported on Slack, it feels like something is wrong with Zero - sharing responses incorrectly. I have therefore switched back to the T4 grant. For a single user that was enough but given the number of users, I would ask to upgrade this to something more powerful if possible. Thanks a lot!
As reported on Slack, it feels like something is wrong with Zero - sharing responses incorrectly. I have therefore switched back to the T4 grant.
Thanks for reporting the issue! Hopefully the ZeroGPU issue will be fixed soon, but yeah, we should use a normal GPU for now.
For a single user that was enough but given the number of users, I would ask to upgrade this to something more powerful if possible.
Done! I just upgraded the hardware to a10g-small.
@hysts Thanks a lot!