Apply for community grant: Academic project (gpu)

#1
by hohonu-vicml - opened

Hello Huggingface,

This is a demo of our recent research paper:
TrailBlazer: Trajectory Control for Diffusion-Based Video Generation
(https://hohonu-vicml.github.io/Trailblazer.Page/)

This project is zero-shot learning that requires no training that guides the synthesized video subject through bounding box. We would like to apply for a GPU grant to run the demo faster and more efficiently.

I am happy to answer any further questions regarding the research! Really appreciate your help!

Best,
Kurt

Hi @hohonu-vicml , we've assigned ZeroGPU to this Space. Please check the usage section of this page so your Space can run on ZeroGPU.
If your Space is not compatible with ZeroGPU, let us know. We'll assign another hardware like t4-small.

Hi @hysts ,
Really appreciated your help. Our app is running under zero currently. One question: is there any limitation under zero framework. In my experience, I always get exceptions about GPU abort during the middle of the diffusion steps, and it is now exceeding the GPU quota (Sorry I keep testing too many times). Not sure if you can see the log, here is the message: """gradio.exceptions.Error: 'GPU task aborted'"""
Thanks for helping

Hi @hohonu-vicml , thanks for checking!

is there any limitation under zero framework. In my experience, I always get exceptions about GPU abort during the middle of the diffusion steps, and it is now exceeding the GPU quota (Sorry I keep testing too many times).

Ah, sorry. It's not mentioned in the docs, but the execution time on ZeroGPU is limited to 60 seconds by default, and the GPU abort error will occur if it's exceeded. You can change the limit by setting duration as @spaces.GPU(duration=90). cc @cbensimon
(FYI, it takes a few hours for GPU quotas to be recharged.)

Ohh!! Thanks for the very quick response and your time from you (Hopefully, you're not working on the weekend!)
I'll confirm this to you later today.

@hysts , confirming it is working for the app after some testing. Thank you so much for helping! Can't wait to annouce it on social media.
will the app be removed from Zero as long as the user traffic is getting cool down?

By the way, we have another Space called DirectedDiffusion (link) for my next priority to upgrade the whole system (e.g., as least, to make Gradio to 4)
Is it possible also to apply Zero on it(not for now) even such Space was assigned with academic grant before?

many thanks

will the app be removed from Zero as long as the user traffic is getting cool down?

I don't know the details on how ZeroGPU works, but my understanding is that GPUs are shared across multiple ZeroGPU Spaces and that each ZeroGPU Space uses GPU only when it runs the function decorated with @spaces.GPU. Maybe @cbensimon can provide more info.

By the way, we have another Space called DirectedDiffusion (link) for my next priority to upgrade the whole system (e.g., as least, to make Gradio to 4)
Is it possible also to apply Zero on it(not for now) even such Space was assigned with academic grant before?

Yeah, for sure! I just switched the hardware of the Space to ZeroGPU and increased the sleep time to 48 hours.
(FYI, currently, HF Spaces infra has an issue on building upgraded Spaces (Spaces get stuck at building), and it may take some time for our infra team to fix it.)

Ahhh!! What you made just like Thanos Snap. I see our former DD Space is now with Zero.
I'll update that repo shortly this week. DD will be presented as poster at AAAI2024.

I think that's all I need for this thread. Thank you for your time to monitor and helping us.
Have a nice day! Looking forward to seeing more features from HF and Gradio

Sign up or log in to comment