Spaces:
Running
on
T4
Very long queues
An alternative is you start charging people to use your space. Make it private and invite only.
Or can we run it locally instead
Or can we run it locally instead
The essence of the problem is not this, but that if a person wants to share his server with those who do not have the opportunity to buy a powerful server or computer, then you need to make these people feel comfortable. This can be provided only when the restrictions on the number of generated images are removed. This is ordinary math. The author should have conducted an experiment and made sure of the truth of my words himself. The queue will be very small, and people will be able to receive 100 images at once. Only the generation duration will increase to a maximum of 3 minutes, but it is compensated by the fact that people will no longer request image generation 100 times for the same request.
Do you think 100 pictures for one person is better than one picture for each of 100 persons?
The total generation time doesn't change either you generate 100 different requests one at a time, or you generate 1 request 100 times in a row.
Nobody can give you guarantee that you'll get what you want even after 100 pictures.
Or can we run it locally instead
The essence of the problem is not this, but that if a person wants to share his server with those who do not have the opportunity to buy a powerful server or computer, then you need to make these people feel comfortable. This can be provided only when the restrictions on the number of generated images are removed. This is ordinary math. The author should have conducted an experiment and made sure of the truth of my words himself. The queue will be very small, and people will be able to receive 100 images at once. Only the generation duration will increase to a maximum of 3 minutes, but it is compensated by the fact that people will no longer request image generation 100 times for the same request.
Do you think 100 pictures for one person is better than one picture for each of 100 persons?
The total generation time doesn't change either you generate 100 different requests one at a time, or you generate 1 request 100 times in a row.
Nobody can give you guarantee that you'll get what you want even after 100 pictures.I always get the one I need after generating 100 images. And the time in the queue will be reduced due to the fact that the person who received 100 images, in 90% of cases, will no longer return for the next generation. You just need to try and make sure of it. It's not difficult.
In order to answer this question, we need to know an average number of unique users. Imagine an average case - we have, say, 100 unique users each has set of 100 pictures to generate. Each picture will be generated in about 5 seconds. How long will you wait for your turn? It's easy to compute - 5100100 = 50000 seconds. Would you wait for a whole day to receive your desired image?
But I think it doesn't work like that.
I would be a thankful even for the given opportunity to generate images for free with no charge.
Otherwise, buy a good video card like I did, and generate whatever and whenever you want.
Or can we run it locally instead
The essence of the problem is not this, but that if a person wants to share his server with those who do not have the opportunity to buy a powerful server or computer, then you need to make these people feel comfortable. This can be provided only when the restrictions on the number of generated images are removed. This is ordinary math. The author should have conducted an experiment and made sure of the truth of my words himself. The queue will be very small, and people will be able to receive 100 images at once. Only the generation duration will increase to a maximum of 3 minutes, but it is compensated by the fact that people will no longer request image generation 100 times for the same request.
Do you think 100 pictures for one person is better than one picture for each of 100 persons?
The total generation time doesn't change either you generate 100 different requests one at a time, or you generate 1 request 100 times in a row.
Nobody can give you guarantee that you'll get what you want even after 100 pictures.I always get the one I need after generating 100 images. And the time in the queue will be reduced due to the fact that the person who received 100 images, in 90% of cases, will no longer return for the next generation. You just need to try and make sure of it. It's not difficult.
In order to answer this question, we need to know an average number of unique users. Imagine an average case - we have, say, 100 unique users each has set of 100 pictures to generate. Each picture will be generated in about 5 seconds. How long will you wait for your turn? It's easy to compute - 5100100 = 50000 seconds. Would you wait for a whole day to receive your desired image?
But I think it doesn't work like that.
I would be a thankful even for the given opportunity to generate images for free with no charge.
Otherwise, buy a good video card like I did, and generate whatever and whenever you want.To answer this question, it is enough to conduct an experiment, and not to calculate formulas. Give people the opportunity to generate up to 100 images. If it gets worse, you will return everything back.
On T4, the duration of generating 100 images is approximately 3 minutes. It will be even faster on the A10.
It's up to @darkstorm2150 to increase the batch size or not. I'm not an owner of this space.
Haven't tried but assuming how duplicate works -- maybe you can duplicate so you have another thread on your end?
@VladislavMotkov increasing batchsize will bring the waiting time seven fold on each request, there is already alot of requests (the waiting time), the only solution is to upgrade the server space with a better GPU, which hugging face will do if the demand is high enough, also T4 does not generate 100 images in 3 minutes, it takes about 10-20 seconds per image, depending on the steps used. that means that a single request could jump the wait times to 16 minutes per person, it would take over 1 hour to get a request with just 4 people doing this..