chrisboulton/php-resque — Issue #31: Pub/Sub option?
Author: RVN-BR
Created: 2011-12-20 02:25:42+00:00
State: open

Hi,

Has anyone tried getting a pub/sub queue working under resque? any comment?

I have one feature that i need to add to my app that calls a webservice for another application we interface. Nonetheless, i need this to be done as quickly as possible, currently using resque using the normal 5 second interval is a bit laggy... 1 second interval would probably ok, nonetheless i think it may be overkill to run the queue across a cluster of server iterating every second, etc, without any activity? (not all the time there will be things on the queue)...

The other option will be to just tie these particular webservice calls to the user-activated script (kinda not-elegant because if the webservice does lag at all we will have a laggy interface as well as laggy functionality...)

Anyways, any suggestions about this? I do suppose that if I put the workers throughout 10 or so servers, and maybe a few workers per server, eventually the lag will be quite small? But still, there will be a ton of hits on Redis, wouldnt a pub/sub mechanism be somewhat better?

thanks for ideas/feedbak