meebo/pistil — Issue #6: A simple example of communicating between worker?
Author: ksamuel
Created: 2011-12-25 13:37:56+00:00
State: open

Let's say I want to send a message from a worker to another one, how do I do so?

Of course, I can make them all TCP worker and POST around, but's that really overkill, and don't give me anyway to queue anything.

I suppose that sharing data between worker is not the primary goal of pistil, and that I could use a message lib such as kombu to do so, but it can be overkill: either you use Sqlite and forget concurrent writting, or use use something more multiprocess friendly and you have to install Redis/RabitMQ, whatever.

The Python multiprocess module got queues for that: http://docs.python.org/library/multiprocessing.html?highlight=multiprocessing#exchanging-objects-between-processes

What would be the pistil equivalent?

Anyway, great software, making worker that simpler in Python is just huge.