chrisboulton/php-resque — Issue #34: performance issues (pcntl_fork overhead?)
Author: kballenegger
Created: 2012-01-06 01:28:02+00:00
State: open

So I've started playing with a deployment of this in production and seem to be having performance issues with pcntl_fork. Processing an empty job (that just contain an `error_log` statement) takes over 50ms, and our queue needs to be able to process more than 1000 items per second.

I'm thinking I might have to fork the project and change the behavior so that instead of forking on every job, to fork on every X jobs (where X > 100). My concern is that I haven't figured out a way to communicate between processes in PHP that would let me pass back the job object about to be processed from the child to the parent. Ideas?