alphagov/rummager — pull request #124 by fatbusinessman (2013-07-10 10:07:59+00:00)
Title: Index documents via a Redis-backed queue

To help avoid some of the timeout problems (particularly when reindexing on Preview and Staging), send submitted documents to a queue and have a worker add them when elasticsearch is ready. In case of timeouts, the worker retries the submission automatically.

This is disabled by default, and can be enabled with an environment variable or on deployment with an initialiser; the intention is to turn it on in all non-development environments.