Make the poller a persistent Python process. Limit the maximal amount of pending jobs.
Add daily dump to S3. Poll some services less frequently. Restore jobs when Redis goes down. Various improvements.