rewrite local crawler queue using redis; using lifo queue so that control commands can be grab asap;