Run a process that listens to the central redis queue for scrape jobs