move scraper dequeue to seperate module
moved to code
stop trying to index docs after X attempts