first phase of queue and crawl status monitoring