Decreased the queue size by not inserting already processed urls
Added failures during html parsing
Added 10 seconds sleep to the main application