Fixed: crawler would retry every single page even if it was successful