Fixed more instances of urls being added to the queue multiple times.