Fixed crawler not to log URLs which does not have any such links