Performance tweak to avoid crawling more deeply urls that were just guesses based on frequent feed urls patterns