revise crawl only to update links when < 100