revise crawl to update links within while loop