minor code cleanup, attempt to visit all links