bug suspected in process_page_links() as unvisted_page_urls is not populated