changed get_pos_to_crawl for better eficiency