Simple Crawler. visited list is used for eliminating cycling