simplified crawling site gathering