Fixed infinite loop while crawling a site.
Added option to wait after page load.