handle memory limit kickass crawl