The crawler makes a dir and save its output inside this dir. Also, the crawler automatically closes itself after one hour