prepare crawler for batch
improved scheduler, prepared Site
improve Site, all tests green