Changed /crawl from GET to POST