more crawlbot api fixes