another code checkpoint. new json api
for crawlbot. new url filters for crawlbot.