add dashboard crawls, fix urls