dont crawl external pages and fix urlcontext hash