adjusts hash to crawlers