Moved more functions to crawlerUtil