more updates for crawlers and utils