fixes build and updates crawlers