Monitoring web crawlers