Block bad, possibly even malicious web crawlers (automated bots) using htaccess.