To stop a web crawler: - Use robots.txt to disallow specific bots or pages - Implement noindex meta tags on pages you don't want indexed - Use server-side blocking for persistent unwanted crawlers - Employ CAPTCHAs for sensitive areas