Space: unitedideas/ai-crawler-policy-checker
title: AI Crawler Robots.txt Checker
sdk: gradio
license: mit
short_description: Check robots.txt policy for eight named AI crawler tokens.
tags: seo, robots-txt, ai-crawlers, openai, anthropic, perplexity, technical-seo
Tags: gradio, seo, robots-txt, ai-crawlers, openai, anthropic, perplexity, technical-seo, region:us