GitHub repository: pixlie/SmartCrawler
Primary language: Rust
Description: A smart web crawler built in Rust that uses Claude AI to select the most relevant URLs from website sitemaps based on crawling objectives.