Crawler For Llm
Type: server
Author: KongHaYao
Language: TypeScript
Tags: Web Crawler,Markdown Converter,Content Extraction,LLM Data Preparation,Knowledge Base Building,Model Context Protocol (MCP)
Description: 高等级的免费爬虫MCP, 完全 Markdown 化支持，支持微信公众号等一大批国内网站。A powerful web crawler designed specifically for LLM applications, capable of extracting clean, readable content from various web pages and converting it to Markdown format. This tool is essential for building knowledge bases, training data collection, and content aggregation for LLM applications. It includes built-in support for the Model Context Protocol (MCP) for enhanced context management.

Tools:
Server command: npx -y @langgraph-js/crawler-mcp@latest
Server configuration:
{
    "mcpServers": {
        "langgraph-crawler": {
            "command": "npx",
            "args": ["-y", "@langgraph-js/crawler-mcp@latest"]
        }
    }
}