Skill: smseow001/lightpanda (version 1.0.0)

--- name: lightpanda description: Lightpanda is a lightweight headless browser written in Zig. 9x faster and 16x less memory than Chrome. Perfect for web scraping, content extraction, and automation. 安装: curl -L -o lightpanda https://github.com/lightpanda-io/browser/releases/download/nightly/lightpanda-x86_64-linux && chmod a+x lightpanda | 轻量级无头浏览器，比Chrome快9倍，省内存16倍，适合网页抓取和内容提取 version: 1.0.0 --- # Lightpanda / 轻量级无头浏览器 ## 简介 / Introduction Lightpanda 是用 Zig 编写的轻量级无头浏览器，非 Chromium 分支。 **性能对比：** | 指标 | Lightpanda | Headless Chrome | 差距 | |------|------------|-----------------|------| | 内存 (100页) | 123MB | 2GB | **16x 更省** | | 速度 (100页) | 5s | 46s | **9x 更快** | ## 安装 / Installation ```bash # Linux curl -L -o lightpanda https://github.com/lightpanda-io/browser/releases/download/nightly/lightpanda-x86_64-linux && \ chmod a+x ./lightpanda # macOS curl -L -o lightpanda https://github.com/lightpanda-io/browser/releases/download/nightly/lightpanda-aarch64-macos && \ chmod a+x ./lightpanda ``` ## 使用方法 / Usage ### 基本命令 / Basic Commands ```bash # 查看版本 ./lightpanda version # 抓取网页为 HTML ./lightpanda fetch --obey-robots --dump html --log-format pretty --log-level info <URL> # 抓取网页为 Markdown（推荐） ./lightpanda fetch --obey-robots --dump markdown --log-format pretty --log-level info <URL> # 等待加载后再抓取 ./lightpanda fetch --obey-robots --dump markdown --wait-ms 3000 <URL> # 等待特定元素 ./lightpanda fetch --obey-robots --dump markdown --wait-selector ".content" <URL> ``` ### Python 调用 / Python Integration ```python import subprocess import re def fetch_url(url, format="markdown", wait_ms=2000): """使用 Lightpanda 抓取网页""" output_format = "markdown" if format == "markdown" else "html" cmd = [ "./lightpanda", "fetch", "--obey-robots", "--dump", output_format, "--wait-ms", str(wait_ms), "--log-format", "pretty", url ] result = subprocess.run(cmd, capture_output=True, text=True) return result.stdout # 使用示例 content = fetch_url("https://example.com", "markdown") print(content) ``` ## 适用场景 / Use Cases | 场景 | 说明 | |------|------| | 🌐 网页抓取 | 轻量快速，适合批量抓取 | | 📄 内容提取 | 转 Markdown，方便后续处理 | | 🔍 竞品分析 | 定期抓取页面内容 | | 📰 新闻聚合 | 抓取文章内容 | | 📊 数据监控 | 监控网页变化 | ## 注意事项 / Notes - **无需 Chrome**：独立二进制，不依赖系统浏览器 - **CDP 协议**：支持 Puppeteer/Playwright 连接（高级用法） - **遵守 robots.txt**：默认 `--obey-robots` - **输出格式**：推荐使用 `--dump markdown` 便于后续处理 ## Docker 部署 / Docker Deployment ```bash docker run -d --name lightpanda -p 127.0.0.1:9222:9222 lightpanda/browser:nightly ``` ## 示例 / Examples ### 抓取网页并保存 ```bash ./lightpanda fetch --obey-robots --dump markdown --log-format pretty --log-level info https://news.ycombinator.com > output.md ``` ### 批量抓取 ```python import subprocess import time urls = [ "https://example.com/page1", "https://example.com/page2", "https://example.com/page3" ] for url in urls: print(f"Fetching: {url}") result = subprocess.run( ["./lightpanda", "fetch", "--obey-robots", "--dump", "markdown", "--wait-ms", "2000", url], capture_output=True, text=True ) # 处理 result.stdout time.sleep(1) # 礼貌性延迟 ``` ### 与 LangChain/文档处理结合 ```python import subprocess def scrape_for_rag(url): """抓取网页用于 RAG 处理""" result = subprocess.run( ["./lightpanda", "fetch", "--obey-robots", "--dump", "markdown", "--wait-ms", "3000", url], capture_output=True, text=True ) return result.stdout ```


Security scan verdicts — ClawScan: clean | static analysis: clean | VirusTotal: clean | SkillSpector: clean (LOW)