GitHub repository: wanghaisheng/gpt-crawler
Description: Crawl a site to generate knowledge files to create your own custom GPT from a URL