Spaces:
Running
Running
Commit
·
bba35ca
1
Parent(s):
84dcee4
adding spaces link
Browse files
README.md
CHANGED
|
@@ -17,6 +17,8 @@ short_description: a gradio app to map and scrape all URLs from a given website
|
|
| 17 |
|
| 18 |
# Docs Scraper
|
| 19 |
|
|
|
|
|
|
|
| 20 |
This project offers a Python script designed to map and scrape all URLs from a specified website using the Firecrawl API. The scraped content is saved into markdown files, which can then be provided to AI systems to offer context. This is particularly beneficial for AI code editors that need to gather comprehensive information from various websites. By analyzing the scraped content, the AI can better understand the structure and details of the information, thereby enhancing its ability to provide accurate code suggestions and improvements.
|
| 21 |
|
| 22 |
Types of sites that would be useful to scrape include:
|
|
|
|
| 17 |
|
| 18 |
# Docs Scraper
|
| 19 |
|
| 20 |
+
[](https://huggingface.co/spaces/patrickacraig/docs-scraper)
|
| 21 |
+
|
| 22 |
This project offers a Python script designed to map and scrape all URLs from a specified website using the Firecrawl API. The scraped content is saved into markdown files, which can then be provided to AI systems to offer context. This is particularly beneficial for AI code editors that need to gather comprehensive information from various websites. By analyzing the scraped content, the AI can better understand the structure and details of the information, thereby enhancing its ability to provide accurate code suggestions and improvements.
|
| 23 |
|
| 24 |
Types of sites that would be useful to scrape include:
|