semvec/pypi-packages huggingface dataset:
sitemapp 0.0.1
Get Clean List of URL from the Sitemap of any Website, Best if it is a Wordpress Site

# Shodkk Scrapy-Sitemap

# pip install sitemapp

Sitemap is a Simple still Quite Important Package for Scraping Any Site, Specially for scraping Wordpress CMS site, which is the most use CMS nowadays

  - Help you get all url of site
  - directly use in your scrapy spider
  - No need of startURL
  - list is created for you put start-url = sitemap(https://life.shodkk.com/post-sitemap.xml) and Ready to scrape




### Installation

pip install sitemapp

How to Import

```sh
$ from sitemapp import sitemap
$ sitemap_list = sitemap('https://life.shodkk.com/post-sitemap.xml')
$ sitemap_list
```

For scraping in scrapy...

```sh
$ # -*- coding: utf-8 -*-
import scrapy
from sitemapp import sitemap
class Spider(scrapy.Spider):
    name = 'shodkk'
    allowed_domains = ['shodkk.com']
    start_urls = sitemap('https://life.shodkk.com/post-sitemap.xml')


```

### Development

Want to contribute? Great!
##### [https://github.com/shaantanu9](https://github.com/shaantanu9)
##### [https://shantanu.shodkk.com](https://shantanu.shodkk.com)

### Todos

 - Use with BeutifulSoup
 - Use with Scrapy
 - Use for Slug Genaration
 - Compare your Site Slug with Competitor

License
----

MIT
scrapy-sitemap 0.0.1
Get Clean List of URL from the Sitemap of any Website, Best if it is a Wordpress Site

# Shodkk Scrapy-Sitemap

# pip install scrapy-sitemap

Sitemap is a Simple still Quite Important Package for Scraping Any Site, Specially for scraping Wordpress CMS site, which is the most use CMS nowadays

  - Help you get all url of site
  - directly use in your scrapy spider
  - No need of startURL
  - list is created for you put start-url = sitemap(https://life.shodkk.com/post-sitemap.xml) and Ready to scrape




### Installation

pip install scrapy-sitemap

How to Import

```sh
$ from scrapy-sitemap import sitemap
$ sitemap_list = sitemap('https://life.shodkk.com/post-sitemap.xml')
$ sitemap_list
```

For scraping in scrapy...

```sh
$ # -*- coding: utf-8 -*-
import scrapy
from sitemap import sitemap
class Spider(scrapy.Spider):
    name = 'shodkk'
    allowed_domains = ['shodkk.com']
    start_urls = sitemap('https://life.shodkk.com/post-sitemap.xml')


```

### Development

Want to contribute? Great!
##### [https://github.com/shaantanu9](https://github.com/shaantanu9)
##### [https://shantanu.shodkk.com](https://shantanu.shodkk.com)

### Todos

 - Use with BeutifulSoup
 - Use with Scrapy
 - Use for Slug Genaration
 - Compare your Site Slug with Competitor

License
----

MIT