semvec/pypi-packages huggingface dataset:
2008WebCrawler 0.0.1a2
A python web crawler
License: MIT

# 2008 Web Crawler

**NOT SUITABLE FOR PRODUCTION ENVIRONMENTS**

## Introduction
My first python project, made in 2008. I have no real purpose for this yet, just trying to get it back to life.

This code was really bad and i'm tweaking this as little as possible to get it working.

It was tested on macOS Mojave using python 3.6.6.

Development is driven mainly by fun.

## How to install

```bash
pip install 2008WebCrawler
```

## How to run

```text
Usage:
    crawler --feed=<url>
    crawler --help

Options:
    -h --help    Show this screen.
    --feed=<url> Web site to crawl.
```

## How to contribute

[2008 Web Crawler on gitlab](https://gitlab.com/luistm/2008-pythonwebcrawler)