semvec/pypi-packages huggingface dataset:
mush-wikis-scraper 4.0.2
Scraper for http://mushpedia.com/, http://twin.tithom.fr/mush/, https://cmnemoi.github.io/archive_aide_aux_bolets/ and QA Mush forum threads.
Requires Python: <3.14,>=3.10

# eMush wikis scraper

[![Continous Integration](https://github.com/cmnemoi/mush_wikis_scraper/actions/workflows/ci.yaml/badge.svg)](https://github.com/cmnemoi/mush_wikis_scraper/actions/workflows/ci.yaml) 
[![Continous Delivery](https://github.com/cmnemoi/mush_wikis_scraper/actions/workflows/publish_to_pypi.yaml/badge.svg)](https://github.com/cmnemoi/mush_wikis_scraper/actions/workflows/publish_to_pypi.yaml)
[![codecov](https://codecov.io/gh/cmnemoi/mush_wikis_scraper/graph/badge.svg?token=FLAARH38AG)](https://codecov.io/gh/cmnemoi/mush_wikis_scraper)
[![PyPI version](https://badge.fury.io/py/mush-wikis-scraper.svg)](https://badge.fury.io/py/mush-wikis-scraper)

Scraper for http://emushpedia.miraheze.org/, https://cmnemoi.github.io/archive_aide_aux_bolets/ and QA Mush forum threads.

# Usage

Install with `python -m pip install --user mush-wikis-scraper`

Then run `python mush-wikis-scrap` in your terminal. The package supports 3 formats: `html`, `text` and `markdown` with the `--format` option.

The result will be printed to the terminal. You can redirect it to a file with `python mush-wikis-scrap > output`.

# Contributing

You need to have `curl` and [`uv`](https://docs.astral.sh/uv/getting-started/installation/) installed on your system.

Then run the following command : `curl -sSL https://raw.githubusercontent.com/cmnemoi/mush_wikis_scraper/main/clone-and-install | bash`

## Development

Run tests with `make test`.

# License

The source code of this repository is licensed under the [MIT License](LICENSE).