semvec/pypi-packages huggingface dataset:
fetchanything 0.2.0
A command-line tool to fetch files from websites recursively
Requires Python: >=3.7

# FetchAnything

A command-line tool to fetch files from websites recursively.

## Installation

You can install FetchAnything using pip:

```bash
pip install fetchanything
```

Or from source:

```bash
git clone https://github.com/yourusername/fetchanything.git
cd fetchanything
pip install -e .
```

## Usage

Basic usage:

```bash
fetchanything <URL> [options]
```

### Options

- `-l, --level LEVEL`: Maximum crawl depth (default: 2)
- `-f, --filter PATTERN`: File pattern to match (e.g., "*.pdf", "*.jpg")
- `-u, --url-pattern PATTERN`: Regex pattern to match URLs for crawling (e.g., ".*/blog/.*")
- `-o, --out DIRECTORY`: Output directory (default: downloads)
- `-v, --verbose`: Enable verbose output

### Examples

1. Download all PDF files from a website up to depth 2:
```bash
fetchanything https://example.com --level 2 --filter "*.pdf" --out download_pdf
```

2. Download all files from a website up to depth 1:
```bash
fetchanything https://example.com --level 1 --out downloads
```

3. Download all images with verbose output:
```bash
fetchanything https://example.com --filter "*.jpg" -v
```

4. Download PDFs only from blog pages:
```bash
fetchanything https://example.com --filter "*.pdf" --url-pattern ".*/blog/.*"
```

5. Download files only from specific subdomain:
```bash
fetchanything https://example.com --url-pattern "https://docs\\.example\\.com/.*"
```

## Features

- Recursive website crawling with depth control
- File pattern matching
- URL pattern filtering
- Progress tracking with tqdm
- Verbose logging option
- Persistent HTTP sessions
- Error handling and graceful interruption

## Requirements

- Python 3.7 or higher
- requests
- beautifulsoup4
- tqdm
- urllib3

## License

MIT License
mlu-api 0.1.1
Python bindings for Cambricon's libraries
Requires Python: >=3.10

# MLU-API

Python bindings for Cambricon's libraries

## Usage

### Install

```
pip install mlu-api
```

### Example

```
from mlu_api import cndev

print(cndev.get_device_count())
```

## Development

### Build and Install

```
uv sync
uv pip install --no-build-isolation -e .
```

### Test

```
uv run -- pytest -s
```

### How to generate compile_command.json

```
ln -s build/cp310-cp310-linux_x86_64/compile_commands.json .
```

## Publish

```
sudo apt install patchelf
rm -rf dist
uv build
uv run auditwheel repair dist/*.whl --plat manylinux_2_34_x86_64
uv publish wheelhouse/mlu_api-0.1.0-cp310-cp310-manylinux_2_34_x86_64.whl
```