semvec/pypi-packages huggingface dataset:
mistralrs-mkl 0.7.0
Fast, flexible LLM inference.
License: MIT
Requires Python: >=3.10
Keywords: machine-learning

# mistralrs Python SDK

`mistralrs` is the Python SDK for [mistral.rs](https://github.com/EricLBuehler/mistral.rs), a blazing-fast LLM inference engine.

## Documentation

For full documentation, see:
- [Python SDK Documentation](https://ericlbuehler.github.io/mistral.rs/PYTHON_SDK.html)
- [Installation Guide](https://ericlbuehler.github.io/mistral.rs/PYTHON_INSTALLATION.html)

## Quick Install

```bash
pip install mistralrs-cuda   # NVIDIA GPUs
pip install mistralrs-metal  # Apple Silicon
pip install mistralrs        # CPU only
```