semvec/pypi-packages huggingface dataset:
ml-infer 0.0.3
Inference toolkit for machine learning models
Requires Python: >=3.10

# Infer

`infer` is a toolchain for doing optimized neural network inference with a number of different backends.

## Installation

Install from `pip`:

```bash
pip install ml-infer
# With development dependencies
pip install 'ml-infer[dev]'
# With TensorRT support
pip install 'ml-infer[tensorrt]'
# With CoreML support
pip install 'ml-infer[coreml]'
# With developer dependencies and TensorRT support
pip install 'ml-infer[dev,tensorrt]'
# With developer dependencies and CoreML support
pip install 'ml-infer[dev,coreml]'
```

## Supported Backend

- TensorRT
- CoreML

## References

- [Official TensorRT Export Pipeline](https://github.com/pytorch/TensorRT)
- [Official CoreML Repository](https://github.com/apple/coremltools)