YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
ONNX INT8 — toxicity-classifier-xlmr-base-v5
Dynamic INT8 (QInt8) ONNX export of gorkem371/toxicity-classifier-xlmr-base-v5 for fast CPU inference via ONNX Runtime.
- ~4x smaller, ~6-10x faster on x86 CPU vs PyTorch
- Prediction parity: 8/8 with source
- Load with onnxruntime; tokenizer + config bundled
- Downloads last month
- 49
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support