neuralmagic/deepsparse: Sparsity-aware deep learning inference runtime for CPUs
Category: nlp
Language: Python
Topics: computer-vision, cpus, deepsparse, inference, llm-inference, machinelearning, nlp, object-detection, onnx, performance, pretrained-models, pruning, quantization, sparsification
Homepage: https://neuralmagic.com/deepsparse/