Research interests

Deep Learning, NLP, CV, optimization, compression, sparsification, quantization, pruning, distillation

Organization Card
About org cards

Software-delivered AI Inference

Neural Magic helps developers in accelerating deep learning performance using automated model sparsification technologies and a CPU inference engine. Download and run our sparsity-aware inference engine and open source tools for GPU-class performance on CPUs.

  • DeepSparse: Inference runtime offering GPU-class performance on CPUs and APIs to integrate ML into your application
  • SparseML: Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models
  • SparseZoo: Neural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes

datasets

None public yet