vilsonrodrigues
/

Hermes-2-Pro-Mistral-7B-Pruned50

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

A Mistral-7B pruned50

Please see my tutorial to execute this model:

https://vilsonrodrigues.medium.com/sparse-quantize-and-serving-llms-with-neuralmagic-autogptq-and-vllm-03961b72ec3a

Downloads last month: 3

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported Inference Providers.