neuralmagic
/

Nous-Hermes-2-Yi-34B-pruned2.4

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

mwitiderrick commited on Mar 5

Commit

92d9539

•

1 Parent(s): 4dbabbc

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -8,7 +8,7 @@ tags:
 - sparse
 ---
-## llama2.c-stories110M-pruned50
 This repo contains model files for [Nous Hermes 2 - Yi-34B](https://huggingface.co/NousResearch/Nous-Hermes-2-Yi-34B) optimized for [NM-vLLM](https://github.com/neuralmagic/nm-vllm), a high-throughput serving engine for compressed LLMs.
 This model was pruned with [SparseGPT](https://arxiv.org/abs/2301.00774), using [SparseML](https://github.com/neuralmagic/sparseml).

 - sparse
 ---
+## Nous-Hermes-2-Yi-34B-pruned2.4
 This repo contains model files for [Nous Hermes 2 - Yi-34B](https://huggingface.co/NousResearch/Nous-Hermes-2-Yi-34B) optimized for [NM-vLLM](https://github.com/neuralmagic/nm-vllm), a high-throughput serving engine for compressed LLMs.
 This model was pruned with [SparseGPT](https://arxiv.org/abs/2301.00774), using [SparseML](https://github.com/neuralmagic/sparseml).