neuralmagic
/

mpt-7b-chat-pruned50-quant-ds

Text Generation

text-generation-inference

Model card Files Files and versions Community

mgoin commited on Oct 19, 2023

Commit

a1b59e5

•

1 Parent(s): 8e482d3

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -4,7 +4,7 @@ tags:
 ---
 # Sparse MPT-7B-Chat - DeepSparse
-Chat-aligned MPT 7b model pruned to 50% and quantized for inference with DeepSparse
 ```python
 from deepsparse import TextGeneration

 ---
 # Sparse MPT-7B-Chat - DeepSparse
+[Chat-aligned MPT 7b model](https://huggingface.co/mosaicml/mpt-7b-chat) pruned to 50% and quantized using SparseGPT for inference with DeepSparse
 ```python
 from deepsparse import TextGeneration