Update README.md

README.md

@@ -1,17 +1,17 @@
 ---
-base_model: upstage/SOLAR-10.7B-Instruct-v1.0
+base_model: mncai/mistral-7b-dpo-merge-v1.1
 inference: false
-model_type: llama
+model_type: mistral
 prompt_template: |
-  ### User:\n
+  <|user|>\n
   {prompt}
-  ### Assistant:\n
+  |assistant|>\n
 quantized_by: mwitiderrick
 tags:
 - deepsparse
 ---
-# SOLAR-10.7B-Instruct-v1.0 - DeepSparse
-This repo contains model files for [SOLAR-10.7B-Instruct-v1.0](https://huggingface.co/upstage/SOLAR-10.7B-Instruct-v1.0) optimized for [DeepSparse](https://github.com/neuralmagic/deepsparse), a CPU inference runtime for sparse models.
+# Mistral-7b-dpo-merge-v1.1 - DeepSparse
+This repo contains model files for [Mistral-7b-dpo-merge-v1.1](https://huggingface.co/mncai/mistral-7b-dpo-merge-v1.1/tree/main) optimized for [DeepSparse](https://github.com/neuralmagic/deepsparse), a CPU inference runtime for sparse models.
 
 This model was quantized and pruned with [SparseGPT](https://arxiv.org/abs/2301.00774), using [SparseML](https://github.com/neuralmagic/sparseml).
 
@@ -25,40 +25,22 @@ Run in a [Python pipeline](https://github.com/neuralmagic/deepsparse/blob/main/d
 from deepsparse import TextGeneration
 
 prompt = "How to make banana bread?"
-formatted_prompt =  f"### User:\n{prompt}\n\n### Assistant:\n"
+formatted_prompt =  f"<|user|>\n{prompt}\n<|assistant|>\n"
 
 model = TextGeneration(model_path="hf:nm-testing/SOLAR-10.7B-Instruct-v1.0-pruned50-quant")
 
 print(model(formatted_prompt, max_new_tokens=200).generations[0].text)
 """
-To make banana bread, follow these steps:
 
-1. Gather ingredients:
-- 4 ripe bananas
-- 1 cup of flour (all-purpose)
-- 1 teaspoon baking soda
-- 1/2 cup of softened butter
-- 1/2 cup of sugar
-- 1/2 teaspoon salt
-- 1 teaspoon vanilla extract
-- 1/2 cup of milk
-
-2. Preheat your oven: Preheat your oven to 350°F (177°C).
-
-3. Prepare a loaf pan: Grease a loaf pan with butter or use a non-stick baking pan.
-
-4. Mash the bananas: Peel the bananas and mash them in a bowl.
-
-5. Mix the dry ingredients: In a separate bowl, mix the flour, baking soda, and salt.
 """
 ```
 
 ## Prompt template
 ```
 
-  ### User:\
+  <|user|>\n
   {prompt}
-  ### Assistant:\n
+  |assistant|>\n
 ```
 ## Sparsification
 For details on how this model was sparsified, see the `recipe.yaml` in this repo and follow the instructions below.
@@ -66,7 +48,7 @@ For details on how this model was sparsified, see the `recipe.yaml` in this repo
 ```bash
 git clone https://github.com/neuralmagic/sparseml
 pip install -e "sparseml[transformers]"
-python sparseml/src/sparseml/transformers/sparsification/obcq/obcq.py upstage/SOLAR-10.7B-Instruct-v1.0 open_platypus --recipe recipe.yaml --save True
+python sparseml/src/sparseml/transformers/sparsification/obcq/obcq.py mncai/mistral-7b-dpo-merge-v1.1 open_platypus --precision float16 --recipe recipe.yaml --save True
 python sparseml/src/sparseml/transformers/sparsification/obcq/export.py --task text-generation --model_path obcq_deployment 
 cp deployment/model.onnx deployment/model-orig.onnx
 ```