alokabhishek
/

Mistral-7B-Instruct-v0.2-4.0-bpw-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

alokabhishek commited on Mar 31

Commit

83b7d62

•

1 Parent(s): ea26a32

Updated Readme

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -60,8 +60,8 @@ import os
 ```python
 # Define the model ID for the desired model
-model_id = "alokabhishek/Mistral-7B-Instruct-v0.2-5.0-bpw-exl2"
-BPW = 5.0
 # define variables
 model_name =  model_id.split("/")[-1]
@@ -133,7 +133,7 @@ model_name =  model_id.split("/")[-1]
-# Model Card for Mistral-7B-Instruct-v0.2
 The Mistral-7B-Instruct-v0.2 Large Language Model (LLM) is an instruct fine-tuned version of the Mistral-7B-v0.2.

 ```python
 # Define the model ID for the desired model
+model_id = "alokabhishek/Mistral-7B-Instruct-v0.2-4.0-bpw-exl2"
+BPW = 4.0
 # define variables
 model_name =  model_id.split("/")[-1]
+# Original Model Card for Mistral-7B-Instruct-v0.2
 The Mistral-7B-Instruct-v0.2 Large Language Model (LLM) is an instruct fine-tuned version of the Mistral-7B-v0.2.