MaziyarPanahi commited on
Commit
bcaba41
1 Parent(s): b65b8e2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +23 -13
README.md CHANGED
@@ -1,20 +1,31 @@
1
  ---
2
- license: apache-2.0
3
- tags:
4
- - finetuned
5
- - quantized
6
- - gptq
7
- - 4-bit
8
- model_name: Mistral-7B-Instruct-v0.1-GPTQ
9
  base_model: mistralai/Mistral-7B-Instruct-v0.1
10
  inference: false
11
- model_creator: Mistral AI
12
- model_type: mistral
 
13
  pipeline_tag: text-generation
14
  quantized_by: MaziyarPanahi
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
15
  ---
16
  # Description
17
- Quantized (GPTQ) version of [mistralai/Mistral-7B-Instruct-v0.1](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1)
18
 
19
  ## How to use
20
  ### Install the necessary packages
@@ -23,7 +34,7 @@ Quantized (GPTQ) version of [mistralai/Mistral-7B-Instruct-v0.1](https://hugging
23
  pip install --upgrade accelerate auto-gptq transformers
24
  ```
25
 
26
- ### Example Python code
27
 
28
 
29
  ```python
@@ -59,5 +70,4 @@ pipe = pipeline(
59
 
60
  outputs = pipe("What is a large language model?")
61
  print(outputs[0]["generated_text"])
62
- ```
63
-
 
1
  ---
 
 
 
 
 
 
 
2
  base_model: mistralai/Mistral-7B-Instruct-v0.1
3
  inference: false
4
+ license: apache-2.0
5
+ model_creator: mistralai
6
+ model_name: Mistral-7B-Instruct-v0.1-GPTQ
7
  pipeline_tag: text-generation
8
  quantized_by: MaziyarPanahi
9
+ tags:
10
+ - finetuned
11
+ - quantized
12
+ - 4-bit
13
+ - gptq
14
+ - transformers
15
+ - pytorch
16
+ - safetensors
17
+ - mistral
18
+ - text-generation
19
+ - finetuned
20
+ - arxiv:2310.06825
21
+ - license:apache-2.0
22
+ - autotrain_compatible
23
+ - has_space
24
+ - text-generation-inference
25
+ - region:us
26
  ---
27
  # Description
28
+ [MaziyarPanahi/Mistral-7B-Instruct-v0.1-GPTQ](https://huggingface.co/MaziyarPanahi/Mistral-7B-Instruct-v0.1-GPTQ) is a quantized (GPTQ) version of [mistralai/Mistral-7B-Instruct-v0.1](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1)
29
 
30
  ## How to use
31
  ### Install the necessary packages
 
34
  pip install --upgrade accelerate auto-gptq transformers
35
  ```
36
 
37
+ ### Example Python Code
38
 
39
 
40
  ```python
 
70
 
71
  outputs = pipe("What is a large language model?")
72
  print(outputs[0]["generated_text"])
73
+ ```