munish0838 commited on
Commit
0d75573
1 Parent(s): 4cb682f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +32 -1
README.md CHANGED
@@ -5,4 +5,35 @@ tags:
5
  - mistral
6
  inference: false
7
  base_model: alpindale/Mistral-7B-v0.2-hf
8
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  - mistral
6
  inference: false
7
  base_model: alpindale/Mistral-7B-v0.2-hf
8
+ ---
9
+
10
+ ---
11
+ license: apache-2.0
12
+ library_name: transformers
13
+ pipeline_tag: text-generation
14
+ tags:
15
+ - mistral
16
+ - text-generation-inference
17
+ base_model: mistralai/Mistral-7B-v0.1
18
+ inference: false
19
+ ---
20
+
21
+ # Mistral-7B-v0.1-GGUF
22
+ - Quantized version of [alpindale/Mistral-7B-v0.2-hf](https://huggingface.co/alpindale/Mistral-7B-v0.2-hf)
23
+ - The model is created by [mistralai](https://huggingface.co/mistralai) and weights provided by [alpindale](https://huggingface.co/alpindale)
24
+ - Created using llama.cpp
25
+
26
+ ## Available Quants
27
+
28
+ * Q2_K
29
+ * Q3_K_L
30
+ * Q3_K_M
31
+ * Q3_K_S
32
+ * Q4_0
33
+ * Q4_K_M
34
+ * Q4_K_S
35
+ * Q5_0
36
+ * Q5_K_M
37
+ * Q5_K_S
38
+ * Q6_K
39
+ * Q8_0