Lewdiculous commited on
Commit
e3ab4ef
1 Parent(s): 8a3833c

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +40 -0
README.md ADDED
@@ -0,0 +1,40 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ language:
4
+ - en
5
+ library_name: transformers
6
+ tags:
7
+ - gguf
8
+ - mistral
9
+ - quantized
10
+ ---
11
+
12
+ This repository hosts GGUF-IQ-Imatrix quants for [**NLPark/SLIDE-v2**](https://huggingface.co/NLPark/SLIDE-v2).
13
+
14
+ From [**quantization request #23**](https://huggingface.co/Lewdiculous/Model-Requests/discussions/23).
15
+
16
+ **Quants:**
17
+ ```python
18
+ quantization_options = [
19
+ "Q4_K_M", "Q4_K_S", "IQ4_XS", "Q5_K_M", "Q5_K_S",
20
+ "Q6_K", "Q8_0", "IQ3_M", "IQ3_S", "IQ3_XXS", "IQ2_M",
21
+ "IQ2_S", "IQ3_XS", "IQ4_NL"
22
+ ]
23
+ ```
24
+
25
+ Using the latest of llama.cpp released at the time.
26
+
27
+ **Card image:**
28
+
29
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/CrPvJwr-jhCev_BSKO2oI.png)
30
+
31
+ **Oringinal model card:**
32
+
33
+ # Shi-Ci Language Identify & Decode Expositor
34
+
35
+ 7B, Multi-Language...
36
+
37
+
38
+ ## Prompt Format
39
+
40
+ Mistral-Instruct