Statuo commited on
Commit
310f305
1 Parent(s): b1ec4ff

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -0
README.md CHANGED
@@ -9,6 +9,15 @@ base_model:
9
  - anthracite-org/magnum-v2.5-12b-kto
10
  - nbeerbower/mistral-nemo-bophades-12B
11
  ---
 
 
 
 
 
 
 
 
 
12
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6303fa71fc783bfc7443e7ae/qRsB-uefbKKrAqxknbWtN.png)
13
 
14
 
 
9
  - anthracite-org/magnum-v2.5-12b-kto
10
  - nbeerbower/mistral-nemo-bophades-12B
11
  ---
12
+ Mostly quanting this because I want to see how it performs.
13
+
14
+ [This is the 4bpw EXL2 quant of this model. For the original model, go here.](https://huggingface.co/Luni/StarDust-12b-v1)
15
+ <br>
16
+ [For the 8bpw version, go here.](https://huggingface.co/Statuo/Stardust-12b-MN-EXL2-8bpw)
17
+ <br>
18
+ [For the 6bpw version, go here](https://huggingface.co/Statuo/Stardust-12b-MN-EXL2-6bpw)
19
+ <br>
20
+
21
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6303fa71fc783bfc7443e7ae/qRsB-uefbKKrAqxknbWtN.png)
22
 
23