LoneStriker
commited on
Commit
•
0c450a8
1
Parent(s):
8c006f1
Upload folder using huggingface_hub
Browse files- .gitattributes +9 -35
- DeepMagic-Coder-7b-Q3_K_L.gguf +3 -0
- DeepMagic-Coder-7b-Q3_K_M.gguf +3 -0
- DeepMagic-Coder-7b-Q3_K_S.gguf +3 -0
- DeepMagic-Coder-7b-Q4_K_M.gguf +3 -0
- DeepMagic-Coder-7b-Q4_K_S.gguf +3 -0
- DeepMagic-Coder-7b-Q5_K_M.gguf +3 -0
- DeepMagic-Coder-7b-Q5_K_S.gguf +3 -0
- DeepMagic-Coder-7b-Q6_K.gguf +3 -0
- DeepMagic-Coder-7b-Q8_0.gguf +3 -0
- README.md +48 -0
.gitattributes
CHANGED
@@ -1,35 +1,9 @@
|
|
1 |
-
|
2 |
-
|
3 |
-
|
4 |
-
|
5 |
-
|
6 |
-
|
7 |
-
|
8 |
-
|
9 |
-
|
10 |
-
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
11 |
-
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
12 |
-
*.model filter=lfs diff=lfs merge=lfs -text
|
13 |
-
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
14 |
-
*.npy filter=lfs diff=lfs merge=lfs -text
|
15 |
-
*.npz filter=lfs diff=lfs merge=lfs -text
|
16 |
-
*.onnx filter=lfs diff=lfs merge=lfs -text
|
17 |
-
*.ot filter=lfs diff=lfs merge=lfs -text
|
18 |
-
*.parquet filter=lfs diff=lfs merge=lfs -text
|
19 |
-
*.pb filter=lfs diff=lfs merge=lfs -text
|
20 |
-
*.pickle filter=lfs diff=lfs merge=lfs -text
|
21 |
-
*.pkl filter=lfs diff=lfs merge=lfs -text
|
22 |
-
*.pt filter=lfs diff=lfs merge=lfs -text
|
23 |
-
*.pth filter=lfs diff=lfs merge=lfs -text
|
24 |
-
*.rar filter=lfs diff=lfs merge=lfs -text
|
25 |
-
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
26 |
-
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
27 |
-
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
28 |
-
*.tar filter=lfs diff=lfs merge=lfs -text
|
29 |
-
*.tflite filter=lfs diff=lfs merge=lfs -text
|
30 |
-
*.tgz filter=lfs diff=lfs merge=lfs -text
|
31 |
-
*.wasm filter=lfs diff=lfs merge=lfs -text
|
32 |
-
*.xz filter=lfs diff=lfs merge=lfs -text
|
33 |
-
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
-
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
-
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
1 |
+
DeepMagic-Coder-7b-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
2 |
+
DeepMagic-Coder-7b-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
3 |
+
DeepMagic-Coder-7b-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
4 |
+
DeepMagic-Coder-7b-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
5 |
+
DeepMagic-Coder-7b-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
6 |
+
DeepMagic-Coder-7b-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
7 |
+
DeepMagic-Coder-7b-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
8 |
+
DeepMagic-Coder-7b-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
9 |
+
DeepMagic-Coder-7b-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
DeepMagic-Coder-7b-Q3_K_L.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:104a59d4869a6098a8308706bdbfab0a7961c81fceeb078bcd8e76386dccd916
|
3 |
+
size 3598429760
|
DeepMagic-Coder-7b-Q3_K_M.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:fb90cfc889295d72ca47a4e00f5ceefc11cd4bc4865295194ebb9083dd8c328a
|
3 |
+
size 3299323456
|
DeepMagic-Coder-7b-Q3_K_S.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:700be2f337ccd239bd0ca95a1bb66ce33debba6c19157beff18831bd1f2de94d
|
3 |
+
size 2949623360
|
DeepMagic-Coder-7b-Q4_K_M.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:55e63852ca1a52acd8e0bdfcfb6ea10f03e1ce655f2b148c120b4bf4ea8f4718
|
3 |
+
size 4082462272
|
DeepMagic-Coder-7b-Q4_K_S.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b12d2881e1c08fa6481d316def8e83ead7fde4520f3524e825fab15de003661f
|
3 |
+
size 3858198080
|
DeepMagic-Coder-7b-Q5_K_M.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3d6c72e502740c05d691fe07f1a05a43d08e49e142a3da6d05c02f1049abce1c
|
3 |
+
size 4784746048
|
DeepMagic-Coder-7b-Q5_K_S.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d0c7ccd6879b8bf6badacfe403633cbb13033264d661f0b527c24e4eb5321bb2
|
3 |
+
size 4653280832
|
DeepMagic-Coder-7b-Q6_K.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:fc0007fca70ed143a42c42bf50bef5db2522b9484b8ec2308f7c8fa4d5f0ec4d
|
3 |
+
size 5530922560
|
DeepMagic-Coder-7b-Q8_0.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:437401b05dcf64b9e61aa79165bacea85efc1a71e8eac56fa713cd48e0e4bd53
|
3 |
+
size 7163326016
|
README.md
ADDED
@@ -0,0 +1,48 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: other
|
3 |
+
license_name: deepseek
|
4 |
+
license_link: https://github.com/deepseek-ai/DeepSeek-Coder/blob/main/LICENSE-MODEL
|
5 |
+
---
|
6 |
+
DeepMagic-Coder-7b
|
7 |
+
|
8 |
+
Alternate version:
|
9 |
+
- https://huggingface.co/rombodawg/DeepMagic-Coder-7b-Alt
|
10 |
+
|
11 |
+
![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/642cc1c253e76b4c2286c58e/LlbswwXZQoIQziTNEMSMk.jpeg)
|
12 |
+
|
13 |
+
This is an extremely successful merge of the deepseek-coder-6.7b-instruct and Magicoder-S-DS-6.7B models, bringing an uplift in overall coding performance without any compromise to the models integrity (at least with limited testing).
|
14 |
+
|
15 |
+
This is the first of my models to use the merge-kits *task_arithmetic* merging method. The method is detailed bellow, and its clearly very usefull for merging ai models that were fine-tuned from a common base:
|
16 |
+
|
17 |
+
Task Arithmetic:
|
18 |
+
```
|
19 |
+
Computes "task vectors" for each model by subtracting a base model.
|
20 |
+
Merges the task vectors linearly and adds back the base.
|
21 |
+
Works great for models that were fine tuned from a common ancestor.
|
22 |
+
Also a super useful mental framework for several of the more involved
|
23 |
+
merge methods.
|
24 |
+
```
|
25 |
+
|
26 |
+
The original models used in this merge can be found here:
|
27 |
+
|
28 |
+
- https://huggingface.co/ise-uiuc/Magicoder-S-DS-6.7B
|
29 |
+
|
30 |
+
- https://huggingface.co/deepseek-ai/deepseek-coder-6.7b-instruct
|
31 |
+
|
32 |
+
|
33 |
+
The Merge was created using Mergekit and the paremeters can be found bellow:
|
34 |
+
```yaml
|
35 |
+
models:
|
36 |
+
- model: deepseek-ai_deepseek-coder-6.7b-instruct
|
37 |
+
parameters:
|
38 |
+
weight: 1
|
39 |
+
- model: ise-uiuc_Magicoder-S-DS-6.7B
|
40 |
+
parameters:
|
41 |
+
weight: 1
|
42 |
+
merge_method: task_arithmetic
|
43 |
+
base_model: ise-uiuc_Magicoder-S-DS-6.7B
|
44 |
+
parameters:
|
45 |
+
normalize: true
|
46 |
+
int8_mask: true
|
47 |
+
dtype: float16
|
48 |
+
```
|