LoneStriker commited on
Commit
99a58b5
1 Parent(s): 451097e

Upload folder using huggingface_hub

Browse files
.gitattributes CHANGED
@@ -33,3 +33,14 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ model-00001-of-00002.safetensors filter=lfs diff=lfs merge=lfs -text
37
+ model-00002-of-00002.safetensors filter=lfs diff=lfs merge=lfs -text
38
+ speechless-zephyr-code-functionary-7b-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
39
+ speechless-zephyr-code-functionary-7b-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ speechless-zephyr-code-functionary-7b-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ speechless-zephyr-code-functionary-7b-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ speechless-zephyr-code-functionary-7b-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
43
+ speechless-zephyr-code-functionary-7b-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ speechless-zephyr-code-functionary-7b-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ speechless-zephyr-code-functionary-7b-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
46
+ speechless-zephyr-code-functionary-7b-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,38 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ library_name: transformers
5
+ pipeline_tag: text-generation
6
+ license: apache-2.0
7
+ ---
8
+
9
+ <p><h1> speechless-zephyr-code-functionary-7b </h1></p>
10
+
11
+ This model is the one of the moloras (Mixture-of-Multi-LoRAs) experiments.
12
+
13
+ Extract LoRA modules from below models (all based Mistral-7B-v0.1), each LoRA module has its own unique skills. By using multi-loras, they can be combined together statically or dynamically to form a versatile new model.
14
+
15
+ - HuggingFaceH4/zephyr-7b-beta (Uncensored Model)
16
+ - meetkai/functionary-small-v2.2 (Execute functions/plugins)
17
+ - uukuguy/speechless-code-mistral-7b-v1.0 (Enhance Coding)
18
+
19
+ The entire process is completed through the use of extract-lora, merge-lora, and lora-hub provided by multi-loras.
20
+
21
+ The router of mixture-of-multi-loras enables an automatic assembling of LoRA modules, using a gradientfree approach to obtain the coefficients of LoRA modules and requiring only a handful of inference steps for unseen tasks.
22
+
23
+ Code: https://github.com/uukuguy/multi_loras
24
+
25
+ ## LM-Evaluation-Harness
26
+
27
+ [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
28
+
29
+ | Metric | Value |
30
+ | --- | --- |
31
+ | ARC | 61.52 |
32
+ | HellaSwag | 83.88 |
33
+ | MMLU | 64.71 |
34
+ | TruthfulQA | 44.99 |
35
+ | Winogrande | 78.69 |
36
+ | GSM8K | 43.82 |
37
+ | Average | 62.93 |
38
+
huggingface-metadata.txt ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ url: https://huggingface.co/uukuguy/speechless-zephyr-code-functionary-7b
2
+ branch: main
3
+ download date: 2024-01-23 09:40:52
4
+ sha256sum:
5
+ 305e3e895b4a6946e528444ed81c0e6b772a6653ad487eb1da19bba47dec31e3 model-00001-of-00002.safetensors
6
+ 2a49562d1c43898a558de9d3194d12e04955ac5fe2db40a07f0b4703f2a7d1d5 model-00002-of-00002.safetensors
7
+ dadfd56d766715c61d2ef780a525ab43b8e6da4de6865bda3d95fdef5e134055 tokenizer.model
speechless-zephyr-code-functionary-7b-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec63b4191bf864ff5162095f8740402374c5c6b97234f210d3498dfe89ca8675
3
+ size 3822024384
speechless-zephyr-code-functionary-7b-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1e616bdb77fed7208fa87860e7fa94a187fdea73bc71e70796cb0d9c996be76
3
+ size 3518985920
speechless-zephyr-code-functionary-7b-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:28d5af8945cd262b079803a13bae683a1654d373dd6fe838d6e806f2fcfbfc3a
3
+ size 3164567232
speechless-zephyr-code-functionary-7b-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:36647880ebfd47e58a43327e1c9041f1c104f6378fa94405c0e26a507e7eb88c
3
+ size 4368438976
speechless-zephyr-code-functionary-7b-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:74948bd620d8a94d1d67e5ffcdf74ee216fa22cdb281f8ad0ea378ffdfbf3b04
3
+ size 4140373696
speechless-zephyr-code-functionary-7b-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bfb562609494c9a8d56053b3e0d81ecb45fbeafa2e657a65b1c7d3f41e439a02
3
+ size 5131409088
speechless-zephyr-code-functionary-7b-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dedcad64f42b479cbc5015f1fc51dcef7e4ec5e480e71ec772e0e0c9a16e7d95
3
+ size 4997715648
speechless-zephyr-code-functionary-7b-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fdb3d69a0ba16d78928db245c54f25d9a5a5d3738ba715ee9d8ebcbe0b4716f7
3
+ size 5942064832
speechless-zephyr-code-functionary-7b-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79ea7644c3727a076c8d65f632757581de9e51e1d7cf9b042aa373880e2ea4ff
3
+ size 7695857344