Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,17 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+wizardmath-7b-v1.1.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+wizardmath-7b-v1.1.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+wizardmath-7b-v1.1.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+wizardmath-7b-v1.1.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+wizardmath-7b-v1.1.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+wizardmath-7b-v1.1.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
+wizardmath-7b-v1.1.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+wizardmath-7b-v1.1.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+wizardmath-7b-v1.1.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+wizardmath-7b-v1.1.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
+wizardmath-7b-v1.1.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+wizardmath-7b-v1.1.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+wizardmath-7b-v1.1.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+wizardmath-7b-v1.1.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,124 @@
+---
+title: "WizardMath-7B-V1.1 Quantized in GGUF"
+tags:
+  - GGUF
+language: en
+---
+![Image description](https://i.postimg.cc/MGwhtFfF/tsune-fixed.png)
+
+# Tsunemoto GGUF's of WizardMath-7B-V1.1
+
+This is a GGUF quantization of WizardMath-7B-V1.1.
+
+## Original Repo Link:
+[Original Repository](https://huggingface.co/WizardLM/WizardMath-7B-V1.1)
+
+## Original Model Card:
+---
+
+
+## WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instruct (RLEIF)
+
+<p style="font-size:28px;" align="center">
+🏠 <a href="https://wizardlm.github.io/" target="_blank">Home Page</a> </p>
+<p align="center">
+<p align="center">
+🤗 <a href="https://huggingface.co/WizardLM" target="_blank">HF Repo</a>  •🐱 <a href="https://github.com/nlpxucan/WizardLM" target="_blank">Github Repo</a> • 🐦 <a href="https://twitter.com/WizardLM_AI" target="_blank">Twitter</a> </p>
+<p align="center">
+ 📃 <a href="https://arxiv.org/abs/2304.12244" target="_blank">[WizardLM]</a>  • 📃 <a href="https://arxiv.org/abs/2306.08568" target="_blank">[WizardCoder]</a>   • 📃 <a href="https://arxiv.org/abs/2308.09583" target="_blank">[WizardMath]</a>  <br>
+</p>
+<p align="center">
+    👋 Join our <a href="https://discord.gg/VZjjHtWrKs" target="_blank">Discord</a>
+</p>
+
+## News
+
+[12/19/2023] 🔥 We released **WizardMath-7B-V1.1** trained from Mistral-7B, the **SOTA 7B math LLM**, achieves **83.2 pass@1** on GSM8k, and **33.0 pass@1** on MATH.
+
+[12/19/2023] 🔥 **WizardMath-7B-V1.1** outperforms **ChatGPT 3.5**, **Gemini Pro**, **Mixtral MOE**, and **Claude Instant** on GSM8K pass@1.
+
+[12/19/2023] 🔥 **WizardMath-7B-V1.1** is comparable with **ChatGPT 3.5**, **Gemini Pro**, and surpasses **Mixtral MOE** on MATH pass@1.
+
+| Model | Checkpoint | Paper  | GSM8k | MATH  |
+| ----- |------| ---- |------|-------| 
+| **WizardMath-7B-V1.1** | 🤗 <a href="https://huggingface.co/WizardLM/WizardMath-7B-V1.1" target="_blank">HF Link</a>  |  📃 <a href="https://arxiv.org/abs/2308.09583" target="_blank">[WizardMath]</a>| 	 **83.2**  |  **33.0** | 
+| WizardMath-70B-V1.0 | 🤗 <a href="https://huggingface.co/WizardLM/WizardMath-70B-V1.0" target="_blank">HF Link</a> |  📃 <a href="https://arxiv.org/abs/2308.09583" target="_blank">[WizardMath]</a>| **81.6**  |  **22.7**	|
+| WizardMath-13B-V1.0 | 🤗 <a href="https://huggingface.co/WizardLM/WizardMath-13B-V1.0" target="_blank">HF Link</a> |  📃 <a href="https://arxiv.org/abs/2308.09583" target="_blank">[WizardMath]</a>| **63.9**  |  **14.0** |
+| WizardMath-7B-V1.0 | 🤗 <a href="https://huggingface.co/WizardLM/WizardMath-7B-V1.0" target="_blank">HF Link</a>  |  📃 <a href="https://arxiv.org/abs/2308.09583" target="_blank">[WizardMath]</a>| 	 **54.9**  |  **10.7** |  
+   
+
+## [12/19/2023] Comparing WizardMath-7B-V1.1 with other open source 7B size math LLMs.
+
+| Model | GSM8k Pass@1 | MATH Pass@1 |
+| ----- |------| ---- |
+| MPT-7B              | 6.8          | 3.0         |
+|Llama 1-7B          | 11.0         | 2.9         |
+|Llama 2-7B|12.3	|2.8	|
+|Yi-6b| 32.6	|5.8	|
+|Mistral-7B|37.8	|9.1	|
+|Qwen-7b|47.8	|9.3	|
+| RFT-7B              | 50.3         | --          |
+| MAmmoTH-7B (COT)    | 50.5         | 10.4        |
+| WizardMath-7B-V1.0 | 54.9  |  10.7 |
+|Abel-7B-001 |59.7	|13	|
+| MetaMath-7B         | 66.5         | 19.8        |
+| Arithmo-Mistral-7B  | 74.7         | 25.3        |
+|MetaMath-Mistral-7B|77.7	|28.2	|
+|Abel-7B-002 |	80.4 | 29.5	|
+| **WizardMath-7B-V1.1** |  **83.2**  |  **33.0** |
+
+
+## [12/19/2023] Comparing WizardMath-7B-V1.1 with large open source (30B~70B) LLMs.
+
+| Model | GSM8k Pass@1 | MATH Pass@1 |
+| ----- |------| ---- |
+| Llemma-34B             | 51.5          |   25.0       |
+| Minerva-62B             | 52.4          |  27.6        |
+| Llama 2-70B             | 56.8          |  13.5        |
+|  DeepSeek 67B            | 63.4          |  --        |
+|  Gork 33B            | 62.9          |  23.9       |
+| MAmmoTH-70B             | 72.4          |  21.1       |
+| Yi-34B            | 67.9          |   15.9       |
+| Mixtral 8x7B            | 74.4          |   28.4      |
+|  MetaMath-70B  | 82.3          |   26.6       |
+| **WizardMath-7B-V1.1** |  **83.2**  |  **33.0** |
+
+
+🔥 
+❗<b>Note for model system prompts usage:</b>
+
+Please use **the same systems prompts strictly** with us, and we do not guarantee the accuracy of the **quantified versions**.
+
+**Default version:**
+
+```
+"Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\n### Instruction:\n{instruction}\n\n### Response:"
+```
+
+
+**CoT Version:** （❗For the **simple** math questions, we do NOT recommend to use the CoT prompt.） 
+
+
+```
+"Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\n### Instruction:\n{instruction}\n\n### Response: Let's think step by step."
+```
+
+## Inference WizardMath Demo Script
+
+We provide the WizardMath inference demo code [here](https://github.com/nlpxucan/WizardLM/tree/main/demo).
+
+
+
+
+## Citation
+
+Please cite the repo if you use the data, method or code in this repo.
+
+```
+@article{luo2023wizardmath,
+  title={WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instruct},
+  author={Luo, Haipeng and Sun, Qingfeng and Xu, Can and Zhao, Pu and Lou, Jianguang and Tao, Chongyang and Geng, Xiubo and Lin, Qingwei and Chen, Shifeng and Zhang, Dongmei},
+  journal={arXiv preprint arXiv:2308.09583},
+  year={2023}
+}
+```

wizardmath-7b-v1.1.Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:042145ebc57c3438e36bbeafcfb2e553fb92bda9b768cb4f44ab1ef272500550
+size 3084034080

wizardmath-7b-v1.1.Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9d6f2bb4106d36eaccd00021992257d5334e9780b3901406211c2d2ea16e1f9a
+size 3822960672

wizardmath-7b-v1.1.Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ff859ecdda4971600012c78ca92b3c6619f9987363157778f64a49e7becf0908
+size 3519922208

wizardmath-7b-v1.1.Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fc1b7aa2c1b87d2834da4ed3b6ac68dae3ba33feec1ac81729393455077a10be
+size 3165503520

wizardmath-7b-v1.1.Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e55396f1a7d4a786e78ae882198c597182a2637ffd9a4e9e40398c15633531b6
+size 4109852704

wizardmath-7b-v1.1.Q4_1.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6b39a8e411c65b257ba1e8468822177a60ca649ede85001b86ef6b85bae27d7e
+size 4554252320

wizardmath-7b-v1.1.Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:575023ff641df2514caf9711fea7e10862055b702e2d79e87a45abb4c08ce585
+size 4369375264

wizardmath-7b-v1.1.Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:46f2047205cbdb5f37c651fd38751f3580d38ba7ceffa96ae0436cf46dfe7c14
+size 4141309984

wizardmath-7b-v1.1.Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:73723d2ee88095846f4d78649018136862a349ab7acb9888e3f4c51ad0709a43
+size 4998651936

wizardmath-7b-v1.1.Q5_1.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:abb226b7a71373f0499b984f3280771deee224cc92b04eebc5ab6d8642ca0611
+size 5443051552

wizardmath-7b-v1.1.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:95ee56846ce64966d32c83a621cd67641e9ee5c86b7e58ac7888a8fe2a2d9e54
+size 5132345376

wizardmath-7b-v1.1.Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a2af9d51bc499ad15c3db1887e78ef66c66bb7df7a92be3e10cb0e090fa3437e
+size 4998651936

wizardmath-7b-v1.1.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3c63940650dc688703b464b9b3fe52cee1adca4e191a69ac1a20ac5a785116f0
+size 5943001120

wizardmath-7b-v1.1.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:32c2620d3c7b1cfdfd206b15eb46ada42a7cee6088ad9884fd9d9c0b3b5a061f
+size 7696793632