| license: cc-by-nc-nd-4.0 | |
| language: | |
| - en | |
| library_name: transformers | |
| pipeline_tag: text-generation | |
| tags: | |
| - Mistral | |
| - Pygmalion | |
| - llama-2 | |
| - llama-2-7b | |
| quant of [Delcos'](https://huggingface.co/Delcos) [MistralPy-7b](https://huggingface.co/Delcos/Mistral-Pygmalion-7b) | |
| ``` | |
| python3 convert.py \ | |
| -i /input/Delcos_Mistral-Pygmalion-7b/ \ | |
| -c /input/wikitext/0000.parquet \ | |
| -o /output/temp/ \ | |
| -cf /output/8bpw/ \ | |
| -b 8.0 \ | |
| -hb 8 | |
| ``` |