File size: 377 Bytes
b24bc56 |
1 2 3 4 5 6 7 8 9 10 11 |
This is the test version for pruning. This model is a base model that will be pruned and quantized for on-device purpose. I used mergekit for merging two models: https://github.com/cg123/mergekit The two models I combined are: https://huggingface.co/jeonsworld/CarbonVillain-en-10.7B-v2 https://huggingface.co/kyujinpy/Sakura-SOLAR-Instruct-DPO-v2 I used GGUF quantization. |