unsloth

/

mistral-7b-instruct-v0.2-bnb-4bit

like 26

@drunkOnData Oh https://github.com/unslothai/unsloth/wiki#saving-models-to-16bit-for-vllm

Also our Colab notebook for Mistral at the bottom has some merging code :) https://colab.research.google.com/drive/1Dyauq4kTZoLewQ1cApceUQVNcnnNTzg_?usp=sharing

Thank you!!! You da best 😊

@drunkOnData no problems!