LeroyDyer/Mixtral_AI_MiniTron_Chat

these little one are easy to train for task !!! ::

They already have some training (not great) But they can take more and more

(and being MISTRAL they can takes lora modules!)

Rememeber to add training on to the lora you merge withit : ie load the lora and train a few cycle on the same data that was applied in the p=lora (ie 20 Steps ) and

See it it took hold then merge IT!

Uploaded model

• Developed by: LeroyDyer
• License: apache-2.0
• Finetuned from model : LeroyDyer/Mixtral_AI_MiniTron

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.