metadata

language:
  - en
license: apache-2.0
tags:
  - text-generation-inference
  - transformers
  - unsloth
  - mistral
  - trl
  - sft
base_model: LeroyDyer/Mixtral_AI_MiniTron

these little one are easy to train for task !!! ::

They already have some training (not great) But they can take more and more

(and being MISTRAL they can takes lora modules!)

Rememeber to add training on to the lora you merge withit : ie load the lora and train a few cycle on the same data that was applied in the p=lora (ie 20 Steps ) and

See it it took hold then merge IT!

Uploaded model

Developed by: LeroyDyer
License: apache-2.0
Finetuned from model : LeroyDyer/Mixtral_AI_MiniTron

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.