Edit model card

Uploaded model

  • Developed by: glouriousgautam
  • License: apache-2.0
  • Finetuned from model : unsloth/mistral-7b-instruct-v0.3-bnb-4bit

An efficient instruction finetune of the Mistral-7B_0.3 in 4bit bnb for good performance with ~5GB of vram inference.

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
1
Inference API
Input a message to start chatting with glouriousgautam/Mistral7b_v03_short_chat.
Model is too large to load in Inference API (serverless). To try the model, launch it on Inference Endpoints (dedicated) instead.

Finetuned from