paul-stansifer
/

qw-mistral-2e-4-7b-gguf

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

https://wandb.ai/paul-stansifer/huggingface/runs/yr3gf551?nw=nwuserpaulstansifer

Loss should be 1.62626.

Uploaded model

Developed by: paul-stansifer
License: apache-2.0
Finetuned from model : unsloth/mistral-7b-bnb-4bit

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month: 19

GGUF

Model size

7.24B params

Architecture

llama

2-bit

4-bit

8-bit

Inference API

Unable to determine this model’s pipeline type. Check the docs .

Model tree for paul-stansifer/qw-mistral-2e-4-7b-gguf

Base model

unsloth/mistral-7b-bnb-4bit

Quantized

(129)

this model