Hugging Face's logo

rAIfle
/
Interim-MN-fp16

Text Generation
Transformers
Safetensors
mistral
unsloth
trl
sft
conversational
text-generation-inference
Inference Endpoints
Model card Files Community

Interim-MN-fp16

Interim

This one was a doozy. Three restarted runs of which one failed at the last possible moment... Anyway, the result is decent enough and passes my own Nala-testing so it's not too bad. Not gonna benchmark this myself but if anyone feels the need to then I'd be happy to include numbers here.

Probably best if using normal Nemo settings, no weird stuff. (Or just use the recommended ones in the Recommended Settings repo)

iMat GGUFs courtesy of your local Cartel frens

Downloads last month
11
Safetensors
Model size
12.2B params
Tensor type
BF16
·
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for rAIfle/Interim-MN-fp16

Quantizations
2 models

Collection including rAIfle/Interim-MN-fp16