Hugging Face's logo

lllyasviel
/
omost-llama-3-8b-4bits

Text Generation
Transformers
Safetensors
PyTorch
llama
trl
sft
conversational
text-generation-inference
4-bit precision
bitsandbytes
Model card Files Community
Edit model card

omost-llama-3-8b-4bits is Omost's llama-3 model with 8k context length in nf4.

Downloads last month
19,562
Safetensors
Model size
4.65B params
Tensor type
BF16
路
F32
路
U8
路
Inference API
Text Generation
Examples
Input a message to start chatting with lllyasviel/omost-llama-3-8b-4bits.
Inference API (serverless) has been turned off for this model.