Hugging Face's logo

Nioooor
/
q4_k_m_llama3

Question Answering
GGUF
English
llama
Inference Endpoints
Model card Files Community
README.md exists but content is empty.
Downloads last month
13
GGUF
Model size
8.03B params
Architecture
llama

4-bit

Inference Providers NEW
Question Answering
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for Nioooor/q4_k_m_llama3

Base model

meta-llama/Meta-Llama-3-8B
Quantized
unsloth/llama-3-8b-bnb-4bit
Quantized
(761)
this model

Dataset used to train Nioooor/q4_k_m_llama3