Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
qwp4w3hyb
/
Hermes-3-Llama-3.1-8B-iMat-GGUF
like
0
GGUF
Inference Endpoints
conversational
Model card
Files
Files and versions
Community
Deploy
Use this model
No model card
Downloads last month
50
GGUF
Model size
8.03B params
Architecture
llama
1-bit
IQ1_S
2-bit
IQ2_XXS
3-bit
IQ3_XXS
4-bit
IQ4_XS
IQ4_NL
Q4_0
Q4_K_M
5-bit
Q5_K_M
6-bit
Q6_K
8-bit
Q8_0
16-bit
BF16
View +2 files
Inference API
Unable to determine this model's library. Check the
docs
.