Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
solidrust
/
llama-3-dragonmaid-8B-v2-AWQ
like
0
Follow
SolidRusT Networks
27
Text Generation
Transformers
Safetensors
llama
4-bit precision
AWQ
Inference Endpoints
conversational
text-generation-inference
awq
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
d81c84b
llama-3-dragonmaid-8B-v2-AWQ
/
quant_config.json
Suparious
adding quant config
d81c84b
verified
8 months ago
raw
Copy download link
history
blame
Safe
82 Bytes
{
"zero_point"
:
true
,
"q_group_size"
:
128
,
"w_bit"
:
4
,
"version"
:
"GEMM"
}