Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
XelotX
/
DeepSeek-V3-Quants
like
0
GGUF
conversational
Model card
Files
Files and versions
Community
Deploy
Use this model
No model card
Downloads last month
359
GGUF
Model size
671B params
Architecture
deepseek2
Chat template
Hardware compatibility
Log In
to view the estimation
2-bit
Q2_K_XS
221 GB
Q2_K
244 GB
Q2_K_L
244 GB
3-bit
Q3_K_M
319 GB
4-bit
Q4_K_M
404 GB
5-bit
Q5_K_M
475 GB
6-bit
Q6_K
551 GB
8-bit
Q8_0
713 GB
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Collection including
XelotX/DeepSeek-V3-Quants
DeepSeek-V3
Collection
5 items
•
Updated
Feb 4