Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
canada-quant
/
hy3-w4a16-mtp
like
2
Follow
Canada Quant Labs
30
Text Generation
Safetensors
5 datasets
English
Chinese
vllm
hy_v3
hy3
hunyuan
w4a16
gptq
int4
compressed-tensors
Mixture of Experts
mixture-of-experts
mtp
speculative-decoding
llmcompressor
conversational
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
1
Copy to bucket
new
2*6000 Pro possible ?
#1
by
mtcl
- opened
4 days ago
Discussion
mtcl
4 days ago
Is this possible to load on 2x6000 pros?
See translation
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment
