YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
deepseek-v2: 2 representative decoder layers
Source: deepseek-ai/DeepSeek-V2.
Original dimensions, context/RoPE settings and precision metadata are retained. This directory contains no weights; use SGLang's native implementation with --load-format dummy.
| Layer | Source layer | Attention | FFN | Routing |
|---|---|---|---|---|
| 0 | 0 | MLA | dense | none |
| 1 | 1 | MLA | MoE | group_limited_greedy |
MTP draft layers retained: 0 (separate from the decoder). MTP requires a speculative draft-and-verify execution path; ordinary one_batch decoding does not run it.
- Downloads last month
- 31
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support