Kevin June

FightLLM's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in cognitivecomputations/DeepSeek-R1-AWQ 2 months ago

why "MLA is not supported with awq_marlin quantization. Disabling MLA." with 4090 * 32 (4 node / vllm 0.7.2)

1

3

#14 opened 2 months ago by

FightLLM