LagPixelLOL

v2ray's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in cognitivecomputations/DeepSeek-V3-0324-AWQ 3 days ago

why tokenizer_config.json changed for AWQ model.

2

#7 opened 3 days ago by

rockcat-miao

New activity in cognitivecomputations/DeepSeek-V3-0324-AWQ 4 days ago

Does FlashMLA support kv cache fp8 dtype and how to enable FlashMLA ?

9

#6 opened 12 days ago by

CharlesLincoln

New activity in cognitivecomputations/DeepSeek-R1-AWQ 5 days ago

AMD Instinct MI210 + vllm fail to run this model, any solutions please? Is there any other deepseek-r1-671b models that can run succesfully on AMD Instinct MI210 + vllm? Thanks!

5

#33 opened 6 days ago by

luciagan

New activity in cognitivecomputations/DeepSeek-R1-AWQ 15 days ago

How to Resolve "GLIBC_2.32 Not Found" Error When Deploying vLLM Environment?

8

#32 opened 20 days ago by

lastsummerLi

New activity in cognitivecomputations/DeepSeek-V3-0324-AWQ 20 days ago

Can the 4090 device run this model?

3

#3 opened 21 days ago by

jinzhongwei

vllm crach with a slightly longer prompt

1

#4 opened 20 days ago by

rockcat-miao

New activity in cognitivecomputations/DeepSeek-V3-0324-AWQ 21 days ago

可以添加一下LICENSE文件吗？

2

#2 opened 21 days ago by

adol-ch

New activity in cognitivecomputations/DeepSeek-R1-AWQ 21 days ago

Are there any updates to the recommended commands?

5

#27 opened 28 days ago by

NaiveYan

New activity in cognitivecomputations/DeepSeek-R1-AWQ 22 days ago

Why hasn't the MTP layer of the 61st layer been quantized?

1

#30 opened 22 days ago by

yang001002

Is there any testing on the support for running on other memory capacities

1

#29 opened 22 days ago by

HRan2004

New activity in cognitivecomputations/DeepSeek-R1-AWQ 26 days ago

Any one can run this model with SGlang framework？

5

#13 opened about 2 months ago by

muziyongshixin

New activity in cognitivecomputations/DeepSeek-R1-AWQ 27 days ago

DeepSeek-R1-AWQ quantized model missing one layer of experts

4

#28 opened 27 days ago by

virilo

New activity in cognitivecomputations/DeepSeek-R1-AWQ about 1 month ago

About the group size

1

#26 opened about 1 month ago by

Skyeaee

The awq quantization model may encounter garbled characters when performing inference on long texts.

9

#24 opened about 1 month ago by

wx111

How can I quantify my BF16 format model into AWQ?

1

#25 opened about 1 month ago by

AlipaySimon

Support for inference with MTP module?

1

#23 opened about 1 month ago by

yhh001

New activity in cognitivecomputations/DeepSeek-V3-AWQ about 2 months ago

poor performance for DeepSeek-V3-AWQ

2

#9 opened about 2 months ago by

fridayl

The V3-AWQ model's response seems not as expected

12

#8 opened about 2 months ago by

juxing

New activity in cognitivecomputations/DeepSeek-R1-AWQ about 2 months ago

Can't get 48 TPS on 8x H800

1

#21 opened about 2 months ago by

Light4Bear

New activity in v2ray/GPT4chan-8B about 2 months ago

gpt-4chan Neo-J

1

#1 opened about 2 months ago by

gman402