x2ray/wheels
Updated
LagPixelLOL
v2ray
AI & ML interests
Looking for compute sponsors, please contact me through my email 2282688304@qq.com!
Recent Activity
updated
a model
about 22 hours ago
x2ray/wheels
updated
a dataset
1 day ago
v2ray/r-chatgpt-general-dump
new activity
2 days ago
cognitivecomputations/DeepSeek-R1-AWQ:About the group size
Organizations
v2ray's activity
updated
a
model
about 22 hours ago
updated
a
dataset
1 day ago
About the group size
1
#26 opened 2 days ago
by
Skyeaee
The awq quantization model may encounter garbled characters when performing inference on long texts.
9
#24 opened 10 days ago
by
wx111
How can I quantify my BF16 format model into AWQ?
1
#25 opened 9 days ago
by
AlipaySimon
Support for inference with MTP module?
1
#23 opened 11 days ago
by
yhh001
poor performance for DeepSeek-V3-AWQ
2
#9 opened 16 days ago
by
fridayl
The V3-AWQ model's response seems not as expected
12
#8 opened 18 days ago
by
juxing
updated
a
model
19 days ago
published
a
model
19 days ago
Can't get 48 TPS on 8x H800
1
#21 opened 20 days ago
by
Light4Bear
gpt-4chan Neo-J
1
#1 opened 20 days ago
by
gman402
Pipeline Parallellism
1
#20 opened 20 days ago
by
leo98xh
8*a100 OUT OF MEMORY
1
#19 opened 20 days ago
by
Jaren
requests get stuck when sending long prompts (already solved, but still don't know why?)
1
#18 opened 20 days ago
by
uv0xab
Significant Speed Drop with Increasing Input Length on H800 GPUs
2
#17 opened 21 days ago
by
wangkkk956
Docker start with vllm failed. Official vllm docker image 0.7.3
1
#7 opened 21 days ago
by
kuliev-vitaly
when i use vllm v0.7.2 to deploy r1 awq, i got empty content
13
#10 opened 29 days ago
by
bupalinyu
why "MLA is not supported with awq_marlin quantization. Disabling MLA." with 4090 * 32 (4 node / vllm 0.7.2)
3
#14 opened 22 days ago
by
FightLLM
when i run command ,it didnot work. ( via vllm 0.7.3)
2
#16 opened 21 days ago
by
xueshuai