23 4 14

cicdatopea

cicdatopea

AI & ML interests

None yet

Recent Activity

new activity about 18 hours ago

OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc:Qwen2.5-VL-72B-Instruct quant?

new activity about 18 hours ago

OPEA/DeepSeek-R1-int4-gptq-sym-inc:VLLM 0.7.2 can start the model normally, but there is no output when simulating a request using Curl, it blocks!

new activity 8 days ago

OPEA/DeepSeek-R1-int2-gptq-sym-inc:Could we get a int3 version of gptq please?

View all activity

Organizations

cicdatopea's activity

New activity in OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc about 18 hours ago

Qwen2.5-VL-72B-Instruct quant?

#1 opened 4 days ago by

samgreen

New activity in OPEA/DeepSeek-R1-int4-gptq-sym-inc about 18 hours ago

VLLM 0.7.2 can start the model normally, but there is no output when simulating a request using Curl, it blocks!

#2 opened about 2 months ago by

JZMALi

New activity in OPEA/DeepSeek-R1-int2-gptq-sym-inc 8 days ago

Could we get a int3 version of gptq please?

#1 opened 8 days ago by

davidsyoung

New activity in kaitchup/QwQ-32B-AutoRoundGPTQ-4bit 11 days ago

Qwen-32B overflow issue

#1 opened 18 days ago by

cicdatopea

New activity in kaitchup/Qwen2.5-72B-Instruct-AutoRound-GPTQ-4bit 11 days ago

how to run this model

#1 opened 11 days ago by

cicdatopea

New activity in deepseek-ai/DeepSeek-V3-0324 14 days ago

Can a quantized version of deepseek-v3-0324 be implemented on a machine with a cluster of 8 *A100s?

#19 opened 14 days ago by

xueshuai

New activity in OPEA/DeepSeek-V3-int4-sym-awq-inc 15 days ago

without licence

#2 opened 15 days ago by

Futureli

New activity in OPEA/DeepSeek-R1-fp8-static-w8a8-inc 18 days ago

how to inference this model?

#1 opened 18 days ago by

xiximayou

New activity in OPEA/gemma-3-27b-it-int4-AutoRound-cpu 19 days ago

so consider build a model for GPU?

#1 opened 19 days ago by

New activity in kaitchup/Llama-3.3-70B-Instruct-AutoRound-GPTQ-4bit about 1 month ago

Your quants are not listed in the base model

#2 opened about 1 month ago by

dazipe

New activity in OPEA/DeepSeek-R1-int4-gptq-sym-inc about 2 months ago

sglang inference issue

#1 opened about 2 months ago by

su400

New activity in OPEA/DeepSeek-V3-int4-sym-awq-inc 2 months ago

Start on cpu with vllm.

#1 opened 2 months ago by

kuliev-vitaly

New activity in Intel/Qwen2-7B-int4-inc 3 months ago

“a larger accuracy drop in Chinese tasks"? how much exectaly?

#1 opened 3 months ago by

chuangzhidian

New activity in OPEA/DeepSeek-V3-int4-sym-gptq-inc 3 months ago

A bug when running the demo inference on GPU

#5 opened 3 months ago by

HuggingLianWang

vllm

#4 opened 3 months ago by

NikolaSigmoid

Base model please!

#2 opened 3 months ago by

deltanym

New activity in OPEA/deepseek-vl2-int4-sym-gptq-inc 3 months ago

ValueError: Invalid modules, at least two modules detected as dependent, {shortest_module} and {longest_module}

#3 opened 3 months ago by

Maverick17

New activity in OPEA/DeepSeek-V3-int4-sym-gptq-inc 3 months ago

engine

#3 opened 3 months ago by

ehartford

New activity in OPEA/DeepSeek-V2.5-1210-int4-sym-inc 3 months ago

alternative serving framework

#1 opened 3 months ago by

erichartford

New activity in OPEA/deepseek-vl2-int4-sym-gptq-inc 3 months ago

Update README.md

#1 opened 3 months ago by

n1ck-guo