fenjun's picture

10 5

fenjun

dafen

·

AI & ML interests

None yet

Organizations

None yet

dafen's activity

New activity in kiranr/internlm2-chat-20b-llama 5 months ago

vllm输出有 <|im_end|> 之类的情况

#1 opened 5 months ago by

New activity in internlm/internlm2-chat-20b 5 months ago

prompt好像还有些问题

#6 opened 5 months ago by

请求适配vllm框架

#2 opened 5 months ago by

New activity in TheBloke/Mixtral-8x7B-Instruct-v0.1-AWQ 5 months ago

always getting 0 in output

#3 opened 5 months ago by

New activity in yuyijiong/Qwen-14b-chat-yarn-32k 5 months ago

能否上传到modelscope上，感谢

#6 opened 5 months ago by

New activity in vivo-ai/BlueLM-7B-Chat-32K 7 months ago

我尝试采用你们官方的vllm推理，发现和hf推理的结果相差非常大

#3 opened 7 months ago by

New activity in vivo-ai/BlueLM-7B-Base-32K 7 months ago

指定GPU后会报错CUBLAS_STATUS_EXECUTION_FAILED

#1 opened 7 months ago by

New activity in vivo-ai/BlueLM-7B-Chat-32K 7 months ago

failed when loading model

#2 opened 8 months ago by

New activity in TheBloke/KAI-7B-Instruct-GPTQ 7 months ago

Can you please help me quantize vivo-ai/BlueLM-7B-Chat to int8?

#1 opened 7 months ago by

New activity in baichuan-inc/Baichuan2-13B-Chat 9 months ago

OSError: We couldn't connect to 'https://huggingface.co' to load this file,

#7 opened 10 months ago by