fenjun
dafen
·
AI & ML interests
None yet
Organizations
None yet
dafen's activity
vllm输出有 <|im_end|> 之类的情况
2
#1 opened 5 months ago
by
dafen
prompt好像还有些问题
1
#6 opened 5 months ago
by
dafen
请求适配vllm框架
4
#2 opened 5 months ago
by
dafen
always getting 0 in output
15
#3 opened 5 months ago
by
xubuild
能否上传到modelscope上,感谢
1
#6 opened 5 months ago
by
dafen
我尝试采用你们官方的vllm推理,发现和hf推理的结果相差非常大
2
#3 opened 7 months ago
by
dafen
指定GPU后会报错CUBLAS_STATUS_EXECUTION_FAILED
3
#1 opened 7 months ago
by
dafen
failed when loading model
3
#2 opened 8 months ago
by
ijustloveses
Can you please help me quantize vivo-ai/BlueLM-7B-Chat to int8?
#1 opened 7 months ago
by
dafen
OSError: We couldn't connect to 'https://huggingface.co' to load this file,
4
#7 opened 10 months ago
by
dafen