hanswang73's picture

16

hanswang73

hanswang73

AI & ML interests

None yet

Organizations

None yet

hanswang73's activity

New activity in 01-ai/Yi-34B-Chat-4bits 5 months ago

这个一般推荐什么推理框架（来做stream）？

#2 opened 6 months ago by

New activity in deepseek-ai/deepseek-llm-67b-chat 5 months ago

Can you provide 4-bits version ?

#7 opened 5 months ago by

New activity in TheBloke/Yi-34B-Chat-AWQ 6 months ago

what is the difference between this model and https://huggingface.co/01-ai/Yi-34B-Chat-4bits ?

#1 opened 6 months ago by

New activity in BAAI/AquilaChat2-34B-16K 7 months ago

这个会出4bits量化版本吗？

#1 opened 7 months ago by

New activity in BAAI/AquilaChat2-34B 7 months ago

4Bits量化版本马上就出来了吧？

#1 opened 7 months ago by

New activity in BAAI/llm-embedder 7 months ago

这个模型是干嘛用的？

#1 opened 7 months ago by

New activity in baichuan-inc/Baichuan2-13B-Chat-4bits 8 months ago

有测试过，2-13b-chat，4bits量化后，各种评分损失有多少吗？

#3 opened 8 months ago by

New activity in BAAI/bge-reranker-large 8 months ago

2个问题

#2 opened 8 months ago by

New activity in baichuan-inc/Baichuan-13B-Chat 9 months ago

关于量化8bits的推理速度

#31 opened 9 months ago by

重复问题

#30 opened 9 months ago by

英文推理报错

#26 opened 9 months ago by

New activity in mosaicml/mpt-30b-chat 10 months ago

Why inference is very slow?

#17 opened 10 months ago by

New activity in intfloat/multilingual-e5-large 10 months ago

Does it support chinese?

#6 opened 10 months ago by

New activity in THUDM/chatglm-6b 12 months ago

v1.1，加载时报错 Unable to load weights from pytorch checkpoint file for '...'. If you tried to load a PyTorch model from a TF 2.0 checkpoint, please set from_tf=True.

#72 opened 12 months ago by