hanswang73's picture

16

hanswang73

hanswang73

hanswang73

AI & ML interests

None yet

Organizations

None yet

hanswang73's activity

New activity in 01-ai/Yi-34B-Chat-4bits 10 months ago

这个一般推荐什么推理框架（来做stream）？

#2 opened 11 months ago by

New activity in deepseek-ai/deepseek-llm-67b-chat 11 months ago

Can you provide 4-bits version ?

#7 opened 11 months ago by

New activity in TheBloke/Yi-34B-Chat-AWQ 11 months ago

what is the difference between this model and https://huggingface.co/01-ai/Yi-34B-Chat-4bits ?

#1 opened 11 months ago by

New activity in BAAI/AquilaChat2-34B-16K about 1 year ago

这个会出4bits量化版本吗？

#1 opened about 1 year ago by

New activity in BAAI/AquilaChat2-34B about 1 year ago

4Bits量化版本马上就出来了吧？

#1 opened about 1 year ago by

New activity in BAAI/llm-embedder about 1 year ago

这个模型是干嘛用的？

#1 opened about 1 year ago by

New activity in baichuan-inc/Baichuan2-13B-Chat-4bits about 1 year ago

有测试过，2-13b-chat，4bits量化后，各种评分损失有多少吗？

#3 opened about 1 year ago by

New activity in BAAI/bge-reranker-large about 1 year ago

2个问题

#2 opened about 1 year ago by

New activity in baichuan-inc/Baichuan-13B-Chat about 1 year ago

关于量化8bits的推理速度

#31 opened about 1 year ago by

重复问题

#30 opened about 1 year ago by

英文推理报错

#26 opened about 1 year ago by

New activity in mosaicml/mpt-30b-chat about 1 year ago

Why inference is very slow?

#17 opened about 1 year ago by

New activity in intfloat/multilingual-e5-large about 1 year ago

Does it support chinese?

#6 opened about 1 year ago by

New activity in THUDM/chatglm-6b over 1 year ago

v1.1，加载时报错 Unable to load weights from pytorch checkpoint file for '...'. If you tried to load a PyTorch model from a TF 2.0 checkpoint, please set from_tf=True.

#72 opened over 1 year ago by