Kaiz Zhao

ishotoli's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

New activity in TheBloke/Yi-34B-200K-Llamafied-GPTQ 7 months ago

When loading 8-bits 128g onto A40 (48GB VRAM), an error occurs: CUDA out of memory.

3

#2 opened 7 months ago by ishotoli

New activity in LoneStriker/Yi-34B-200K-4.65bpw-h6-exl2 7 months ago

An error occurred when using Exllamav2 to load the model.

1

#2 opened 7 months ago by ishotoli

New activity in BAAI/AquilaChat2-34B-16K 8 months ago

非常感谢BAAI的开源项目，发现语料库的一点小问题

1

#3 opened 8 months ago by ishotoli

New activity in CalderaAI/30B-Lazarus-GPTQ4bit 12 months ago

Can you please provide the quantize_config.json file?

5

#1 opened about 1 year ago by ishotoli