jack seaver's picture

6

jack seaver

tutu329

AI & ML interests

None yet

Organizations

None yet

tutu329's activity

New activity in bosonai/Higgs-Llama-3-70B 1 day ago

it is a 70B model. why using almost 280GB disk？

#7 opened 1 day ago by

New activity in jarrelscy/Mixtral-8x22B-Instruct-v0.1-GPTQ-4bit about 2 months ago

KeyError: 'model.layers.45.block_sparse_moe.gate.g_idx'

#2 opened about 2 months ago by

New activity in Dogge/llama-3-70B-instruct-uncensored about 2 months ago

will there be a gptq int4 version?

#1 opened about 2 months ago by

New activity in jarrelscy/Mixtral-8x22B-Instruct-v0.1-GPTQ-4bit about 2 months ago

no special_tokens_map.json tokenizer_config.json and tokenizer.json

#1 opened about 2 months ago by

New activity in MaziyarPanahi/miqu-1-70b-sf-GPTQ 4 months ago

vllm can not inter this model (other 70b gptq model are ok)

#1 opened 4 months ago by

New activity in TheBloke/Qwen-14B-Chat-AWQ 6 months ago

hope there is a qwen-72b-chat-awq（can be inferenced by vllm）

#3 opened 6 months ago by