jim's picture

7 1 32

jim

jmjzz

·

AI & ML interests

None yet

Organizations

None yet

jmjzz's activity

New activity in PrunaAI/dbrx-instruct-bnb-4bit 2 months ago

generation is not good

#2 opened 2 months ago by

New activity in databricks/dbrx-instruct 2 months ago

OSError: You are trying to access a gated repo. Make sure to have access to it at https://huggingface.co/databricks/dbrx-instruct.

#33 opened 2 months ago by

The fused expert parameters means load_in_4bit doesn't work properly, nor does LoRA

#10 opened 2 months ago by

New activity in databricks/dbrx-instruct 2 months ago

We can't copy/paste?

#3 opened 2 months ago by

New activity in Crystalcareai/GemMoE-Base-Random 2 months ago

from_pretrained() extremely slow

#5 opened 2 months ago by

New activity in Crystalcareai/GemMoE-Base-Random 3 months ago

Inference code

#1 opened 3 months ago by

New activity in Crystalcareai/GemMoE-Beta-1 3 months ago

Memory requirement

#4 opened 3 months ago by