Was config.json accidentally replaced with the 33B config?
#3
by
masharpe
- opened
I am just getting started with exllama, and had an error opening this model. It appears that the commit e9aae5d67910407a0c2fcd39d23fbfe4f61ab341 may have accidentally replaced config.json with that of 33B. For example, num_hidden_layers was changed to 60, when it should be 80, I believe, like it is in Neko-Institute-of-Science/LLaMA-65B-4bit-128g. Replacing the config.json with the one from that other model seems to work.
yeah looks like that lol... Will fix it.
done.
Neko-Institute-of-Science
changed discussion status to
closed
Thanks, it works for me now.