ValueError

by ceoofcapybaras - opened Jul 18

Jul 18

Expected shape (5120, 640) but received shape (4096, 640) for parameter model.layers.0.self_attn.q_proj.weight
after manually editing hidden state in config.json:
Expected shape (131072, 512) but received shape (131072, 640) for parameter model.embed_tokens.weight

AxelVirtual

Jul 18

same here : ValueError: Expected shape (5120, 640) but received shape (4096, 640) for parameter model.layers.0.self_attn.q_proj.weight

prince-canuma

MLX Community org Jul 19

Please install mlx-lm from source, the PR is not merged yet:

https://github.com/ml-explore/mlx-examples/pull/895

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment