Can't convert to safetensors
#6
by
bartowski
- opened
Any idea why? I get:
RuntimeError:
Some tensors share memory, this will lead to duplicate memory on disk and potential differences when loading them again: [{'model.embed_tokens.weight', 'lm_head.weight'}].
A potential way to correctly save your model is to use save_model.
More information at https://huggingface.co/docs/safetensors/torch_shared_tensors
I will be deprecating this variant of GemMoE soon in favor of beta 1.1 - will share that shortly.