Raw weights for LoRA training

#6
by stablellama - opened

To train LoRAs it would be great to have the raw, undistilled weights as well. Can you publish them as well, please?

For LoRAs a good training adapter is likely all we need. For fine-tuning a raw version would be useful. Furthermore I hope we also get a raw version of the video model.

Sign up or log in to comment