Rope Scaling factor
#5
by
jg-ipcopilot
- opened
Since this has a predefined scaling factor, would it be possible to update the config.json to reflect the definition as used by vLLM?
e.g. "rope_scaling": {"factor": 8.0, "type": "linear"}, as opposed to null
Thanks!
Hi,
Yes. It should be.
We have release new models LongAlpaca-7B/13B/70B. They are available in the following links. These models should be much better than these SFT models. We include the "rope_scaling" settings in their config.
https://huggingface.co/Yukang/LongAlpaca-7B
https://huggingface.co/Yukang/LongAlpaca-13B
https://huggingface.co/Yukang/LongAlpaca-70B-lora
Regards,
Yukang Chen
jg-ipcopilot
changed discussion status to
closed