Support for longrope implementation in llama.cpp
#88
by
ManniX-ITA
- opened
Could your team please also support the implementation of the new longrope in Phi-3 128K?
We can't convert and use the June 2024 updated models.
https://github.com/ggerganov/llama.cpp/issues/6849
Thanks!
Also doesn't work yet in VLLM and TGI :/