mradermacher

/

Llama3-ChatQA-1.5-70B-GGUF

like 1

I can try - phi3 is not well supported by llama.cpp, so if it works it should still be suspected. Also, next time, please provide a url :)

Unfortunately, llama.cpp does not yet support phi3 128k. You can watch this issue regarding this problem:

https://github.com/ggerganov/llama.cpp/issues/6849

and once this is fixed, just ask me again and I will try again.