Spaces:

ggml-org

/

gguf-my-repo

like 309

Running

For example, trying to create a Q6_K from microsoft/Phi-3-mini-128k-instruct results in:

Error: Error converting to fp16: b'Traceback (most recent call last):\n File "/home/user/app/llama.cpp/convert-hf-to-gguf.py", line 2807, in \n main()\n File "/home/user/app/llama.cpp/convert-hf-to-gguf.py", line 2787, in main\n model_class = Model.from_model_architecture(hparams["architectures"][0])\n File "/home/user/app/llama.cpp/convert-hf-to-gguf.py", line 216, in from_model_architecture\n raise NotImplementedError(f'Architecture {arch!r} not supported!') from None\nNotImplementedError: Architecture 'Phi3ForCausalLM' not supported!\n'