No files when downloading?
I just tried to download: http://microsoft/Phi-3-medium-128k-instruct-onnx-cuda
via Oobabooga (textgen) and it took like a second and said the files were downloaded successfully. I know this is not true.
Am I doing something wrong?
Did you enable git lfs locally before downloading? You can follow the setup instructions here to install git lfs.
Yes, but I'm a copywriter, not a coder. I tried to follow along with everything and it's not working. Literally have no idea what I'm doing.
I just want to use it with Oobabooga textgen. No worries, will wait for the GGUF quant so I can use it in Oobabooga.
If you just want to interact with the models, you can use the models hosted at https://ai.azure.com/explore/models?selectedCollection=phi&tid=72f988bf-86f1-41af-91ab-2d7cd011db47
If you are planning to integrate it in your apps, or run on specific devices ONNX models could be downloaded and tried using this gradio chat app https://github.com/microsoft/onnxruntime-genai/tree/main/examples/chat_app or the generate API() https://github.com/microsoft/onnxruntime-genai/blob/main/examples/python/phi-3-tutorial.md