Text Generation
Transformers
PyTorch
English
llama
Inference Endpoints
text-generation-inference

Please provide a GGML version. or the necessary components to create it.

#13
by rombodawg - opened

llama.cpp finally added support for llama2 70b so a ggml version of this would be greatly appreciated!!!

This comment has been hidden

please look at this profile: https://huggingface.co/TheBloke

there are new GGML versions added all the time, maybe FreeWilly2 will be added there soon too

Yup, i actually asked him and there is currently an issue making ggml version of the llama 70b fine tuned models i believe a solution is being worked on though. Thanks for the response!

Sign up or log in to comment