New discussion

Loading gguf model for inference

1
#6 opened about 1 month ago by Rasi1610

Llama.cpp server support

3
#5 opened about 2 months ago by vigneshR

Does not work /:

10
#3 opened about 2 months ago by erikpro007

Can you provide the template?

6
#2 opened about 2 months ago by yanghan111

can you provide F16.gguf ?

5
#1 opened about 2 months ago by praymich