google
/

madlad400-10b-mt

text2text-generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

GGUF model how to run ?

#3

by Nondzu - opened Jan 13

Nondzu

Jan 13

Hi,
I see gguf files model-q6k.gguf model-q4k.gguf, how to run it ?
original llama.cpp looks like does not support madlad ?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment