add gguf version is more faster and take less memory on startup, thanks
· Sign up or log in to comment