add gguf

#1
by deleted - opened
deleted

add gguf version is more faster and take less memory on startup, thanks

Sign up or log in to comment