openchat

/

openchat-3.5-0106-gemma

like 52

lemon-mint/openchat-gemma-gguf

The provided link by boxqkrtm is down so I found two other GGUF versions, but neither work for me using either GPT4ALL or koboldcpp. I pasted them below in case they work for someone else.

https://huggingface.co/gguf/openchat-3.5-0106-gemma-GGUF

https://huggingface.co/bartowski/openchat-3.5-0106-gemma-GGUF

Have baked it today: https://huggingface.co/pi-null-mezon/openchat-3.5-0106-gemma-GGUF

Works both in llama.cpp and in ollama

Thanks @pi-null-mezon it's the first to load in GPT4ALL v2.7.3, but has a token issue (see bellow). This has happened before with GGUFs that later worked properly after GPT4ALL was updated. It takes a while for it to use the latest llama.cpp.

"Thelyricisfromthesong“ILoveIt”byMeghanTrainorfeaturingNickiMinajandCharliePuth,whichwasreleasedin2016."