Running the GGUF on Nvidia GTX 1080 8 GB VRAM and 32 GB RAM
#5
by realdopamine - opened
I was able to do so off a fork of llama.cpp I customized using opencode and zen deepseek v4. runs at 3 tps for tg....
I was able to do so off a fork of llama.cpp I customized using opencode and zen deepseek v4. runs at 3 tps for tg....