[Question] Ideal Vram and Ram distribution

by muratowski - opened Aug 31

Aug 31

In order to run Q4 models efficiently and fairly quickly, how much vram and CPU ram should be distributed simultaneously in Ollama for PC?

muratowski changed discussion title from Ideal Vram and Ram distribution to [Question] Ideal Vram and Ram distribution Aug 31

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment