Good performance in CPU
#2
by tstello - opened
I performed some tests using this model for translation, using CPU mode with llama.cpp on 24 cores, consuming less than 25% CPU, 4 GB RAM and averaging 40 t/s.
I performed some tests using this model for translation, using CPU mode with llama.cpp on 24 cores, consuming less than 25% CPU, 4 GB RAM and averaging 40 t/s.