llama.cpp: CPU vs GPU, shared VRAM and Inference Speed
This is the 2nd part of my investigations of local LLM inference speed. Here're the 1st and 3rd...
Tags: ai, machinelearning, llm, genai