In this video, we run local inference on an Apple M3 MacBook with llama.cpp
Local inference shootout: Llama.cpp vs. MLX on 10B and 32B Arcee SLMs   In this video, we...
Tags: llm, ai, opensource, apple