llama.native.js (npm): use `npm i --save llama.native.js` to run lama.cpp models on your local machine. features a socket.io server and client that can do inference with the host of the model.
Keywords: llm|wrapper|huggingface|javascript|llama.cpp|socket.io|dalai|quantized|cpu|text|generation