GitHub repository: zhengpeirong/distributed-llama
Primary language: C++
Description: Leverage tensor parallelism techniques to run large language models in the CPU memory of edge devices.