GitHub repository: mightyhouseinc/minigpt4.cpp
Description: Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)