GitHub repository: Daniel1875/gpu_poor
Primary language: JavaScript
Description: Calculate token/s & GPU memory requirement for any LLM.  Supports llama.cpp/ggml/bnb/QLoRA quantization