GitHub repository: mohsenhariri/kvq
Primary language: Makefile
Description: More for Keys, Less for Values: Adaptive KV Cache Quantization ☝️🔑👇🔢