Methods for compressing the KV cache in transformer inference. E8 lattice, KVarN, TurboQuant, KIVI.
João André Gomes Marques
jmarquex
AI & ML interests
None yet
Recent Activity
updated a model about 20 hours ago
jmarquex/nexusquant updated a Space 2 days ago
jmarquex/nexusquant-demo updated a collection 8 days ago
KV Cache Compression MethodsOrganizations
None yet