New k-quants formats
#6
by
mudler
- opened
Just for anyone, new k-quants model are compatible with LocalAI v1.18.0: https://github.com/go-skynet/LocalAI ( https://localai.io/basics/news/index.html#-06-06-2023-__v1180__- )
mudler
changed discussion title from
New k-quants
to New k-quants formats
Too bad there's no release for Windows.