mixtral-instruct-8x7b for Q2KS as well

by shing3232 - opened Jan 22

Jan 22

AMD Rocm dont seems to support XS/XXS quants for now
so, maybe support Q2KS is needs.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment