Dracones

/

mixtral-8x22b-instruct-oh_exl2_5.0bpw

like 0

Using gpu-split 18,18,18,18,18,18,18,18 on 8x RTX 3090s, 21/20/19/19/19/5 GB (6x cards, 2x unused) actual usage with overhead taken account of.

No action required, just notating in these for people to see VRAM usage in these quants. Thanks for these, @Dracones !