works on 48GB

by gtkunit - opened Apr 13

Apr 13

Works great so far on 2x3090. Using cache in 8-bit, 4096 context and 2 experts. Can I recommend you add exl2 or similar in the title and files so other people can find this?

blockblockblock

Owner Apr 15

Works great so far on 2x3090. Using cache in 8-bit, 4096 context and 2 experts. Can I recommend you add exl2 or similar in the title and files so other people can find this?

Sure, can work on this soon

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment