ExLlamaV2 Quants for the community

by bartowski - opened Feb 29

Feb 29

In case anyone comes here looking for a way to run locally, I made some ExLlamaV2 quants for this model here:

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment