CorticalStack's picture
Update README.md
6d7d742 verified
metadata
license: apache-2.0
Pastiche crown clown logo

CorticalStack/pastiche-crown-clown-7b-dare-dpo

An EXL2 6.5bpw quantised version of CorticalStack/pastiche-crown-clown-7b-dare-dpo.

An incomplete list of clients and libraries that are known to support EXL2:

  • text-generation-webui, the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
  • exllamav2, an inference library for running local LLMs on modern consumer GPUs.