--- license: apache-2.0 tags: - merge - not-for-all-audiences --- ## **DarkForest-20B-v3.0** [exllamav2](https://github.com/turboderp/exllamav2) quant for [TeeZee/DarkForest-20B-v3.0](https://huggingface.co/TeeZee/DarkForest-20B-v3.0) using specialized dataset [openerotica/erotiquant](https://huggingface.co/datasets/openerotica/erotiquant) Runs smoothly on single 3090 in webui with context length set to 4096, ExLlamav2_HF loader and cache_8bit=True All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel: Buy Me A Coffee