I found CognitiveFusion when searching for new models to use for instruct and roleplay based ineractions. This model blew me way instantly, and I knew I had to make some exl2 quants for it. I have held onto these for a while, as I have been out of my element uploading model cards to HF, but I finally decided to jump in. As of now I have only created 8.0BPW and 3.5BPW quants, but I do have plans to create 3.0, 4.0, 4.5, and 6.0 BPW quants when I am able to.
- Downloads last month
- 1