GGUF quants for Airoboros 65b 1.4, 2.0, and m2.0
#1
by
Nexesenex
- opened
Hello, Tom.
If that's not a hassle for you, could you please add in your todolist the GGUF quants for these 6 models, especially the 65b :
- https://huggingface.co/jondurbin/airoboros-65b-gpt4-1.4
- https://huggingface.co/ycros/airoboros-65b-gpt4-1.4.1-PI-8192-fp16
- https://huggingface.co/jondurbin/airoboros-65b-gpt4-2.0
- https://huggingface.co/jondurbin/airoboros-65b-gpt4-m2
- https://huggingface.co/TheBloke/airoboros-33B-gpt4-1-4-SuperHOT-8K-fp16
- https://huggingface.co/bhenrym14/airoboros-33b-gpt4-1.4.1-PI-8192-fp16
I know I'm asking a lot, but these models are part of our heritage ! ^^