Outdated:
Outdaded tokenizer configuration!
This is only kept for historical purposes, use the newer models instead of this one. Busy times, for the faint of heart, wait the storm.

This is yet another attempt with hopefully more stable formatting for quotes/asterisks dialogues.

GGUF-IQ-Imatrix quants for ResplendentAI/Aurora_l3_8B.

Recommended presets here or here.
Use the latest version of KoboldCpp. Use the provided presets.
This is all still highly experimental, modified configs were used to avoid the tokenizer issues, let the authors know how it performs for you, feedback is more important than ever now.

Original model information:

Aurora

image/png

A more poetic offering with a focus on perfecting the quote/asterisk RP format. I have strengthened the creative writing training.

Make sure your example messages and introduction are formatted cirrectly. You must respond in quotes if you want the bot to follow. Thoroughly tested and did not see a single issue. The model can still do plaintext/aserisks if you choose.

Downloads last month
55
GGUF
Model size
8.03B params
Architecture
llama

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference API
Unable to determine this model's library. Check the docs .

Collection including Lewdiculous/Aurora_l3_8B-GGUF-IQ-Imatrix