Edit model card

GGUFs

I'm happy with where this model currently is so I am releasing the 7b for testing. If I get good feedback I'll be scaling up to larger models! Thank you!

Datasets Used:

  • Dolphin
  • Ultrachat
  • Capybara
  • Augmental
  • ToxicQA
  • Magiccoder-Evol-Instruct-110k
  • Yahoo Answers
  • OpenOrca
  • Airoboros 3.1
  • grimulkan/physical-reasoning and theory-of-mind

Prompt Format: Chat ( The default Ooba template and Silly Tavern Template )

{System Prompt}

Username: {Input}
BotName: {Response}
Username: {Input}
BotName: {Response}

Recommended Silly Tavern Preset -> (Temp: 1.25, MinP: 0.1, RepPen: 1.03)

Recommended Kobold Horde Preset -> MinP

Downloads last month
27
GGUF
Model size
7.24B params
Architecture
llama

4-bit

5-bit

6-bit

8-bit

Inference API
Unable to determine this model's library. Check the docs .