Collection of resources and models for storytelling and roleplay. Updated Jan 2025.
Current favorite: mistralai/Mistral-Small-24B-Instruct-2501
Some notes on best usage:
- some people prefer base models over instruct models, but base models are too unruly
- in general, roleplay finetunes I find to be braindamaged
- you also don't want to "overparameterize" by writing too long a prompt
- Conclusion: use original instruct models with short prompts
- actually, on second thought: this idea that the original instruct models have "higher intelligence" might be flawed. The other perspective is that the models are merely a representation of their dataset, which is why you might prefer finetunes and monster merges.
⚒️ Base models
- Llama 3 (8B) - the OG
- Mistral-Nemo-Base-2407 (12B)
- Qwen2.5
- Mistral Small
🤖 Instruct models
- Llama 3 Instruct
- Qwen 2.5 Instruct
- Mistral-Nemo-Instruct-2407 (12B)
- Mistral Small (22B) (instruct) - a winner?
😈 Story/roleplay-tuned models
- Sao10K/L3-8B-Stheno-v3.2
- Sao10K/Fimbulvetr-11B-v2
- nothingiisreal/MN-12B-Celeste-V1.9
- anthracite-org/magnum-12b-v2
- NeverSleep/Lumimaid-v0.2-8B
- nbeerbower/mistral-nemo-gutenberg-12B-v2
🧟♂️ Model merges
- MarinaraSpaghetti/NemoMix-Unleashed-12B - personal favorite
- Sao10K/L3-8B-Lunaris-v1
- aetherwiing/MN-12B-Starcannon-v3
Misc. links
- llama.cpp and llama-cpp-python - preferred LLM software
- /r/localllama
- /lmg/
- LMSys Chatbot Arena Leaderboard
- Uncensored General Intelligence Leaderboard
- /r/SillyTavernAI
- NothingiisReal discord
- NeverSleep discord
- SillyTavern discord
- BeaverAI discord
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.