Edit model card

image/png

Mahou-1.3b-llama3-8B

Mahou is designed to provide short messages in a conversational context. It is capable of casual conversation and character roleplay.

Chat Format

This model has been trained to use ChatML format.

<|im_start|>system
{{system}}<|im_end|>
<|im_start|>{{char}}
{{message}}<|im_end|>
<|im_start|>{{user}}
{{message}}<|im_end|>

Roleplay Format

  • Speech without quotes.
  • Actions in *asterisks*
*leans against wall cooly* so like, i just casted a super strong spell at magician academy today, not gonna lie, felt badass.

SillyTavern Settings

  1. Use ChatML for the Context Template.
  2. Enable Instruct Mode.
  3. Use the Mahou preset.
  4. Recommended Additonal stopping strings: ["\n", "<|", "</"]

Method

ORPO finetuned on 2x RTX 4060 Ti for 1 epoch.

Fine-tune Llama 3 with ORPO

Downloads last month
10
Safetensors
Model size
8.03B params
Tensor type
BF16
·
Inference API
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for flammenai/Mahou-1.3b-llama3-8B

Finetuned
this model
Quantizations
2 models

Datasets used to train flammenai/Mahou-1.3b-llama3-8B

Collection including flammenai/Mahou-1.3b-llama3-8B