Edit model card

Llama-3-Natsuki-DDLC-8b-v1

  • Model fine-tuned for Natsuki character from DDLC
  • Base: LLaMA-3
  • GGUFs

USAGE

For best results: replace "Human" and "Assistant" with "Player" and "Natsuki" like so:

\nPlayer: (prompt)\nNatsuki:

HYPERPARAMS

  • Trained for 1 epoch
  • rank: 32
  • lora alpha: 32
  • lora dropout: 0
  • lr: 2e-4
  • batch size: 2
  • grad steps: 4

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

WARNINGS AND DISCLAIMERS

This model is meant to closely reflect the characteristics of Natsuki. Despite this, there is always the chance that "Natsuki" will hallucinate and get information about herself wrong or act out of character.

Finally, this model is not guaranteed to output aligned or safe outputs, use at your own risk.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 62.02
AI2 Reasoning Challenge (25-Shot) 60.32
HellaSwag (10-Shot) 80.99
MMLU (5-Shot) 64.75
TruthfulQA (0-shot) 45.41
Winogrande (5-shot) 78.77
GSM8k (5-shot) 41.85
Downloads last month
1,377

Finetuned from

Dataset used to train 922-CA/Llama-3-natsuki-ddlc-8b-v1

Evaluation results