Tsukiai Laya Fine-Tuned Decision Gate (tsukihime-exe/tsukiai-laya)
This repository contains the fine-tuned and metadata-prompt-tuned Laya Decision Gate for the Tsukiai Agent Pipeline.
Model Overview
- Base Model:
convaiinnovations/laya - Output Labels:
respond,ignore,optional - Primary Use Case: Classifying incoming live Discord messages and voice transcripts to decide whether Tsukiai should reply, remain silent, or treat as optional banter.
Benchmark Results (samlee.txt - 1,000 Examples)
Evaluating on 600 held-out test examples:
| Category | Baseline Accuracy | Tsukiai Tuned Accuracy |
|---|---|---|
| Overall Test Accuracy | 53.83% | 77.67% (+23.84%) |
direct_mention |
100.0% | 100.0% |
reply |
0.0% | 100.0% |
background |
100.0% | 100.0% |
ambiguous |
4.4% | 29.6% |
joke |
42.5% | 62.5% |
voice_transcript |
47.8% | 71.3% |
Quickstart Usage
import laya
# Load Tsukiai fine-tuned Laya gate directly from Hugging Face
model = laya.load("tsukihime-exe/tsukiai-laya", device="cuda")
# Predict typed decision
decision = model.predict("[Reply to Tsukiai] User: Hey Tsukiai, are you online?")
print("Decision:", decision) # -> 'respond'