Laya fine-tuned on Typed Decisions

This derivative checkpoint fine-tunes the open-source Laya base model by Convai Innovations for typed decision-making sample sets.

Fine-tuned on 1,200 training cases (6,000 decisions) from LocalLLaMA/typed-decisions using two NVIDIA T4 GPUs for four epochs.

Official held-out evaluation

400 cases / 2,000 decisions.

Metric Result
Accuracy 0.769
Soft accuracy 0.5068
Brier score 0.0694
ECE 0.2150
Score MAE 0.2442
Within one level 0.9912
p50 latency 116.1 ms/case
p95 latency 153.8 ms/case

Accuracy 0.769 vs TypeSafe Jev 1.13.0 baseline 0.727 and teacher self-agreement 0.735.

Per workflow: agent trace 0.746, customer service 0.776, invoice processing 0.806, security incidents 0.748.

import laya
agent = laya.Agent("Ankit1106/laya-typed-decisions")
result = agent.predict(state, questions)

Full metrics are in laya_benchmark_report.json. This is a fine-tuned derivative checkpoint, not an ownership claim over Laya.

Downloads last month

-

Downloads are not tracked for this model. How to track
Safetensors
Model size
0.4B params
Tensor type
F16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support