INTISARI-CHAT-V4

INTISARI-CHAT-V4 adalah LLM - LARGE LANGUAGE MODEL BAHASA INDONESIA Model chat Bahasa Indonesia berukuran kecil (~58.5M params) untuk percakapan natural casual.

Demo

Coba model secara langsung:

https://intisari.flatseek.io

Statistik

Parameter Nilai
Parameters 58.5M
Training Samples 50,047
Context Length 512 tokens
Epochs 3
Validation Loss 1.236
Validation PPL 3.44
Validation Accuracy 71.0%

Evaluasi

Metric Value
Avg tokens 13.21
Distinct-2 73.8%
Distinct-3 89.0%
Degeneration Rate 3.0%
Topic Drift 15.0%

Training Curves

Arsitektur

vocab_size:     8196
n_layers:        20
n_heads:         8
n_kv_heads:     2
hidden_dim:      512
ffn_dim:         1408
context_length:   512
rope_theta:      10000
activation:      SwiGLU
normalization:   RMSNorm

Training

Model dilatih menggunakan Flatbuild dengan 50,047 samples percakapan casual Bahasa Indonesia.

Topik percakapan:

  • Greeting & Opening
  • Small Talk
  • Question → Answer
  • Follow-up
  • Acknowledgement
  • Empathy & Emotional Support
  • Humor & Banter
  • Requests & Refusal
  • Topic Management
  • Conversation Ending

Training History

Epoch Val Loss PPL Accuracy
1 2.296 9.94 49.0%
2 1.665 5.28 61.1%
3 1.236 3.44 71.0%

Training Curves

Turn Distribution

Turns Percentage
2 turns 64.5%
3 turns 7.0%
4 turns 22.0%
5+ turns 6.5%

Evaluasi Generation

Generation Quality

Repetition Analysis

Prinsip Dataset

Teach the model how to converse naturally in Indonesian, not how to answer knowledge questions.

Prioritas: Naturalness > Coherence > Appropriateness > Diversity

Contoh Generation

Greeting

Prompt: <|user|>\nHalo\n<|assistant|>\n Output: Halo, aku baik. Kamu?

Food

Prompt: <|user|>\nUdah makan?\n<|assistant|>\n Output: Udah, kamu?

Emotion

Prompt: <|user|>\nGue capek banget\n<|assistant|>\n Output: Parah juga ya. Banyak kerjaan?

Casual

Prompt: <|user|>\nWeekend mau ngapain?\n<|assistant|>\n Output: Nggak tau nih. Lo?

Keterbatasan

  • Model kecil (~58.5M params), kemampuan terbatas
  • Tidak punya pengetahuan dunia yang luas
  • Generasi masih pendek

Lisensi

Apache 2.0


Dilatih menggunakan Flatbuild

Downloads last month
140
GGUF
Model size
60.6M params
Architecture
llama
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Dataset used to train INTISARI/intisari-indonesian-chat-v4