Uunan/tiny-gemma4-village-generator

Tiny Gemma4 Village Generator

A tiny character-level language model based on the Gemma4 architecture for generating Turkish village names.

This model was trained from scratch for educational purposes using 11,104 unique Turkish village names.

Model Information

• Architecture: Gemma4 (Tiny)
• Parameters: 70,528
• Vocabulary: 64 characters
• Context Length: 32
• Training Steps: 8,000

Dataset

Training dataset:

• Uunan/turkish-village-names

The dataset contains one Turkish village name per line.

Example Output

Karadere
Aşağıova
Boztepe
Çamlıca
Akören

Usage

python generate.py

Notes

• Character-level language model
• Trained from scratch
• Uses a tiny Gemma4-inspired architecture with local and global attention
• Intended for educational and research purposes
• Outputs are synthetic and may not correspond to real village names

Acknowledgements

This project is based on the educational repository:

https://github.com/Uunan/tiny-village-llms