Tiny Qwen3 Village Generator
A tiny character-level language model based on the Qwen3 architecture for generating Turkish village names.
This model was trained from scratch for educational purposes using 11,104 unique Turkish village names.
Model Information
- Architecture: Qwen3 (Tiny)
- Parameters: 20,672
- Vocabulary: 64 characters
- Context Length: 32
- Training Steps: 8,000
Dataset
Training dataset:
- Uunan/turkish-village-names
The dataset contains one Turkish village name per line.
Example Output
Ebrailler
Aşağıkarakış
Teçitönü
Ortakadoğaz
Ortalan
Odaderesi
Pireler
Nezciliye
Kunubel
Sazarören
Usage
python generate.py
Notes
- Character-level language model
- Trained from scratch
- Uses a tiny Qwen3-inspired transformer architecture
- Intended for educational and research purposes
- Outputs are synthetic and may not correspond to real village names
Acknowledgements
This project is based on the educational repository: