|
--- |
|
{} |
|
--- |
|
# Finetune Google Gemma model for Chinese Poem writing |
|
|
|
## Important! Gemma-IT format |
|
|
|
``` |
|
GEMMA_IT_FORMAT = """<start_of_turn>user |
|
{user_question}<end_of_turn> |
|
<start_of_turn>model |
|
""" |
|
``` |
|
|
|
## Before finetune using Gemma-it-7b |
|
|
|
``` |
|
Before training |
|
春风得意花铺路 |
|
春风得意花铺路，春暖花开，美不胜 |
|
美丽中国魅力北京 |
|
**美丽中国魅力北京，令人惊叹的现代与传统 |
|
鱼书千里梦 |
|
鱼书千里梦，是一个关于爱慕和成长的小说 |
|
日落晚霞临古寺 |
|
夕暮暮色，日落缓缓西下，将天空渲染成 Varies |
|
``` |
|
|
|
## After finetune (undertrained, after 10mins using T4 GPU, undertrained) |
|
|
|
``` |
|
春风得意花铺路 |
|
秋雨流派诗作韵<eos> |
|
美丽中国魅力北京 |
|
和谐社会和谐社会<eos> |
|
鱼书千里梦 |
|
鸟歌百载歌<eos> |
|
日落晚霞临古寺 |
|
月明清风送客船<eos> |
|
``` |
|
|
|
## Code to trigger this Lora ckpt (to be added) |
|
|
|
```python |
|
``` |
