metadata
base_model: Qwen/Qwen2.5-1.5B-Instruct
tags:
- text-generation-inference
- transformers
- unsloth
- trl
- grpo
license: apache-2.0
language:
- en
For function calling purpose
config = {
"rank": 8,
"alpha": 16,
"learning_rate": 2e-5,
"target_modules": ["mlps"]
}
I really don't know how to imporve these kind of model =((