System prompt during Fine Tuning
#117
by
matteoperiani
- opened
This question arise because I've fine tuned model with an empty system prompt and when provided during inference, the model basically ignore it. Instead, when the vanilla IT model is used, the system prompt affects quite good the generation of the response. I was wandering if this behavior derive from the fine tuning stage with an empty System prompt or something else.
Thank you!