Metric for best model

#5
by learn3r - opened

Hi @Stancld I'm currently training a model on longt5-xl doing the summ_screen_fd summarization task. During training I found that the training loss decreases and evaluation rouge score increases, but evaluation loss also increases. Do you recommend using metric_for_best_model as loss or rouge in this case? Thanks!

Sign up or log in to comment