What you want to plot is usually the score on the whole training subset that has been used to train the model and not just on the current "subsubset".