Test for correct behaviour when averaging and early stopping happens