early stop kicks in only after patience+1 validation runs