throw errors from refresh before running tests