Before revision: the expected reward given the sampled parameters, the action and the current context.
After revision: ,the expected reward given the sampled parameters, the action and the current context.