Before revision: Thompson sampling consists in playing the action according to the probability that it maximizes the expected reward; action is chosen with probability where is the indicator function.
After revision: Thompson samplofg consists in playing the action according to the probability that it maximizes the expected reward; action is chosen with probability where is the indicator function.