Tried to apply the UCB1-Tuned algorithm, still a problem with the V(.)
term. Which doesn't get smaller than 1/4.