Before revision:  In the discounted setting , the Gittins index reduces the one-player problem to the comparison between a risky arm, with a prior \mu, and a predictable arm  with success probability p.
After revision:  With discount factor \beta , the Gittins index reduces the one-player problem to the comparison between a risky arm, with a prior \mu, and a predictable arm with success probability p.