Online Learning in Markov Decision Processes with Changing Cost Sequences
Logarithmic regret algorithms for online convex optimization