Before revision:  More specifically , we first formally define the  learning to switch problem using finite horizon Markov decision processes .
After revision:  More specifically , we first formally define the problem of learning to switch problem using finite horizon Markov decision processes .