Before revision:  More specifically , we first formally define the  learning to switch problem using finite horizon Markov decision processes .
After revision:  To this end , we first formally define the learning to switch problem using finite horizon Markov decision processes .