Before revision:  More specifically , we first formally define the  learning to switch problem using finite horizon Markov decision processes .
After revision:  More specifically , we first formally define the learning to switch control among agents in a team via a 2-layer Markov decision process .