tokens: While generalization across multi - task in multi - agent reinforcement learning has been studied in Omidshafiei-2017-ICML , to our best knowledge we are the first one to consider the multi - scenario multi - agent deep RL system .