Multi-robot -> stochastic games