Before revision:   The main novelties are that we do not assume a Markovian nature of the game nor a particular structure of the information available to the players.
After revision:  As a by-product of our method of proof we also obtain existence of optimal strategies for both players. The main novelties are that we do not assume a Markovian nature of the game nor a particular structure of the information available to the players.