Task: Language Identification
Input (Spanish, English): I like the setting presented in this paper but I have several criticism/questions:  (1) What are the failure model of this work? As richness of behaviors get complex, I expected this approach to have issues with the diversity of skills that could be discovered.  (2) Looking at Sec 5.3 -- " let X be a random variable denoting the grid in which the agent is currently situated" -- is the space discretized? And if so why and what happens if it isn't.   (3) Expanding on the first point, does the approach work with more complicated embodiment? Say a 5-link swimmer instead of 2? I think this is important to assess the generality of this approach  (4) Authors claim that "Recently, Heess et al. (2016) have independently proposed to learn a range of skills in a pre-training environment that will be useful for the downstream tasks, which is similar to our framework. However, their pre-training setup requires a set of goals to be specified. In comparison, we use intrinsic rewards as the only signal to the agent during the pre-training phase, the construction of which only requires very minimal domain knowledge."  I don't entirely agree with this. The rewards that this paper proposes are also quite hand-crafted and specific to a seemingly limited set of control tasks.
Output (English): en