Task: Question Answering
Input (English): We evaluate our approach by training an autocomplete system on 500K randomly sampled sentences from Yelp reviews BIBREF6 (see Appendix for details). We quantify the efficiency of a communication scheme $(q_{\alpha },p_{\beta })$ by the retention rate of tokens, which is measured as the fraction of tokens that are kept in the keywords. The accuracy of a scheme is measured as the fraction of sentences generated by greedily decoding the model that exactly matches the target sentence. 
 Question: How are models evaluated in this human-machine communication game?
Output (English): by training an autocomplete system on 500K randomly sampled sentences from Yelp reviews