Question: How does the SCAN dataset evaluate compositional generalization?
Answer: it systematically holds out inputs in the training set containing basic primitive verb, "jump", and tests on sequences containing that verb.