Before revision:  It can be difficult to accurately assess code generation performance, and there has been surprisingly little work on evaluating code generation in a way that is both flexible and rigorous .
After revision:  Despite its importance, there has been surprisingly little work on evaluating code generation in a way that is both flexible and rigorous .