Adding the 'noAutoReject' tag for Tokens. Also:

   - fixing the check for empty productions to also consider the combination of notInRules and notInGround tags
   - adding back the <delete> line from ant clean that removes the /basic directory from the code to avoid cleanup issues in git.

@grosu @dwightguth please review.