correctly uses tokenize to tell whether code is in comments