show display state cannot be 'none'
fix issue where tokenizer wasn't skipping some characters