Don't re-highlight lines that were highlighted during drawing