clean up even when lazy-highlight-cleanup is nil

fixes #6