Yes, you can polish wheels without removing them, but removing them often allows for a more thorough job.