Yes, it's not good for your eyes. Your eyes are especially sensitive, and rubbing them can lead to damage. It's also possible to accidentally introduce contaminants by transferring them from your hands to your eyes, which can make things worse.