Upon rebooting you'll find that the Internet Explorer icon is gone from your desktop and Windows works fine.
When you restart Internet Explorer's icon will be removed.