No, you don't have to use a USB device when activating restore points. You can also select any other methods Windows provides, such as restoring from a system image or performing a full reset of your computer. The USB device must only create an external copy of your data before attempting a system restore.