Yes, not unless you want your flash drive to be corrupted. Ejecting USB mass storage devices before you disconnect them is the safest way to prevent any kind of damage to your data or the device itself.