Yes, someone could access your system and change your network security key and lock you out of your network.