To keep your Bitcoin USB wallet secure, you should always keep it offline when not in use, and store it in a secure location. You should also keep a backup of your wallet in case of loss or damage.