The major difference is that a hot wallet is connected to the internet while a cold wallet is not. Keys are stored in a USB like device for cold wallet that will only be connected to a computer when you would like to use your crypto.