Setting up a new power adapter involves unplugging the old one from the swing and the wall outlet, then connecting the new adapter to the swing and plugging it into the wall. Ensure the voltage and amperage of the new adapter match the swing's requirements to avoid damaging the swing.