A third-party exchange usually holds the private keys of a custodial wallet; this is not the case for non-custodial wallets.