If you lose access to your private key, you will lose access to your wallet, while a public key is also known as the wallet address.