A private key is generated along with the CSR and needs to be saved in a separate text document. In future, it will be required to install, renew, and also reinstall the SSL certificate.
It is important not to delete the key even after installing the SSL certificate!