Fix issues after actually testing in RHEL.

The certificate path already exists and we upload them there. No reason
to actually attempt to move them back into the same location.