Temporarily add secret to /tmp