Fix stale files in /tmp breaking cleanup

Wait for a couple of seconds until it is safe to delete all files in /tmp.