Make sure we try to unlink an existing file. This prevents errors on first run.