Don't try to remove the pending file if it doesn't exist.