Only attempt to remove the file if it exists