Make sure we only remove the file when the file_path is set. Log exceptions.