Only chmod if the file exists