Make sure file exists before removal