Only try to remove files which exist