Fix an idempotency issue, because replacing the file every time is bad with WARs