Avoid moving war files unecessarily

[#74546134] https://www.pivotaltracker.com/story/show/74546134

Signed-off-by: Morgan Fine <mfine@pivotallabs.com>