We shouldn't restart apache until configured.

Change-Id: I1247a211412f32df52e846888fd3befe8d20e9ac